-- Logs begin at Tue 2021-11-23 03:11:25 UTC, end at Tue 2021-11-23 04:35:49 UTC. -- Nov 23 03:53:51.521999 dv-cinder-768458-16-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Nov 23 03:53:51.530650 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 23 03:53:51.533633 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 23 03:53:51 2021] *** Nov 23 03:53:51.533633 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 23 03:53:51.533633 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 23 03:53:51.533633 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: nodename: dv-cinder-768458-16-iscsi Nov 23 03:53:51.533633 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: machine: x86_64 Nov 23 03:53:51.533633 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: clock source: unix Nov 23 03:53:51.533633 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: pcre jit disabled Nov 23 03:53:51.533633 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: detected number of CPU cores: 4 Nov 23 03:53:51.533633 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: current working directory: / Nov 23 03:53:51.533633 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: detected binary path: /usr/bin/uwsgi-core Nov 23 03:53:51.533633 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: your processes number limit is 47680 Nov 23 03:53:51.533633 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: your memory page size is 4096 bytes Nov 23 03:53:51.533633 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: detected max file descriptor number: 2048 Nov 23 03:53:51.533633 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: lock engine: pthread robust mutexes Nov 23 03:53:51.533633 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: thunder lock: enabled Nov 23 03:53:51.533633 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 23 03:53:51.533633 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 23 03:53:51.578263 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: Python main interpreter initialized at 0x55b726f039c0 Nov 23 03:53:51.578263 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: python threads support enabled Nov 23 03:53:51.578263 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: your server socket listen backlog is limited to 100 connections Nov 23 03:53:51.578263 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: your mercy for graceful operations on workers is 90 seconds Nov 23 03:53:51.578648 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: mapped 403077 bytes (393 KB) for 2 cores Nov 23 03:53:51.578725 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: *** Operational MODE: preforking *** Nov 23 03:53:51.578953 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: *** uWSGI is running in multiple interpreter mode *** Nov 23 03:53:51.578953 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: spawned uWSGI master process (pid: 79235) Nov 23 03:53:51.579160 dv-cinder-768458-16-iscsi systemd[1]: Started Devstack devstack@keystone.service. Nov 23 03:53:51.583251 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: spawned uWSGI worker 1 (pid: 79250, cores: 1) Nov 23 03:53:51.583251 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: spawned uWSGI worker 2 (pid: 79251, cores: 1) Nov 23 03:53:51.583251 dv-cinder-768458-16-iscsi devstack@keystone.service[79235]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 23 03:53:56.697709 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 03:53:56.697709 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: from cryptography.utils import int_from_bytes Nov 23 03:53:56.698397 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 03:53:56.698397 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: from cryptography.utils import int_from_bytes Nov 23 03:53:56.698527 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 03:53:56.698527 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: from cryptography.utils import int_from_bytes Nov 23 03:53:56.698527 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 03:53:56.698527 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: from cryptography.utils import int_from_bytes Nov 23 03:53:56.747444 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 03:53:56.747615 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 03:53:56.747697 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 03:53:56.747789 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 03:53:56.747865 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] command line args: [] {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 03:53:56.747939 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] command line args: [] {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 03:53:56.748083 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 03:53:56.748212 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 03:53:56.748300 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ================================================================================ {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 03:53:56.748387 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ================================================================================ {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 03:53:56.748506 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] admin_token = **** {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.748590 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] admin_token = **** {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.748750 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] config_dir = [] {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.748832 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] config_dir = [] {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.748939 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.749027 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.749104 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] config_source = [] {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.749179 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] config_source = [] {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.749289 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] debug = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.749373 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] debug = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.749489 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.749735 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.749879 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.749960 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.750026 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.750094 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.750265 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.750351 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.750513 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.750591 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.750744 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] list_limit = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.750833 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] list_limit = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.750940 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] log_config_append = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.751019 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] log_config_append = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.751085 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.751147 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.751288 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] log_dir = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.751471 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] log_dir = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.751541 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] log_file = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.751604 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] log_file = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.751667 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.751725 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.751916 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.752038 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.752153 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.752244 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.752389 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.752487 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.752570 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.752641 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.752755 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.752877 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.752990 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.753090 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.753234 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.753381 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.753506 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.753633 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.753758 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.753890 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.753890 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.754129 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.754129 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.754371 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.754497 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.754628 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.754748 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.754829 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.754905 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.755028 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.755356 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.54/identity {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.755456 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.54/identity {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.755530 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] publish_errors = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.755662 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] publish_errors = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.755767 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.755844 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.756089 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.756692 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.756822 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.756930 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.757058 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.757154 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.757257 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.757397 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.757482 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] standard_threads = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.757643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] standard_threads = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.757727 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.757879 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.757963 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.758108 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.758191 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.758286 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] use_journal = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.758370 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.758464 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] use_journal = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.758540 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] use_json = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.758622 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] use_stderr = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.758733 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] use_json = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.758833 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] use_syslog = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.758939 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] use_stderr = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.759049 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] use_syslog = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.759200 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.759326 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 03:53:56.759422 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.759531 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.759634 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.759766 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.759878 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.760009 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.760119 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.760260 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.760364 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.760515 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.760625 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.760759 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.760876 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.761014 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.761121 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.761257 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.761374 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.761511 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.761616 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.761792 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.761904 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.762001 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.762102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.762232 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.762347 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.762453 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.762549 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.762704 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.762814 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.762956 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.763072 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.763250 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.763366 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.763513 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.763617 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.763718 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.763833 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.763931 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.764031 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.764166 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.764270 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.764420 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.764536 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.764692 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.764797 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.765041 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.765121 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.765294 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.765382 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.765531 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.765615 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.765764 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.765851 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.765996 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.766102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.766233 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.766311 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.766475 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.766604 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.766724 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.766801 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.766959 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.767044 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.767193 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.767325 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.767452 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.767539 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.767705 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.767788 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.767945 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.768026 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.768190 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.768268 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.768426 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.768503 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.768666 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.768749 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.768905 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.768987 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.769138 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.769220 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.769370 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.769453 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.769602 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.769688 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.769836 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.769914 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.770070 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.770146 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.770312 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.770425 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.770542 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.770626 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.770780 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.770864 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.771013 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.771091 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.771267 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.771350 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.771505 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.771604 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.771780 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.771863 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.772035 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.772272 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.772349 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.772514 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.772591 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.772755 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.772841 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.772995 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.773072 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.773233 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.773317 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.773472 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.773560 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.773706 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.773782 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.773959 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.774037 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.774196 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.774274 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.774434 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.774512 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.774673 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.774812 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.774930 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.775017 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.775167 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.775296 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.775425 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.775502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.775666 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.775751 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.775904 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.775987 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.776171 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.776248 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.776409 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.776498 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.776660 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.776737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.776896 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.776973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.777146 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.777231 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.777384 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.777460 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.777625 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.777702 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.777862 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.777947 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.778098 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.778181 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.778332 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.778414 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.778568 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.778655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.778826 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.778903 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.779070 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.779153 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.779330 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.779422 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.779564 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.779641 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.779796 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.779873 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.780025 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.780111 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.780261 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.780339 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.780492 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.780572 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.780723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.780809 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.780959 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.781036 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.781207 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.781284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.781445 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.781601 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.781704 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.781784 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.781962 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.782038 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.782205 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.782293 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.782440 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] auth.external = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.782516 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] auth.external = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.782671 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.782747 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.782968 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.783047 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.783202 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.783327 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.783457 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] auth.password = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.783533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] auth.password = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.783690 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] auth.token = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.783768 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] auth.token = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.783934 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.784018 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.784169 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.784245 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.784418 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.784495 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.784648 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.784730 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.784895 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.784973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.785143 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.785227 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.785374 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.785482 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.785609 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] credential.caching = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.785687 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] credential.caching = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.785856 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.785934 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.786105 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.786185 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.786353 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.786430 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.786590 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.786673 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.786833 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.786911 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.787070 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.787147 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.787366 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.787455 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.787628 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.787891 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.787984 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.788064 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.788138 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.788297 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.788386 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.788584 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.788663 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.788832 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.788910 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.789097 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.789184 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.789340 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.789419 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.789579 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] federation.caching = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.789656 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.789822 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] federation.caching = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.789907 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.790070 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.790147 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.790321 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.790435 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.790550 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.790636 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.790784 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.790867 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.791027 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.791105 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.791284 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.791381 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.791542 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.791621 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.791780 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.791858 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.792025 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.792114 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.792264 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.792341 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.792503 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] identity.caching = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.792581 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.792737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] identity.caching = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.792821 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.792984 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.793062 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.793221 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.793298 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.793454 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.793538 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.793690 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.793768 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.793926 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.794002 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.794162 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.794241 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.794401 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.794479 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.794651 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.794730 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.794885 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.794969 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.795120 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.795199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.795375 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.795464 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.795609 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.795688 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.795857 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.795935 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.796104 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.796182 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.796352 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.796431 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.796600 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.796685 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.796847 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.796924 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.797106 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.797184 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.797347 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.797425 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.797583 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.797667 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.797813 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.797887 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.798041 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.798119 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.798273 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.798357 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.798509 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.798595 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.798750 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.798826 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.798986 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.799063 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.799260 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.799343 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.799479 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.799557 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.799727 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.799805 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.799964 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.800044 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.800199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.800275 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.800444 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.800522 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.800676 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.800756 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.800911 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.800994 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.801143 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.801219 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.801372 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.801456 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.801611 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.801688 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.801847 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.801925 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.802085 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.802164 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.802320 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.802396 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.802558 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.802635 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.803332 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.803497 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.803629 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.803737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.803872 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.804127 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.804222 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.804380 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.804459 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.804620 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.804697 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.804860 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.804947 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.805099 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.805176 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.805332 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.user = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.805408 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.805566 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.805651 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.805798 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.user = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.805876 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.806038 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.806117 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.806287 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.806366 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.806517 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.806595 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.806765 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.806843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.807001 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.807080 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.807252 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.807335 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.807494 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.807572 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.807723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.807802 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.807959 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.808038 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.808193 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.808270 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.808428 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.808507 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.808661 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.808739 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.808909 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.808996 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.809158 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.809238 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.809403 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.809480 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.809634 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.809711 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.809884 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.809963 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.810116 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.810194 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.810354 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.810430 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.810591 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.810672 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.810828 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.810905 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.811063 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.811142 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.811323 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.811404 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.811570 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.811648 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.811820 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.811898 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.812055 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.812134 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.812305 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.812383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.812534 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.812612 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.812771 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.812853 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.813006 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.813090 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.813243 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.813321 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.813487 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.813599 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.813717 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.813797 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.813962 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.814040 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.814194 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.814272 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] resource.caching = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.814437 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.814514 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.814678 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] resource.caching = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.814755 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.814914 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.814992 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.815165 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.815261 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.815424 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.815502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.815667 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.815745 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.815914 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.815989 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.816150 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.816226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.816392 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.816470 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.816627 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.816703 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] role.caching = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.816866 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.816950 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] role.driver = sql {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.817099 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.817176 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] role.caching = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.817342 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] role.driver = sql {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.817418 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.817574 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.817650 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.817823 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.817907 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.818072 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.818148 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.818318 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.818394 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.819161 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.819625 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.819707 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.819884 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.819961 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.820123 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.820202 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.820374 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.820449 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.820623 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.820700 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.820858 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.820936 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.821109 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.821186 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.821361 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.821518 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.821603 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.821761 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.821839 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.822014 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.822244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.822328 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.822495 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.822574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.822725 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.822803 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.822973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.823049 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.823317 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.823457 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.823533 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.823603 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.823718 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.823797 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.823967 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.824045 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.824204 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.824282 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.824441 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.824519 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.824673 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.824751 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.824913 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.824990 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.825146 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.825231 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.825400 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.825477 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.825644 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.825719 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.825880 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.825964 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.826120 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.826205 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] token.caching = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.826356 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.826432 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.826585 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.826669 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.826822 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] token.caching = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.826899 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.827059 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.827135 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.827329 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.827420 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.827569 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.827646 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.827814 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.827890 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.828062 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.828146 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.828299 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.828375 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.828544 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.828619 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.828785 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.828868 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.829021 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.829103 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.829258 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.829334 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.829498 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.829582 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.829730 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.829806 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.829973 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.830050 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.830223 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.830313 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.830455 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.830531 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] database.connection = **** {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.830698 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.830774 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.830960 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.831044 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.831203 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.831297 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] database.connection = **** {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.831466 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.831543 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.831704 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.831792 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.831941 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.832017 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.832178 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.832253 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.832413 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.832499 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.832650 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.832726 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.832886 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.832963 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.833122 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.833208 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.833378 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.833462 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.833617 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.833701 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.833861 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.833939 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.834124 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.834231 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.834366 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.834498 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.834600 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.834677 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.834850 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.834948 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.835082 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.835161 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79250) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 03:53:56.835344 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.835581 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 03:53:56.835752 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 03:53:56.865137 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:56.865959 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:56.866060 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:56.866185 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:56.866272 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:56.866489 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:56.874922 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:56.875134 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:56.991956 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:56.992258 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:56.993167 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:56.993404 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.045854 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.046015 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.095543 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.095778 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.096104 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.096343 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.163317 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.163541 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.163635 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.163767 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.163930 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.164012 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.164079 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.164197 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.164277 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.164413 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.164495 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.164707 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.188112 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.188312 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.188410 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.188550 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.188631 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.188774 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.188853 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.188997 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.189077 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.189214 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.189294 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.189429 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.189508 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.189659 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.201052 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.201150 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.214301 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.214534 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.214764 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.214845 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.214992 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.215072 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.215226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.215322 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.215465 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.215545 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.215681 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.215758 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79250) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.215898 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.216113 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 03:53:57.233073 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.233285 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 23 03:53:57.233593 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.233674 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.233808 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 23 03:53:57.233890 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 23 03:53:57.234079 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.234191 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.234346 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.234437 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 23 03:53:57.234608 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.234690 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.234866 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.234944 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.235123 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.235403 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.245716 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.245945 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.246217 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.246502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.247314 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.247619 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.247887 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.248164 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.254431 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79250) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.256245 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.257691 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79250) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.258090 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.258377 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.258661 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.258947 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.259233 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.259506 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.259585 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.259783 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.259911 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.260053 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.260317 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.260438 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.260583 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.260833 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.261121 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.261383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.261652 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.261929 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.262200 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.262482 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.262747 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.286923 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.289089 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79250) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.289368 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.290067 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.291682 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.291964 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.294512 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79250) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.294794 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.295073 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.297155 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.297434 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.297709 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.302204 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79250) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.302490 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.305064 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.305342 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.308678 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79250) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.308969 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.309256 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.309540 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.309816 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.310092 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.310367 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.310639 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.311468 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.311755 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.312036 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.312316 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.312590 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.312864 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.313133 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.313425 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.329199 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.329477 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.331847 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.332123 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.333960 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79250) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.337067 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.338284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.338577 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.340617 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.340911 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.343539 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79250) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.345774 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.347289 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79250) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.349612 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.351505 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.351813 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.352103 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.352391 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.352671 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.352948 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.353719 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.354031 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.354314 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.354598 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.354885 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.355161 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.371935 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79250) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.372221 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.372488 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.372754 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.374013 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.374300 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.374566 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.374828 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.380447 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.382453 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.382543 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.382738 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.384240 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.384513 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.385755 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79250) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.386039 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.386331 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.386623 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.386912 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.387506 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.387792 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.388082 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.388373 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.388660 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.400652 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79250) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.400933 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.401216 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.401500 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.401783 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.402061 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.402349 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.402633 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.402915 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.403195 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.403503 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.403785 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.404070 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.404353 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.420629 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79250) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.423839 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79250) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.426308 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.427084 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.428785 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.429879 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.430385 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79250) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.430675 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.430969 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.433161 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.434731 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.436351 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.436631 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.436917 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.438255 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.439875 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79250) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.443010 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.443327 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.443650 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.443928 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.444623 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.446207 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.449362 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.449649 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.449931 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.450218 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.453265 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79250) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.453557 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.453843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.460693 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.460977 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.461255 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.462388 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79250) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.462673 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.462959 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.463329 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.463545 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.463828 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.464105 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.464371 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.464638 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.464914 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.465198 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.465471 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.465857 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.466122 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79250) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.469008 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 03:53:57.469292 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.469578 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.469856 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.470126 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.470402 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.470671 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.470950 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.471235 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.471508 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.471794 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.472066 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.472436 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.472705 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 03:53:57.503938 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b726f039c0 pid: 79250 (default app) Nov 23 03:53:57.507488 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4992a93-a023-4c1a-8a86-dacf10942466 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:53:57.507785 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4992a93-a023-4c1a-8a86-dacf10942466 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:53:57.508071 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4992a93-a023-4c1a-8a86-dacf10942466 None None] PATH_INFO: `/v3` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:53:57.510260 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b726f039c0 pid: 79251 (default app) Nov 23 03:53:57.512256 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1/1] 10.222.0.54 () {50 vars in 791 bytes} [Tue Nov 23 03:53:57 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:05.935371 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac6019-86a3-4b6b-9442-f96b7bd61af9 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:05.935852 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac6019-86a3-4b6b-9442-f96b7bd61af9 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:05.935852 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac6019-86a3-4b6b-9442-f96b7bd61af9 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:05.940780 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1/2] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:05 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:54:05.947409 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa6cc6-ad3f-4e06-8598-e565e80844d3 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:05.947809 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa6cc6-ad3f-4e06-8598-e565e80844d3 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:05.947977 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa6cc6-ad3f-4e06-8598-e565e80844d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:05.979409 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG oslo_db.sqlalchemy.engines [None req-52aa6cc6-ad3f-4e06-8598-e565e80844d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79250) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 03:54:06.166757 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG passlib.handlers.bcrypt [None req-52aa6cc6-ad3f-4e06-8598-e565e80844d3 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79250) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 23 03:54:06.167186 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG passlib.handlers.bcrypt [None req-52aa6cc6-ad3f-4e06-8598-e565e80844d3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79250) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 23 03:54:06.222404 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-52aa6cc6-ad3f-4e06-8598-e565e80844d3 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:06.223987 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-52aa6cc6-ad3f-4e06-8598-e565e80844d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:06.358738 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 2/3] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:06.393430 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac6019-86a3-4b6b-9442-f96b7bd61af9 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:06.426944 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG oslo_db.sqlalchemy.engines [None req-7aac6019-86a3-4b6b-9442-f96b7bd61af9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79251) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 03:54:06.555228 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac6019-86a3-4b6b-9442-f96b7bd61af9 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:06.559488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797f3b1-bf35-43ba-93f8-5c8046eb5999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:06.560143 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797f3b1-bf35-43ba-93f8-5c8046eb5999 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:06.560426 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797f3b1-bf35-43ba-93f8-5c8046eb5999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:06.560702 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797f3b1-bf35-43ba-93f8-5c8046eb5999 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:06.569608 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797f3b1-bf35-43ba-93f8-5c8046eb5999 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:06.620680 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8797f3b1-bf35-43ba-93f8-5c8046eb5999 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 23 03:54:06.621024 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797f3b1-bf35-43ba-93f8-5c8046eb5999 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:06.630112 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 2/4] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:06 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:06.636784 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa6cc6-ad3f-4e06-8598-e565e80844d3 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:06.652762 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa6cc6-ad3f-4e06-8598-e565e80844d3 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:06.657097 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dcf11-4377-4690-8992-fd938cddf0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:06.658168 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dcf11-4377-4690-8992-fd938cddf0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:06.658463 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dcf11-4377-4690-8992-fd938cddf0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:06.658748 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dcf11-4377-4690-8992-fd938cddf0a1 admin admin] PATH_INFO: `/v3/projects/a46903e1a0df4e5bbff165f0dc8442a9` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:06.660264 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01dcf11-4377-4690-8992-fd938cddf0a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=a46903e1a0df4e5bbff165f0dc8442a9)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:06.711329 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e01dcf11-4377-4690-8992-fd938cddf0a1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 23 03:54:06.711681 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01dcf11-4377-4690-8992-fd938cddf0a1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:06.716286 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 3/5] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:06 2021] GET /identity/v3/projects/a46903e1a0df4e5bbff165f0dc8442a9 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:08.939744 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacadae-e1b5-4c54-81fc-b3d9f19f195c None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:08.940223 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacadae-e1b5-4c54-81fc-b3d9f19f195c None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:08.940223 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacadae-e1b5-4c54-81fc-b3d9f19f195c None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:08.945493 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 3/6] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:08 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:54:08.951521 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec521836-210e-45ce-aa48-60025ef66091 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:08.951902 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec521836-210e-45ce-aa48-60025ef66091 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:08.952088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec521836-210e-45ce-aa48-60025ef66091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:08.970999 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-ec521836-210e-45ce-aa48-60025ef66091 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:08.972564 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-ec521836-210e-45ce-aa48-60025ef66091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:08.980603 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 4/7] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:09.003023 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacadae-e1b5-4c54-81fc-b3d9f19f195c None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:09.015321 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacadae-e1b5-4c54-81fc-b3d9f19f195c None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:09.019460 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3fa67-993b-4fcd-b052-74b8c6053f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:09.020086 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3fa67-993b-4fcd-b052-74b8c6053f8a admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:09.020367 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3fa67-993b-4fcd-b052-74b8c6053f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:09.020644 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3fa67-993b-4fcd-b052-74b8c6053f8a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:09.028859 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3fa67-993b-4fcd-b052-74b8c6053f8a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:09.030606 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3fa67-993b-4fcd-b052-74b8c6053f8a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:09.038917 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 4/8] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:09 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 23 03:54:09.044787 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec521836-210e-45ce-aa48-60025ef66091 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:09.053603 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec521836-210e-45ce-aa48-60025ef66091 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:09.057927 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbb746-abf0-4cc7-a7bb-b2fe667986f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:09.058769 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbb746-abf0-4cc7-a7bb-b2fe667986f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:09.059050 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbb746-abf0-4cc7-a7bb-b2fe667986f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:09.059364 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbb746-abf0-4cc7-a7bb-b2fe667986f3 admin admin] PATH_INFO: `/v3/users/2323192b0179440984840bcf5178ed35` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:09.060745 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbb746-abf0-4cc7-a7bb-b2fe667986f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=2323192b0179440984840bcf5178ed35)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:09.062531 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbb746-abf0-4cc7-a7bb-b2fe667986f3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:09.064101 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 5/9] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:09 2021] GET /identity/v3/users/2323192b0179440984840bcf5178ed35 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:11.368828 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313447fc-b871-4e12-b378-8f4d0e5fdb1d None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:11.369343 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313447fc-b871-4e12-b378-8f4d0e5fdb1d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:11.369455 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313447fc-b871-4e12-b378-8f4d0e5fdb1d None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:11.371122 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 5/10] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:11.376809 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9deb4c-70bd-479d-a163-4b831c6837e8 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:11.377218 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9deb4c-70bd-479d-a163-4b831c6837e8 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:11.377365 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9deb4c-70bd-479d-a163-4b831c6837e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:11.395140 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-bb9deb4c-70bd-479d-a163-4b831c6837e8 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:11.396957 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-bb9deb4c-70bd-479d-a163-4b831c6837e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:11.404338 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 6/11] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:11.406957 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d902b-cc61-4a12-a3bf-d30fd5d329b6 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:11.407268 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d902b-cc61-4a12-a3bf-d30fd5d329b6 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:11.407557 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d902b-cc61-4a12-a3bf-d30fd5d329b6 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:11.409298 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 6/12] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:54:11.415078 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f757f-fe94-47ac-9128-9a366b78996b None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:11.415405 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f757f-fe94-47ac-9128-9a366b78996b None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:11.415716 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f757f-fe94-47ac-9128-9a366b78996b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:11.427625 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d902b-cc61-4a12-a3bf-d30fd5d329b6 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:11.433818 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-a17f757f-fe94-47ac-9128-9a366b78996b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:11.435008 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-a17f757f-fe94-47ac-9128-9a366b78996b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:11.439179 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d902b-cc61-4a12-a3bf-d30fd5d329b6 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:11.442481 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 7/13] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:11.444378 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314eb76d-8afc-49d6-a862-7009248c4a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:11.445151 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314eb76d-8afc-49d6-a862-7009248c4a03 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:11.445438 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314eb76d-8afc-49d6-a862-7009248c4a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:11.445714 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314eb76d-8afc-49d6-a862-7009248c4a03 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:11.461847 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314eb76d-8afc-49d6-a862-7009248c4a03 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:11.466242 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f757f-fe94-47ac-9128-9a366b78996b None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:11.468739 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-314eb76d-8afc-49d6-a862-7009248c4a03 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:54:11.469928 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 7/14] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:54:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:54:11.475195 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f757f-fe94-47ac-9128-9a366b78996b None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:11.475987 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314eb76d-8afc-49d6-a862-7009248c4a03 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:11.479638 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106cc7b-9b1d-4c41-8842-0d0039068634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:11.480274 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106cc7b-9b1d-4c41-8842-0d0039068634 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:11.480561 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106cc7b-9b1d-4c41-8842-0d0039068634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:11.480842 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106cc7b-9b1d-4c41-8842-0d0039068634 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:11.485754 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314eb76d-8afc-49d6-a862-7009248c4a03 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:11.488670 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106cc7b-9b1d-4c41-8842-0d0039068634 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:11.491105 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106cc7b-9b1d-4c41-8842-0d0039068634 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:11.491240 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01e2c7-b1cc-4c22-a080-1680834b144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:11.491814 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01e2c7-b1cc-4c22-a080-1680834b144e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:11.492102 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01e2c7-b1cc-4c22-a080-1680834b144e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:11.492381 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01e2c7-b1cc-4c22-a080-1680834b144e admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:11.493139 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01e2c7-b1cc-4c22-a080-1680834b144e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:11.493450 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01e2c7-b1cc-4c22-a080-1680834b144e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:11.495172 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING py.warnings [None req-9e01e2c7-b1cc-4c22-a080-1680834b144e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:54:11.495172 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: warnings.warn(msg) Nov 23 03:54:11.495172 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: Nov 23 03:54:11.496094 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01e2c7-b1cc-4c22-a080-1680834b144e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:11.499785 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 8/15] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 23 03:54:11.506362 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106cc7b-9b1d-4c41-8842-0d0039068634 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:11.511518 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 8/16] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:11.514980 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106cc7b-9b1d-4c41-8842-0d0039068634 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:11.516930 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01e2c7-b1cc-4c22-a080-1680834b144e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:11.519479 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae7b1c-fdf3-4280-9c43-1c16a198d2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:11.520242 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae7b1c-fdf3-4280-9c43-1c16a198d2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:11.520531 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae7b1c-fdf3-4280-9c43-1c16a198d2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:11.520813 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae7b1c-fdf3-4280-9c43-1c16a198d2f3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:11.522342 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae7b1c-fdf3-4280-9c43-1c16a198d2f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:11.524073 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae7b1c-fdf3-4280-9c43-1c16a198d2f3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:11.525641 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 9/17] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:54:11 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:11.526721 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01e2c7-b1cc-4c22-a080-1680834b144e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:11.531145 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e70b3-01a6-48fb-91e6-4b757bca4dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:11.532166 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e70b3-01a6-48fb-91e6-4b757bca4dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:11.532460 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e70b3-01a6-48fb-91e6-4b757bca4dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:11.532744 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e70b3-01a6-48fb-91e6-4b757bca4dc6 admin admin] PATH_INFO: `/v3/users/2323192b0179440984840bcf5178ed35` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:11.534565 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e70b3-01a6-48fb-91e6-4b757bca4dc6 admin admin] RBAC: Authorizing `identity:get_user(user_id=2323192b0179440984840bcf5178ed35)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:11.536463 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e70b3-01a6-48fb-91e6-4b757bca4dc6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:11.538914 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 9/18] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:11 2021] GET /identity/v3/users/2323192b0179440984840bcf5178ed35 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:11.545306 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae7b1c-fdf3-4280-9c43-1c16a198d2f3 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:11.556421 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae7b1c-fdf3-4280-9c43-1c16a198d2f3 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:11.560962 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac97ff-7561-4352-9131-6dfe1298cdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:11.561773 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac97ff-7561-4352-9131-6dfe1298cdfd admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:11.562064 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac97ff-7561-4352-9131-6dfe1298cdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:11.562348 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac97ff-7561-4352-9131-6dfe1298cdfd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:11.563636 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac97ff-7561-4352-9131-6dfe1298cdfd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:11.565382 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac97ff-7561-4352-9131-6dfe1298cdfd admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:11.567058 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 10/19] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:54:11 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:11.573951 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e70b3-01a6-48fb-91e6-4b757bca4dc6 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:11.585058 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e70b3-01a6-48fb-91e6-4b757bca4dc6 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:11.589699 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce22f52-d2ae-4110-b9b0-449ddbc74287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:11.590381 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce22f52-d2ae-4110-b9b0-449ddbc74287 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:11.590671 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce22f52-d2ae-4110-b9b0-449ddbc74287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:11.590953 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce22f52-d2ae-4110-b9b0-449ddbc74287 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:11.591843 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce22f52-d2ae-4110-b9b0-449ddbc74287 admin admin] RBAC: Adding query filter params (role.id=3db7012b41944542a50049819500eadd, scope.domain.id=default, user.id=2323192b0179440984840bcf5178ed35) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:11.592159 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce22f52-d2ae-4110-b9b0-449ddbc74287 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:11.593179 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING py.warnings [None req-8ce22f52-d2ae-4110-b9b0-449ddbc74287 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:54:11.593179 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: warnings.warn(msg) Nov 23 03:54:11.593179 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: Nov 23 03:54:11.594370 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce22f52-d2ae-4110-b9b0-449ddbc74287 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:11.605235 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 10/20] 10.222.0.54 () {56 vars in 1343 bytes} [Tue Nov 23 03:54:11 2021] GET /identity/v3/role_assignments?user.id=2323192b0179440984840bcf5178ed35&scope.domain.id=default&role.id=3db7012b41944542a50049819500eadd => generated 233 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:14.195299 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642f730-e9b5-4362-bd9a-d75e3966ded4 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:14.195805 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642f730-e9b5-4362-bd9a-d75e3966ded4 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:14.195905 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642f730-e9b5-4362-bd9a-d75e3966ded4 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:14.198146 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 11/21] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:14.204166 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2c663-0d21-4f48-9b2d-8f4f9aa7d7d5 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:14.204602 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2c663-0d21-4f48-9b2d-8f4f9aa7d7d5 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:14.204811 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2c663-0d21-4f48-9b2d-8f4f9aa7d7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:14.246387 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e898fb-c088-4178-9930-cbc17ddbf108 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:14.246562 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG passlib.handlers.bcrypt [None req-cdc2c663-0d21-4f48-9b2d-8f4f9aa7d7d5 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79251) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 23 03:54:14.246822 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG passlib.handlers.bcrypt [None req-cdc2c663-0d21-4f48-9b2d-8f4f9aa7d7d5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79251) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 23 03:54:14.247387 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e898fb-c088-4178-9930-cbc17ddbf108 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:14.247868 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e898fb-c088-4178-9930-cbc17ddbf108 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:14.251257 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 12/22] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:14.257284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5eb55-2433-4500-b088-d718414298c1 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:14.257607 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5eb55-2433-4500-b088-d718414298c1 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:14.257850 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5eb55-2433-4500-b088-d718414298c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:14.288664 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-00f5eb55-2433-4500-b088-d718414298c1 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:14.290093 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-00f5eb55-2433-4500-b088-d718414298c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:14.304333 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-cdc2c663-0d21-4f48-9b2d-8f4f9aa7d7d5 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:14.305962 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-cdc2c663-0d21-4f48-9b2d-8f4f9aa7d7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:14.308420 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 13/23] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:14.345804 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 11/24] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:14.372723 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5eb55-2433-4500-b088-d718414298c1 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:14.385132 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5eb55-2433-4500-b088-d718414298c1 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:14.389773 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3d320-d740-425b-a962-5e25f8161448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:14.390442 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3d320-d740-425b-a962-5e25f8161448 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:14.390726 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3d320-d740-425b-a962-5e25f8161448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:14.391000 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3d320-d740-425b-a962-5e25f8161448 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:14.392571 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2c663-0d21-4f48-9b2d-8f4f9aa7d7d5 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:14.401905 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2c663-0d21-4f48-9b2d-8f4f9aa7d7d5 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:14.402805 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3d320-d740-425b-a962-5e25f8161448 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:14.406788 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f033c13-2f34-4f62-8a6e-4f6e8102b69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:14.408225 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f033c13-2f34-4f62-8a6e-4f6e8102b69b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:14.408688 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING py.warnings [None req-77a3d320-d740-425b-a962-5e25f8161448 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:54:14.408688 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: warnings.warn(msg) Nov 23 03:54:14.408688 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: Nov 23 03:54:14.409143 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f033c13-2f34-4f62-8a6e-4f6e8102b69b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:14.409619 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3d320-d740-425b-a962-5e25f8161448 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:14.409718 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f033c13-2f34-4f62-8a6e-4f6e8102b69b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:14.424157 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f033c13-2f34-4f62-8a6e-4f6e8102b69b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:14.431941 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-4f033c13-2f34-4f62-8a6e-4f6e8102b69b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:54:14.436343 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 12/25] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:54:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:54:14.439528 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f033c13-2f34-4f62-8a6e-4f6e8102b69b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:14.454625 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f033c13-2f34-4f62-8a6e-4f6e8102b69b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:14.459556 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f433d-09a4-4cca-b973-ad1f4cbc4360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:14.460563 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f433d-09a4-4cca-b973-ad1f4cbc4360 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:14.465036 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f433d-09a4-4cca-b973-ad1f4cbc4360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:14.465036 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f433d-09a4-4cca-b973-ad1f4cbc4360 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:14.465036 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f433d-09a4-4cca-b973-ad1f4cbc4360 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:14.465036 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f433d-09a4-4cca-b973-ad1f4cbc4360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:14.465036 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f433d-09a4-4cca-b973-ad1f4cbc4360 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:14.474823 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 13/26] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:14.476463 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c650991-eb86-4ee3-bee1-2687ce873bd9 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:14.476967 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c650991-eb86-4ee3-bee1-2687ce873bd9 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:14.477445 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c650991-eb86-4ee3-bee1-2687ce873bd9 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:14.479739 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 14/27] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:14.480679 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c650991-eb86-4ee3-bee1-2687ce873bd9 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:14.497150 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c650991-eb86-4ee3-bee1-2687ce873bd9 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:14.501759 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8547d-ad13-4dba-a7e2-d28ca60b0b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:14.502615 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8547d-ad13-4dba-a7e2-d28ca60b0b3b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:14.502901 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8547d-ad13-4dba-a7e2-d28ca60b0b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:14.503180 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8547d-ad13-4dba-a7e2-d28ca60b0b3b admin admin] PATH_INFO: `/v3/users/2323192b0179440984840bcf5178ed35` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:14.504810 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8547d-ad13-4dba-a7e2-d28ca60b0b3b admin admin] RBAC: Authorizing `identity:get_user(user_id=2323192b0179440984840bcf5178ed35)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:14.506845 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8547d-ad13-4dba-a7e2-d28ca60b0b3b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:14.508809 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 15/28] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:14 2021] GET /identity/v3/users/2323192b0179440984840bcf5178ed35 => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:14.510018 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ed857-9b17-4d4a-9813-9a4346c43885 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:14.510305 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ed857-9b17-4d4a-9813-9a4346c43885 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:14.510582 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ed857-9b17-4d4a-9813-9a4346c43885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:14.530047 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-670ed857-9b17-4d4a-9813-9a4346c43885 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:14.531469 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-670ed857-9b17-4d4a-9813-9a4346c43885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:14.540429 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 16/29] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:14.544034 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ed857-9b17-4d4a-9813-9a4346c43885 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:14.557488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ed857-9b17-4d4a-9813-9a4346c43885 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:14.567462 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87dd9e-a6b2-4e71-b5a3-d9f91ae9a255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:14.568495 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87dd9e-a6b2-4e71-b5a3-d9f91ae9a255 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:14.569045 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87dd9e-a6b2-4e71-b5a3-d9f91ae9a255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:14.569327 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87dd9e-a6b2-4e71-b5a3-d9f91ae9a255 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:14.576015 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87dd9e-a6b2-4e71-b5a3-d9f91ae9a255 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:14.577744 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87dd9e-a6b2-4e71-b5a3-d9f91ae9a255 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:14.579740 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 17/30] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:54:14 2021] GET /identity/v3/domains/default => generated 199 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:14.586082 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87dd9e-a6b2-4e71-b5a3-d9f91ae9a255 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:14.598664 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87dd9e-a6b2-4e71-b5a3-d9f91ae9a255 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:14.603469 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb459e3-a961-4253-bf23-ecb344daf4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:14.604332 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb459e3-a961-4253-bf23-ecb344daf4c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:14.604619 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb459e3-a961-4253-bf23-ecb344daf4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:14.604901 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb459e3-a961-4253-bf23-ecb344daf4c0 admin admin] PATH_INFO: `/v3/domains/default/users/2323192b0179440984840bcf5178ed35/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:14.606963 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb459e3-a961-4253-bf23-ecb344daf4c0 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2323192b0179440984840bcf5178ed35, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:14.608019 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING py.warnings [None req-ddb459e3-a961-4253-bf23-ecb344daf4c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:54:14.608019 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: warnings.warn(msg) Nov 23 03:54:14.608019 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: Nov 23 03:54:14.610008 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb459e3-a961-4253-bf23-ecb344daf4c0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:14.683776 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 14/31] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 03:54:14 2021] POST /identity/v3/roles => generated 219 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:54:14.684783 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3d320-d740-425b-a962-5e25f8161448 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:14.697187 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3d320-d740-425b-a962-5e25f8161448 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:14.702113 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d3085-39ca-4d41-b463-9333acad3017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:14.702923 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d3085-39ca-4d41-b463-9333acad3017 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:14.703234 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d3085-39ca-4d41-b463-9333acad3017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:14.703524 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d3085-39ca-4d41-b463-9333acad3017 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:14.718761 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d3085-39ca-4d41-b463-9333acad3017 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:14.718761 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d3085-39ca-4d41-b463-9333acad3017 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:14.743255 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-6a6d3085-39ca-4d41-b463-9333acad3017 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:54:14.745102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 15/32] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:54:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:14.762099 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d3085-39ca-4d41-b463-9333acad3017 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:14.788522 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d3085-39ca-4d41-b463-9333acad3017 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:14.901069 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 18/33] 10.222.0.54 () {58 vars in 1382 bytes} [Tue Nov 23 03:54:14 2021] PUT /identity/v3/domains/default/users/2323192b0179440984840bcf5178ed35/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:54:14.906255 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75414b14-15e8-44ec-9167-94e6b6a32103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:14.907520 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75414b14-15e8-44ec-9167-94e6b6a32103 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:14.908039 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75414b14-15e8-44ec-9167-94e6b6a32103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:14.908539 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75414b14-15e8-44ec-9167-94e6b6a32103 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:14.909590 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75414b14-15e8-44ec-9167-94e6b6a32103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:14.910171 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75414b14-15e8-44ec-9167-94e6b6a32103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:14.911683 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING py.warnings [None req-75414b14-15e8-44ec-9167-94e6b6a32103 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:54:14.911683 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: warnings.warn(msg) Nov 23 03:54:14.911683 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: Nov 23 03:54:14.913078 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75414b14-15e8-44ec-9167-94e6b6a32103 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:14.934178 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 16/34] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:54:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:14.940601 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb459e3-a961-4253-bf23-ecb344daf4c0 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:14.953309 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb459e3-a961-4253-bf23-ecb344daf4c0 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:14.962985 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c2485-f6d7-4b84-bedc-939fe05c31f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:14.964099 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c2485-f6d7-4b84-bedc-939fe05c31f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:14.964613 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c2485-f6d7-4b84-bedc-939fe05c31f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:14.965129 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c2485-f6d7-4b84-bedc-939fe05c31f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:14.966103 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c2485-f6d7-4b84-bedc-939fe05c31f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:14.967688 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING py.warnings [None req-f37c2485-f6d7-4b84-bedc-939fe05c31f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:54:14.967688 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: warnings.warn(msg) Nov 23 03:54:14.967688 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: Nov 23 03:54:14.969438 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c2485-f6d7-4b84-bedc-939fe05c31f5 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:15.092381 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 19/35] 10.222.0.54 () {60 vars in 1162 bytes} [Tue Nov 23 03:54:14 2021] POST /identity/v3/projects => generated 301 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:54:15.094422 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e5595-016a-4f85-ad3e-9ce27a07b2b6 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:15.094984 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e5595-016a-4f85-ad3e-9ce27a07b2b6 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:15.095606 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e5595-016a-4f85-ad3e-9ce27a07b2b6 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:15.097900 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 17/36] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:15.105478 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75257f-fad7-4916-82fa-fe6dfdd85997 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:15.106131 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75257f-fad7-4916-82fa-fe6dfdd85997 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:15.106564 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75257f-fad7-4916-82fa-fe6dfdd85997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:15.138316 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-3a75257f-fad7-4916-82fa-fe6dfdd85997 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:15.140415 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-3a75257f-fad7-4916-82fa-fe6dfdd85997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:15.220152 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 18/37] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:15.247645 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c2485-f6d7-4b84-bedc-939fe05c31f5 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:15.262227 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c2485-f6d7-4b84-bedc-939fe05c31f5 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:15.269090 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a16d9-e3ec-4408-ac27-3964de79ffcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:15.269780 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a16d9-e3ec-4408-ac27-3964de79ffcf admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:15.270539 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a16d9-e3ec-4408-ac27-3964de79ffcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:15.270539 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a16d9-e3ec-4408-ac27-3964de79ffcf admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:15.271419 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a16d9-e3ec-4408-ac27-3964de79ffcf admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:15.272589 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING py.warnings [None req-ea4a16d9-e3ec-4408-ac27-3964de79ffcf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:54:15.272589 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: warnings.warn(msg) Nov 23 03:54:15.272589 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: Nov 23 03:54:15.273529 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a16d9-e3ec-4408-ac27-3964de79ffcf admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:15.360761 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 20/38] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 03:54:15 2021] POST /identity/v3/roles => generated 225 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:54:15.674639 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a59c62-272d-42a1-b007-e616539a11bb None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:15.675420 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a59c62-272d-42a1-b007-e616539a11bb None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:15.675710 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a59c62-272d-42a1-b007-e616539a11bb None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:15.679956 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 19/39] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:15.687243 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e419938-3e7a-4c3f-a11a-dcefa54ffc19 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:15.687543 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e419938-3e7a-4c3f-a11a-dcefa54ffc19 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:15.687832 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e419938-3e7a-4c3f-a11a-dcefa54ffc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:15.708836 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-7e419938-3e7a-4c3f-a11a-dcefa54ffc19 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:15.710351 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-7e419938-3e7a-4c3f-a11a-dcefa54ffc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:15.718860 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 21/40] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:15.743051 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a59c62-272d-42a1-b007-e616539a11bb None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:15.755307 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a59c62-272d-42a1-b007-e616539a11bb None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:15.760681 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abc96c-b64e-478b-8c5c-f3048704f0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:15.761335 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abc96c-b64e-478b-8c5c-f3048704f0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:15.761626 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abc96c-b64e-478b-8c5c-f3048704f0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:15.761906 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abc96c-b64e-478b-8c5c-f3048704f0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:15.762689 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abc96c-b64e-478b-8c5c-f3048704f0a2 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:15.764344 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abc96c-b64e-478b-8c5c-f3048704f0a2 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:15.850922 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 20/41] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 03:54:15 2021] POST /identity/v3/roles => generated 223 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 03:54:16.037525 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d19a6-43ef-433b-9a18-d659ced8b239 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:16.037926 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d19a6-43ef-433b-9a18-d659ced8b239 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:16.038206 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d19a6-43ef-433b-9a18-d659ced8b239 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:16.040188 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 22/42] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:16.046555 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b084a7-a33d-4e8f-8a35-c20b8040f608 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:16.046837 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b084a7-a33d-4e8f-8a35-c20b8040f608 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:16.047114 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b084a7-a33d-4e8f-8a35-c20b8040f608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:16.067120 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-c2b084a7-a33d-4e8f-8a35-c20b8040f608 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:16.068489 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c2b084a7-a33d-4e8f-8a35-c20b8040f608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:16.076911 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 21/43] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:16.102104 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d19a6-43ef-433b-9a18-d659ced8b239 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:16.114309 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d19a6-43ef-433b-9a18-d659ced8b239 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:16.119431 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a5801-956c-4617-9999-a82389a86f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:16.120231 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a5801-956c-4617-9999-a82389a86f6d admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:16.120519 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a5801-956c-4617-9999-a82389a86f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:16.120800 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a5801-956c-4617-9999-a82389a86f6d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:16.122019 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a5801-956c-4617-9999-a82389a86f6d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:16.123882 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a5801-956c-4617-9999-a82389a86f6d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:16.125737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 23/44] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:54:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:16.131576 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b084a7-a33d-4e8f-8a35-c20b8040f608 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:16.140596 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b084a7-a33d-4e8f-8a35-c20b8040f608 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:16.144968 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46196a-6cbd-4d55-93a8-f8889f955beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:16.146158 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46196a-6cbd-4d55-93a8-f8889f955beb admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:16.146519 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46196a-6cbd-4d55-93a8-f8889f955beb admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:16.146870 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46196a-6cbd-4d55-93a8-f8889f955beb admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:16.147640 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46196a-6cbd-4d55-93a8-f8889f955beb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:16.148643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING py.warnings [None req-6f46196a-6cbd-4d55-93a8-f8889f955beb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:54:16.148643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: warnings.warn(msg) Nov 23 03:54:16.148643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: Nov 23 03:54:16.149841 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46196a-6cbd-4d55-93a8-f8889f955beb admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:16.239544 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 22/45] 10.222.0.54 () {60 vars in 1162 bytes} [Tue Nov 23 03:54:16 2021] POST /identity/v3/projects => generated 312 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:54:17.507587 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a502900-9b20-49b5-97dd-33ad18836b3d None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:17.508098 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a502900-9b20-49b5-97dd-33ad18836b3d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:17.508183 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a502900-9b20-49b5-97dd-33ad18836b3d None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:17.509941 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 24/46] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:17.515803 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a55ca-0915-43df-8c8b-86a9a067bf37 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:17.516179 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a55ca-0915-43df-8c8b-86a9a067bf37 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:17.516365 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a55ca-0915-43df-8c8b-86a9a067bf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:17.535028 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-999a55ca-0915-43df-8c8b-86a9a067bf37 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:17.536885 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-999a55ca-0915-43df-8c8b-86a9a067bf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:17.592957 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 23/47] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:17.617324 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a502900-9b20-49b5-97dd-33ad18836b3d None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:17.628945 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a502900-9b20-49b5-97dd-33ad18836b3d None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:17.633929 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432bfeb7-3b58-4aa3-ab53-e4fb9dc5d24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:17.634725 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bfeb7-3b58-4aa3-ab53-e4fb9dc5d24e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:17.635007 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bfeb7-3b58-4aa3-ab53-e4fb9dc5d24e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:17.635309 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bfeb7-3b58-4aa3-ab53-e4fb9dc5d24e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:17.645049 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432bfeb7-3b58-4aa3-ab53-e4fb9dc5d24e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:17.651815 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-432bfeb7-3b58-4aa3-ab53-e4fb9dc5d24e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:54:17.652952 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 25/48] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:54:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:17.658796 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a55ca-0915-43df-8c8b-86a9a067bf37 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:17.667723 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a55ca-0915-43df-8c8b-86a9a067bf37 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:17.672189 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2495be-e8c0-4dad-9843-e013a52a8908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:17.672848 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2495be-e8c0-4dad-9843-e013a52a8908 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:17.673137 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2495be-e8c0-4dad-9843-e013a52a8908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:17.673417 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2495be-e8c0-4dad-9843-e013a52a8908 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:17.674183 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2495be-e8c0-4dad-9843-e013a52a8908 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:17.674493 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2495be-e8c0-4dad-9843-e013a52a8908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:17.675542 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING py.warnings [None req-de2495be-e8c0-4dad-9843-e013a52a8908 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:54:17.675542 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: warnings.warn(msg) Nov 23 03:54:17.675542 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: Nov 23 03:54:17.676443 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2495be-e8c0-4dad-9843-e013a52a8908 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:17.690779 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 24/49] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:17.697588 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432bfeb7-3b58-4aa3-ab53-e4fb9dc5d24e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:17.707532 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432bfeb7-3b58-4aa3-ab53-e4fb9dc5d24e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:17.711836 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d5d17-56ca-44c7-be0e-90a2d74506e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:17.712673 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d5d17-56ca-44c7-be0e-90a2d74506e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:17.712952 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d5d17-56ca-44c7-be0e-90a2d74506e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:17.713222 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d5d17-56ca-44c7-be0e-90a2d74506e4 admin admin] PATH_INFO: `/v3/users/2323192b0179440984840bcf5178ed35` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:17.714401 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d5d17-56ca-44c7-be0e-90a2d74506e4 admin admin] RBAC: Authorizing `identity:get_user(user_id=2323192b0179440984840bcf5178ed35)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:17.716230 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d5d17-56ca-44c7-be0e-90a2d74506e4 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:17.717791 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 26/50] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:17 2021] GET /identity/v3/users/2323192b0179440984840bcf5178ed35 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:17.723225 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2495be-e8c0-4dad-9843-e013a52a8908 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:17.732708 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2495be-e8c0-4dad-9843-e013a52a8908 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:17.736953 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be670081-2111-4a25-94a1-080fd57b8116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:17.737706 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be670081-2111-4a25-94a1-080fd57b8116 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:17.737990 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be670081-2111-4a25-94a1-080fd57b8116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:17.738267 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be670081-2111-4a25-94a1-080fd57b8116 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:17.739986 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be670081-2111-4a25-94a1-080fd57b8116 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:17.741763 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be670081-2111-4a25-94a1-080fd57b8116 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:17.743318 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 25/51] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:54:17 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:17.748989 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d5d17-56ca-44c7-be0e-90a2d74506e4 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:17.759384 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d5d17-56ca-44c7-be0e-90a2d74506e4 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:17.763723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ca828-5c2c-415e-8644-be4afe45eeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:17.764351 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ca828-5c2c-415e-8644-be4afe45eeee admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:17.764641 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ca828-5c2c-415e-8644-be4afe45eeee admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:17.764925 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ca828-5c2c-415e-8644-be4afe45eeee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:17.765766 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ca828-5c2c-415e-8644-be4afe45eeee admin admin] RBAC: Adding query filter params (role.id=3db7012b41944542a50049819500eadd, scope.domain.id=default, user.id=2323192b0179440984840bcf5178ed35) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:17.766079 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ca828-5c2c-415e-8644-be4afe45eeee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:17.767946 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ca828-5c2c-415e-8644-be4afe45eeee admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:17.773779 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 27/52] 10.222.0.54 () {56 vars in 1343 bytes} [Tue Nov 23 03:54:17 2021] GET /identity/v3/role_assignments?user.id=2323192b0179440984840bcf5178ed35&scope.domain.id=default&role.id=3db7012b41944542a50049819500eadd => generated 530 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:18.498669 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ad015-b55a-4a61-bce1-c99696cab4ca None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:18.498963 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ad015-b55a-4a61-bce1-c99696cab4ca None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:18.499280 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ad015-b55a-4a61-bce1-c99696cab4ca None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:18.501085 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 26/53] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:18.507473 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33e306-1a70-4d7b-ac55-1ffc954ca557 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:18.507767 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33e306-1a70-4d7b-ac55-1ffc954ca557 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:18.508272 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33e306-1a70-4d7b-ac55-1ffc954ca557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:18.525113 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-eb33e306-1a70-4d7b-ac55-1ffc954ca557 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:18.526291 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-eb33e306-1a70-4d7b-ac55-1ffc954ca557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:18.533618 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 28/54] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:18.557078 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ad015-b55a-4a61-bce1-c99696cab4ca None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:18.569923 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ad015-b55a-4a61-bce1-c99696cab4ca None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:18.574151 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949ff15-1b58-4ccd-a1e2-c2a3cf156394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:18.574924 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949ff15-1b58-4ccd-a1e2-c2a3cf156394 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:18.575239 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949ff15-1b58-4ccd-a1e2-c2a3cf156394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:18.575521 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949ff15-1b58-4ccd-a1e2-c2a3cf156394 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:18.576704 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949ff15-1b58-4ccd-a1e2-c2a3cf156394 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:18.578405 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949ff15-1b58-4ccd-a1e2-c2a3cf156394 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:18.579996 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 27/55] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:54:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:18.585404 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33e306-1a70-4d7b-ac55-1ffc954ca557 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:18.593964 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33e306-1a70-4d7b-ac55-1ffc954ca557 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:18.598198 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc259fa8-5905-4f86-8419-7cfbe6c1bc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:18.599395 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc259fa8-5905-4f86-8419-7cfbe6c1bc91 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:18.599679 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc259fa8-5905-4f86-8419-7cfbe6c1bc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:18.599954 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc259fa8-5905-4f86-8419-7cfbe6c1bc91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:18.600660 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc259fa8-5905-4f86-8419-7cfbe6c1bc91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:18.602536 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc259fa8-5905-4f86-8419-7cfbe6c1bc91 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:18.666624 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 29/56] 10.222.0.54 () {60 vars in 1161 bytes} [Tue Nov 23 03:54:18 2021] POST /identity/v3/projects => generated 298 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:54:20.885003 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cafd31-f7fa-4930-bf7f-0e20dade5357 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:20.885499 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cafd31-f7fa-4930-bf7f-0e20dade5357 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:20.885678 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cafd31-f7fa-4930-bf7f-0e20dade5357 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:20.887470 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 28/57] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:20.893165 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c67a9-11f9-4472-af83-7f438c9075ba None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:20.893579 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c67a9-11f9-4472-af83-7f438c9075ba None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:20.893722 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c67a9-11f9-4472-af83-7f438c9075ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:20.911324 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-b37c67a9-11f9-4472-af83-7f438c9075ba None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:20.912510 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-b37c67a9-11f9-4472-af83-7f438c9075ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:20.974987 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 30/58] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:20.999544 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cafd31-f7fa-4930-bf7f-0e20dade5357 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:21.011969 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cafd31-f7fa-4930-bf7f-0e20dade5357 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:21.016099 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a246ed-7535-43fd-8abf-7681ee76e6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:21.016860 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a246ed-7535-43fd-8abf-7681ee76e6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:21.017145 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a246ed-7535-43fd-8abf-7681ee76e6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:21.017422 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a246ed-7535-43fd-8abf-7681ee76e6d3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:21.018590 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a246ed-7535-43fd-8abf-7681ee76e6d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:21.020284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a246ed-7535-43fd-8abf-7681ee76e6d3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:21.022675 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 29/59] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:54:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:21.028067 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c67a9-11f9-4472-af83-7f438c9075ba None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:21.037362 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c67a9-11f9-4472-af83-7f438c9075ba None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:21.041731 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28055e-8c67-4842-b4ee-f430a929d8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:21.042377 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28055e-8c67-4842-b4ee-f430a929d8ad admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:21.042662 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28055e-8c67-4842-b4ee-f430a929d8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:21.042938 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28055e-8c67-4842-b4ee-f430a929d8ad admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:21.043700 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28055e-8c67-4842-b4ee-f430a929d8ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:21.044695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING py.warnings [None req-4e28055e-8c67-4842-b4ee-f430a929d8ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:54:21.044695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: warnings.warn(msg) Nov 23 03:54:21.044695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: Nov 23 03:54:21.045904 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28055e-8c67-4842-b4ee-f430a929d8ad admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:21.135636 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 31/60] 10.222.0.54 () {60 vars in 1153 bytes} [Tue Nov 23 03:54:21 2021] POST /identity/v3/users => generated 275 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 03:54:24.664345 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91076a76-1d1f-4566-bb7b-2f47f868a630 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:24.665394 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91076a76-1d1f-4566-bb7b-2f47f868a630 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:24.665881 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91076a76-1d1f-4566-bb7b-2f47f868a630 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:24.668348 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 30/61] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:24.685107 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5db33c-0f5f-4c7e-a4e4-001ecf66d2b9 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:24.685502 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5db33c-0f5f-4c7e-a4e4-001ecf66d2b9 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:24.685659 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5db33c-0f5f-4c7e-a4e4-001ecf66d2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:24.712227 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-ea5db33c-0f5f-4c7e-a4e4-001ecf66d2b9 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:24.713657 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-ea5db33c-0f5f-4c7e-a4e4-001ecf66d2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:24.725961 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bdb23-8700-4818-b96c-73f0e7dc1980 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:24.726573 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bdb23-8700-4818-b96c-73f0e7dc1980 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:24.727145 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bdb23-8700-4818-b96c-73f0e7dc1980 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:24.727269 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 32/62] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:24.729438 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 31/63] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:24.749417 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91381666-1e1b-490d-8140-1c514959defc None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:24.749705 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91381666-1e1b-490d-8140-1c514959defc None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:24.749984 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91381666-1e1b-490d-8140-1c514959defc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:24.756346 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bdb23-8700-4818-b96c-73f0e7dc1980 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:24.769866 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bdb23-8700-4818-b96c-73f0e7dc1980 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:24.775624 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc6da7-6342-4f94-a1c7-2045018730f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:24.776820 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc6da7-6342-4f94-a1c7-2045018730f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:24.777303 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc6da7-6342-4f94-a1c7-2045018730f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:24.777771 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc6da7-6342-4f94-a1c7-2045018730f2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:24.780458 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-91381666-1e1b-490d-8140-1c514959defc None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:24.781710 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-91381666-1e1b-490d-8140-1c514959defc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:24.793935 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc6da7-6342-4f94-a1c7-2045018730f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:24.797608 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 33/64] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:24.801958 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-fcbc6da7-6342-4f94-a1c7-2045018730f2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:54:24.804031 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 32/65] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:54:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:54:24.810384 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91381666-1e1b-490d-8140-1c514959defc None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:24.824722 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91381666-1e1b-490d-8140-1c514959defc None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:24.836298 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca8bc2-1d42-4773-8179-be2255cafb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:24.837006 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca8bc2-1d42-4773-8179-be2255cafb3d admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:24.837297 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca8bc2-1d42-4773-8179-be2255cafb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:24.837582 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca8bc2-1d42-4773-8179-be2255cafb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:24.838381 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca8bc2-1d42-4773-8179-be2255cafb3d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:24.838693 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca8bc2-1d42-4773-8179-be2255cafb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:24.840378 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca8bc2-1d42-4773-8179-be2255cafb3d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:24.856273 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 34/66] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:24.862286 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc6da7-6342-4f94-a1c7-2045018730f2 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:24.864158 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca8bc2-1d42-4773-8179-be2255cafb3d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:24.873573 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc6da7-6342-4f94-a1c7-2045018730f2 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:24.878293 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f08379-559b-47ee-9bc8-171dada4169a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:24.879417 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f08379-559b-47ee-9bc8-171dada4169a admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:24.880486 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f08379-559b-47ee-9bc8-171dada4169a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:24.880794 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca8bc2-1d42-4773-8179-be2255cafb3d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:24.881156 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f08379-559b-47ee-9bc8-171dada4169a admin admin] PATH_INFO: `/v3/users/2323192b0179440984840bcf5178ed35` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:24.882675 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f08379-559b-47ee-9bc8-171dada4169a admin admin] RBAC: Authorizing `identity:get_user(user_id=2323192b0179440984840bcf5178ed35)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:24.884813 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f08379-559b-47ee-9bc8-171dada4169a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:24.886936 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 33/67] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:24 2021] GET /identity/v3/users/2323192b0179440984840bcf5178ed35 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:24.893509 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f08379-559b-47ee-9bc8-171dada4169a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:24.896765 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15710fa9-e456-4e68-af02-5ab06e06eda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:24.897582 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15710fa9-e456-4e68-af02-5ab06e06eda6 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:24.897869 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15710fa9-e456-4e68-af02-5ab06e06eda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:24.898151 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15710fa9-e456-4e68-af02-5ab06e06eda6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:24.905002 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f08379-559b-47ee-9bc8-171dada4169a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:24.909688 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa362b-b270-4407-bba5-71df2c78784e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:24.910550 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa362b-b270-4407-bba5-71df2c78784e admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:24.911578 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa362b-b270-4407-bba5-71df2c78784e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:24.912074 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa362b-b270-4407-bba5-71df2c78784e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:24.921339 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa362b-b270-4407-bba5-71df2c78784e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:24.923379 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa362b-b270-4407-bba5-71df2c78784e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:24.924144 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15710fa9-e456-4e68-af02-5ab06e06eda6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:24.931419 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-15710fa9-e456-4e68-af02-5ab06e06eda6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 03:54:24.932801 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 35/68] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:24 2021] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:54:24.933962 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 34/69] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:24 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 23 03:54:24.939824 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15710fa9-e456-4e68-af02-5ab06e06eda6 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:24.940262 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa362b-b270-4407-bba5-71df2c78784e admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:24.950779 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa362b-b270-4407-bba5-71df2c78784e admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:24.952708 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15710fa9-e456-4e68-af02-5ab06e06eda6 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:24.955239 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d3435-d7cf-4115-8fa7-7a74e153c8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:24.956072 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d3435-d7cf-4115-8fa7-7a74e153c8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:24.956353 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d3435-d7cf-4115-8fa7-7a74e153c8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:24.956626 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d3435-d7cf-4115-8fa7-7a74e153c8e6 admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:24.957361 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c3d86-cb27-4b6b-b16b-017f884606b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:24.957901 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d3435-d7cf-4115-8fa7-7a74e153c8e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=04deb99f5f1a4beba726c6ac86a84723)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:24.958114 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c3d86-cb27-4b6b-b16b-017f884606b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:24.958373 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c3d86-cb27-4b6b-b16b-017f884606b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:24.958739 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c3d86-cb27-4b6b-b16b-017f884606b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:24.959573 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c3d86-cb27-4b6b-b16b-017f884606b1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:24.959887 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c3d86-cb27-4b6b-b16b-017f884606b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:24.960034 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d3435-d7cf-4115-8fa7-7a74e153c8e6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:24.961486 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c3d86-cb27-4b6b-b16b-017f884606b1 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:24.965788 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 35/70] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:24 2021] GET /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:24.965788 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c088c-35f5-4b5f-b021-a1dbe19ff0df None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:24.965788 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c088c-35f5-4b5f-b021-a1dbe19ff0df None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:24.965788 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c088c-35f5-4b5f-b021-a1dbe19ff0df None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:24.965788 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 36/71] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:24.966758 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1876350-a223-4a67-87ab-cefd43bd4758 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:24.967260 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1876350-a223-4a67-87ab-cefd43bd4758 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:24.967709 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1876350-a223-4a67-87ab-cefd43bd4758 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:24.969452 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 37/72] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:24.970305 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1876350-a223-4a67-87ab-cefd43bd4758 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:24.978111 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 36/73] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:24 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:24.979463 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3da5e2-c663-4649-9c5b-07d9ced5f5ec None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:24.979752 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3da5e2-c663-4649-9c5b-07d9ced5f5ec None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:24.980034 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3da5e2-c663-4649-9c5b-07d9ced5f5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:24.983002 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1876350-a223-4a67-87ab-cefd43bd4758 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:24.987555 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b998d3-c4c8-4b28-8834-d0a778703c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:24.988197 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b998d3-c4c8-4b28-8834-d0a778703c97 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:24.988484 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b998d3-c4c8-4b28-8834-d0a778703c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:24.988759 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b998d3-c4c8-4b28-8834-d0a778703c97 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:24.990142 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b998d3-c4c8-4b28-8834-d0a778703c97 admin admin] RBAC: Adding query filter params (role.id=3db7012b41944542a50049819500eadd, scope.project.id=04deb99f5f1a4beba726c6ac86a84723, user.id=2323192b0179440984840bcf5178ed35) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:24.990454 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b998d3-c4c8-4b28-8834-d0a778703c97 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:24.991476 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING py.warnings [None req-27b998d3-c4c8-4b28-8834-d0a778703c97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:54:24.991476 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: warnings.warn(msg) Nov 23 03:54:24.991476 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: Nov 23 03:54:24.992740 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b998d3-c4c8-4b28-8834-d0a778703c97 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:24.999616 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 38/74] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:54:24 2021] GET /identity/v3/role_assignments?user.id=2323192b0179440984840bcf5178ed35&scope.project.id=04deb99f5f1a4beba726c6ac86a84723&role.id=3db7012b41944542a50049819500eadd => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:25.000086 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-6e3da5e2-c663-4649-9c5b-07d9ced5f5ec None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:25.000801 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888bbc7-9cae-4473-bd0d-e1fca96b14af None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:25.001085 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888bbc7-9cae-4473-bd0d-e1fca96b14af None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:25.001285 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-6e3da5e2-c663-4649-9c5b-07d9ced5f5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:25.001376 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888bbc7-9cae-4473-bd0d-e1fca96b14af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:25.009546 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 37/75] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:25.011437 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3da5e2-c663-4649-9c5b-07d9ced5f5ec None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:25.020961 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-c888bbc7-9cae-4473-bd0d-e1fca96b14af None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:25.022152 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3da5e2-c663-4649-9c5b-07d9ced5f5ec None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:25.022261 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c888bbc7-9cae-4473-bd0d-e1fca96b14af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:25.027195 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70d95a-9b3e-4cea-a67a-57c5f48bb7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:25.028664 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70d95a-9b3e-4cea-a67a-57c5f48bb7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:25.029148 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70d95a-9b3e-4cea-a67a-57c5f48bb7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:25.029619 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70d95a-9b3e-4cea-a67a-57c5f48bb7c0 admin admin] PATH_INFO: `/v3/users/f201b7997ba3410f852f300ba0cbfbe3` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:25.030239 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 39/76] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:25.031620 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3a101-fef3-46c1-97f7-71b29a110207 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:25.031913 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3a101-fef3-46c1-97f7-71b29a110207 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:25.032190 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3a101-fef3-46c1-97f7-71b29a110207 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:25.034116 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 40/77] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:25.034951 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3a101-fef3-46c1-97f7-71b29a110207 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:25.049316 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70d95a-9b3e-4cea-a67a-57c5f48bb7c0 admin admin] RBAC: Authorizing `identity:get_user(user_id=f201b7997ba3410f852f300ba0cbfbe3)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:25.051786 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70d95a-9b3e-4cea-a67a-57c5f48bb7c0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:25.052069 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3a101-fef3-46c1-97f7-71b29a110207 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:25.053587 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 38/78] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:25 2021] GET /identity/v3/users/f201b7997ba3410f852f300ba0cbfbe3 => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:25.054885 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e18277-9ad0-42d6-8d93-c1b98818070b None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:25.055178 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e18277-9ad0-42d6-8d93-c1b98818070b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:25.055484 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e18277-9ad0-42d6-8d93-c1b98818070b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:25.057803 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e7c0c-3382-4954-8c8c-8037c951c1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:25.058859 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e7c0c-3382-4954-8c8c-8037c951c1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:25.059311 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e7c0c-3382-4954-8c8c-8037c951c1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:25.059718 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e7c0c-3382-4954-8c8c-8037c951c1b8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:25.071790 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e7c0c-3382-4954-8c8c-8037c951c1b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:25.075540 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-d3e18277-9ad0-42d6-8d93-c1b98818070b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:25.076799 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-d3e18277-9ad0-42d6-8d93-c1b98818070b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:25.078753 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-6c2e7c0c-3382-4954-8c8c-8037c951c1b8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 03:54:25.080054 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 41/79] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:25 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:25.085988 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e7c0c-3382-4954-8c8c-8037c951c1b8 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:25.090686 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 39/80] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:25.091947 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e18277-9ad0-42d6-8d93-c1b98818070b None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:25.097594 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e7c0c-3382-4954-8c8c-8037c951c1b8 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:25.103313 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e18277-9ad0-42d6-8d93-c1b98818070b None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:25.104122 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e58b51-8b14-47cc-8691-e69271fe448f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:25.105053 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e58b51-8b14-47cc-8691-e69271fe448f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:25.105424 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e58b51-8b14-47cc-8691-e69271fe448f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:25.105859 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e58b51-8b14-47cc-8691-e69271fe448f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:25.109011 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec03e47-b343-4667-bc06-b865da592e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:25.110097 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec03e47-b343-4667-bc06-b865da592e61 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:25.110559 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec03e47-b343-4667-bc06-b865da592e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:25.111008 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec03e47-b343-4667-bc06-b865da592e61 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:25.116477 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e58b51-8b14-47cc-8691-e69271fe448f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:25.118380 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e58b51-8b14-47cc-8691-e69271fe448f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:25.123356 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec03e47-b343-4667-bc06-b865da592e61 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:25.127917 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 42/81] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:25 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:25.128785 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e58b51-8b14-47cc-8691-e69271fe448f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:25.132068 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-dec03e47-b343-4667-bc06-b865da592e61 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 03:54:25.138544 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 40/82] 10.222.0.54 () {56 vars in 1135 bytes} [Tue Nov 23 03:54:25 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:25.138544 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec03e47-b343-4667-bc06-b865da592e61 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:25.138817 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e58b51-8b14-47cc-8691-e69271fe448f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:25.143253 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf930667-4e1a-4143-adb9-cf4036ea8a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:25.144045 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf930667-4e1a-4143-adb9-cf4036ea8a6e admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:25.144242 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf930667-4e1a-4143-adb9-cf4036ea8a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:25.144509 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf930667-4e1a-4143-adb9-cf4036ea8a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:25.145813 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf930667-4e1a-4143-adb9-cf4036ea8a6e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:25.146127 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf930667-4e1a-4143-adb9-cf4036ea8a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:25.147140 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec03e47-b343-4667-bc06-b865da592e61 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:25.147849 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf930667-4e1a-4143-adb9-cf4036ea8a6e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:25.151789 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc1c46-71f5-45c8-8e87-bb2bad27ee73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:25.152591 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc1c46-71f5-45c8-8e87-bb2bad27ee73 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:25.152875 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc1c46-71f5-45c8-8e87-bb2bad27ee73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:25.153153 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc1c46-71f5-45c8-8e87-bb2bad27ee73 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:25.154365 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc1c46-71f5-45c8-8e87-bb2bad27ee73 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:25.156115 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc1c46-71f5-45c8-8e87-bb2bad27ee73 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:25.163082 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 43/83] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:25 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:25.163082 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf930667-4e1a-4143-adb9-cf4036ea8a6e admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:25.163494 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 41/84] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:54:25 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:25.163494 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc1c46-71f5-45c8-8e87-bb2bad27ee73 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:25.172803 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf930667-4e1a-4143-adb9-cf4036ea8a6e admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:25.175509 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc1c46-71f5-45c8-8e87-bb2bad27ee73 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:25.177615 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b0111-ac78-4e65-be91-fc7dc5d204dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:25.178671 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b0111-ac78-4e65-be91-fc7dc5d204dc admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:25.178962 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b0111-ac78-4e65-be91-fc7dc5d204dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:25.179270 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b0111-ac78-4e65-be91-fc7dc5d204dc admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:25.180291 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1f0da-aec6-451a-bfbe-16c315574b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:25.180635 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b0111-ac78-4e65-be91-fc7dc5d204dc admin admin] RBAC: Authorizing `identity:get_project(project_id=04deb99f5f1a4beba726c6ac86a84723)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:25.180984 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1f0da-aec6-451a-bfbe-16c315574b72 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:25.181242 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1f0da-aec6-451a-bfbe-16c315574b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:25.181516 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1f0da-aec6-451a-bfbe-16c315574b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:25.182279 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1f0da-aec6-451a-bfbe-16c315574b72 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:25.182586 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1f0da-aec6-451a-bfbe-16c315574b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:25.182735 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b0111-ac78-4e65-be91-fc7dc5d204dc admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:25.184202 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1f0da-aec6-451a-bfbe-16c315574b72 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:25.184761 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 44/85] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:25 2021] GET /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:25.185281 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b0111-ac78-4e65-be91-fc7dc5d204dc admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:25.196606 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b0111-ac78-4e65-be91-fc7dc5d204dc admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:25.200407 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 42/86] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:54:25 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:25.200407 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1f0da-aec6-451a-bfbe-16c315574b72 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:25.206015 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daf285-a48b-42fa-9f2c-eb7eaeb59af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:25.206704 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daf285-a48b-42fa-9f2c-eb7eaeb59af0 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:25.207019 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daf285-a48b-42fa-9f2c-eb7eaeb59af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:25.207332 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daf285-a48b-42fa-9f2c-eb7eaeb59af0 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:25.209015 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daf285-a48b-42fa-9f2c-eb7eaeb59af0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:25.210054 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING py.warnings [None req-75daf285-a48b-42fa-9f2c-eb7eaeb59af0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:54:25.210054 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: warnings.warn(msg) Nov 23 03:54:25.210054 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: Nov 23 03:54:25.211304 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daf285-a48b-42fa-9f2c-eb7eaeb59af0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:25.215768 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1f0da-aec6-451a-bfbe-16c315574b72 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:25.220159 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440cf91-fb92-4559-a195-9534e420504a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:25.221036 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440cf91-fb92-4559-a195-9534e420504a admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:25.221325 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440cf91-fb92-4559-a195-9534e420504a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:25.221606 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440cf91-fb92-4559-a195-9534e420504a admin admin] PATH_INFO: `/v3/users/f201b7997ba3410f852f300ba0cbfbe3` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:25.224716 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440cf91-fb92-4559-a195-9534e420504a admin admin] RBAC: Authorizing `identity:get_user(user_id=f201b7997ba3410f852f300ba0cbfbe3)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:25.226073 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440cf91-fb92-4559-a195-9534e420504a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:25.228072 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 43/87] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:25 2021] GET /identity/v3/users/f201b7997ba3410f852f300ba0cbfbe3 => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:25.228875 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440cf91-fb92-4559-a195-9534e420504a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:25.238221 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440cf91-fb92-4559-a195-9534e420504a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:25.242802 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8df84f-a121-45b0-91aa-c574f4a9f5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:25.245474 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8df84f-a121-45b0-91aa-c574f4a9f5ec admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:25.245474 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8df84f-a121-45b0-91aa-c574f4a9f5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:25.245474 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8df84f-a121-45b0-91aa-c574f4a9f5ec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:25.245474 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8df84f-a121-45b0-91aa-c574f4a9f5ec admin admin] RBAC: Adding query filter params (role.id=c817e9fe7d034dd4ac25b1f45fd209c7, scope.project.id=04deb99f5f1a4beba726c6ac86a84723, user.id=f201b7997ba3410f852f300ba0cbfbe3) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:25.245474 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8df84f-a121-45b0-91aa-c574f4a9f5ec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:25.246986 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8df84f-a121-45b0-91aa-c574f4a9f5ec admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:25.252513 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 44/88] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:54:25 2021] GET /identity/v3/role_assignments?user.id=f201b7997ba3410f852f300ba0cbfbe3&scope.project.id=04deb99f5f1a4beba726c6ac86a84723&role.id=c817e9fe7d034dd4ac25b1f45fd209c7 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:25.253285 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8df84f-a121-45b0-91aa-c574f4a9f5ec admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:25.262886 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8df84f-a121-45b0-91aa-c574f4a9f5ec admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:25.267706 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f18141-3d42-4c12-a2a8-edde5fe9bdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:25.268599 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f18141-3d42-4c12-a2a8-edde5fe9bdca admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:25.268953 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f18141-3d42-4c12-a2a8-edde5fe9bdca admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:25.269257 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f18141-3d42-4c12-a2a8-edde5fe9bdca admin admin] PATH_INFO: `/v3/users/f201b7997ba3410f852f300ba0cbfbe3` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:25.271008 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f18141-3d42-4c12-a2a8-edde5fe9bdca admin admin] RBAC: Authorizing `identity:get_user(user_id=f201b7997ba3410f852f300ba0cbfbe3)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:25.274783 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f18141-3d42-4c12-a2a8-edde5fe9bdca admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:25.275622 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 45/89] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:25 2021] GET /identity/v3/users/f201b7997ba3410f852f300ba0cbfbe3 => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:25.276230 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f18141-3d42-4c12-a2a8-edde5fe9bdca admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:25.286735 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f18141-3d42-4c12-a2a8-edde5fe9bdca admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:25.291639 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22047a0c-5864-4c0e-a5d7-3e5044124edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:25.292387 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22047a0c-5864-4c0e-a5d7-3e5044124edf admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:25.292587 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22047a0c-5864-4c0e-a5d7-3e5044124edf admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:25.292873 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22047a0c-5864-4c0e-a5d7-3e5044124edf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:25.297843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 45/90] 10.222.0.54 () {60 vars in 1153 bytes} [Tue Nov 23 03:54:25 2021] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:54:25.299096 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daf285-a48b-42fa-9f2c-eb7eaeb59af0 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:25.309485 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22047a0c-5864-4c0e-a5d7-3e5044124edf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:25.311293 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22047a0c-5864-4c0e-a5d7-3e5044124edf admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:25.311739 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daf285-a48b-42fa-9f2c-eb7eaeb59af0 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:25.317447 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cd354-c396-44f2-b111-2d102eddc8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:25.319074 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cd354-c396-44f2-b111-2d102eddc8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:25.319618 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cd354-c396-44f2-b111-2d102eddc8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:25.320082 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cd354-c396-44f2-b111-2d102eddc8c2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:25.327533 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 46/91] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:25 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:25.331300 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78cd354-c396-44f2-b111-2d102eddc8c2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:25.334382 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78cd354-c396-44f2-b111-2d102eddc8c2 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:25.334595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22047a0c-5864-4c0e-a5d7-3e5044124edf admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:25.345411 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 46/92] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:25 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:25.349685 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22047a0c-5864-4c0e-a5d7-3e5044124edf admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:25.352512 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cd354-c396-44f2-b111-2d102eddc8c2 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:25.365822 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a127422-077b-4533-b54a-773fa40f61b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:25.367290 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a127422-077b-4533-b54a-773fa40f61b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:25.369332 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a127422-077b-4533-b54a-773fa40f61b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:25.369833 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a127422-077b-4533-b54a-773fa40f61b9 admin admin] PATH_INFO: `/v3/projects/0687659ebfd84f1bbeca4f4e3d7b196b` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:25.370256 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cd354-c396-44f2-b111-2d102eddc8c2 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:25.373032 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a127422-077b-4533-b54a-773fa40f61b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=0687659ebfd84f1bbeca4f4e3d7b196b)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:25.377610 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a127422-077b-4533-b54a-773fa40f61b9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:25.382467 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23435bcf-6084-4d41-9d65-34bc0fa0ac0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:25.384032 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 47/93] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:25 2021] GET /identity/v3/projects/0687659ebfd84f1bbeca4f4e3d7b196b => generated 312 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:25.384282 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23435bcf-6084-4d41-9d65-34bc0fa0ac0c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:25.384827 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23435bcf-6084-4d41-9d65-34bc0fa0ac0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:25.385290 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23435bcf-6084-4d41-9d65-34bc0fa0ac0c admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:25.387027 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23435bcf-6084-4d41-9d65-34bc0fa0ac0c admin admin] RBAC: Authorizing `identity:get_project(project_id=04deb99f5f1a4beba726c6ac86a84723)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:25.389715 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a127422-077b-4533-b54a-773fa40f61b9 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:25.396021 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23435bcf-6084-4d41-9d65-34bc0fa0ac0c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:25.399114 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 47/94] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:25 2021] GET /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:25.405727 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23435bcf-6084-4d41-9d65-34bc0fa0ac0c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:25.407134 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a127422-077b-4533-b54a-773fa40f61b9 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:25.451305 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9dc7f1-990b-48d9-8b61-f1f43e957824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:25.451305 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9dc7f1-990b-48d9-8b61-f1f43e957824 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:25.451305 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9dc7f1-990b-48d9-8b61-f1f43e957824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:25.451706 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23435bcf-6084-4d41-9d65-34bc0fa0ac0c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:25.451796 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9dc7f1-990b-48d9-8b61-f1f43e957824 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:25.451796 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9dc7f1-990b-48d9-8b61-f1f43e957824 admin admin] RBAC: Adding query filter params (role.id=c817e9fe7d034dd4ac25b1f45fd209c7, scope.project.id=0687659ebfd84f1bbeca4f4e3d7b196b, user.id=f201b7997ba3410f852f300ba0cbfbe3) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:25.451796 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9dc7f1-990b-48d9-8b61-f1f43e957824 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:25.451796 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9dc7f1-990b-48d9-8b61-f1f43e957824 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:25.452174 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb3346-5e10-486e-9a4a-2666bef80e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:25.452174 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb3346-5e10-486e-9a4a-2666bef80e46 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:25.452174 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb3346-5e10-486e-9a4a-2666bef80e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:25.452174 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb3346-5e10-486e-9a4a-2666bef80e46 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:25.452467 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb3346-5e10-486e-9a4a-2666bef80e46 admin admin] RBAC: Adding query filter params (role.id=e8e5c21f4bea46318bef0c9784214ce6, scope.project.id=04deb99f5f1a4beba726c6ac86a84723, user.id=f201b7997ba3410f852f300ba0cbfbe3) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:25.452467 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb3346-5e10-486e-9a4a-2666bef80e46 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:25.452467 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb3346-5e10-486e-9a4a-2666bef80e46 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:25.454669 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 48/95] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:54:25 2021] GET /identity/v3/role_assignments?user.id=f201b7997ba3410f852f300ba0cbfbe3&scope.project.id=04deb99f5f1a4beba726c6ac86a84723&role.id=e8e5c21f4bea46318bef0c9784214ce6 => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:25.462973 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 48/96] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:54:25 2021] GET /identity/v3/role_assignments?user.id=f201b7997ba3410f852f300ba0cbfbe3&scope.project.id=0687659ebfd84f1bbeca4f4e3d7b196b&role.id=c817e9fe7d034dd4ac25b1f45fd209c7 => generated 259 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:27.838903 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e95ca9-371e-453c-9c1f-bade0eacb03f None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:27.839462 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e95ca9-371e-453c-9c1f-bade0eacb03f None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:27.839552 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e95ca9-371e-453c-9c1f-bade0eacb03f None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:27.841540 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 49/97] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:27.857345 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2f7e4-342c-4787-b645-e340f2d38534 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:27.857844 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2f7e4-342c-4787-b645-e340f2d38534 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:27.857923 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2f7e4-342c-4787-b645-e340f2d38534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:27.881035 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-15a2f7e4-342c-4787-b645-e340f2d38534 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:27.882252 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-15a2f7e4-342c-4787-b645-e340f2d38534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:27.890415 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 49/98] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:27.926120 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e95ca9-371e-453c-9c1f-bade0eacb03f None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:27.941491 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e95ca9-371e-453c-9c1f-bade0eacb03f None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:27.952035 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edf481-6357-443a-b2e5-44ed0491b2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:27.953241 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edf481-6357-443a-b2e5-44ed0491b2fa admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:27.953736 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edf481-6357-443a-b2e5-44ed0491b2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:27.954220 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edf481-6357-443a-b2e5-44ed0491b2fa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:27.972569 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edf481-6357-443a-b2e5-44ed0491b2fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:27.983710 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-03edf481-6357-443a-b2e5-44ed0491b2fa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:54:27.985497 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 50/99] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:54:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:27.992945 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2f7e4-342c-4787-b645-e340f2d38534 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:28.004477 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2f7e4-342c-4787-b645-e340f2d38534 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:28.014505 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca751d5-f492-4759-a874-00b3a89a2e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:28.015200 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca751d5-f492-4759-a874-00b3a89a2e4b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:28.015514 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca751d5-f492-4759-a874-00b3a89a2e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:28.015800 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca751d5-f492-4759-a874-00b3a89a2e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:28.016636 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca751d5-f492-4759-a874-00b3a89a2e4b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:28.016955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca751d5-f492-4759-a874-00b3a89a2e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:28.018562 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca751d5-f492-4759-a874-00b3a89a2e4b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:28.034932 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 50/100] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:28.041477 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edf481-6357-443a-b2e5-44ed0491b2fa admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:28.057507 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edf481-6357-443a-b2e5-44ed0491b2fa admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:28.066065 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86881079-a53b-436f-b801-8b62efceb12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:28.067459 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86881079-a53b-436f-b801-8b62efceb12a admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:28.067967 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86881079-a53b-436f-b801-8b62efceb12a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:28.068686 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86881079-a53b-436f-b801-8b62efceb12a admin admin] PATH_INFO: `/v3/users/2323192b0179440984840bcf5178ed35` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:28.076001 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86881079-a53b-436f-b801-8b62efceb12a admin admin] RBAC: Authorizing `identity:get_user(user_id=2323192b0179440984840bcf5178ed35)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:28.078103 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86881079-a53b-436f-b801-8b62efceb12a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:28.082059 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 51/101] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:28 2021] GET /identity/v3/users/2323192b0179440984840bcf5178ed35 => generated 247 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:28.087370 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca751d5-f492-4759-a874-00b3a89a2e4b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:28.101002 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca751d5-f492-4759-a874-00b3a89a2e4b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:28.111406 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91571db0-6638-41a4-80ad-1768158e80f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:28.112273 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91571db0-6638-41a4-80ad-1768158e80f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:28.112562 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91571db0-6638-41a4-80ad-1768158e80f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:28.112844 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91571db0-6638-41a4-80ad-1768158e80f0 admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:28.120081 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91571db0-6638-41a4-80ad-1768158e80f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=04deb99f5f1a4beba726c6ac86a84723)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:28.122244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91571db0-6638-41a4-80ad-1768158e80f0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:28.124125 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 51/102] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:28 2021] GET /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:28.130581 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86881079-a53b-436f-b801-8b62efceb12a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:28.144024 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86881079-a53b-436f-b801-8b62efceb12a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:28.154138 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb3074-90f0-49e5-8640-8d4dda812bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:28.155333 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb3074-90f0-49e5-8640-8d4dda812bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:28.155831 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb3074-90f0-49e5-8640-8d4dda812bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:28.156318 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb3074-90f0-49e5-8640-8d4dda812bc5 admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723/users/2323192b0179440984840bcf5178ed35/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:28.160669 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb3074-90f0-49e5-8640-8d4dda812bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04deb99f5f1a4beba726c6ac86a84723, user_id=2323192b0179440984840bcf5178ed35, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:28.162574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING py.warnings [None req-3deb3074-90f0-49e5-8640-8d4dda812bc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:54:28.162574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: warnings.warn(msg) Nov 23 03:54:28.162574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: Nov 23 03:54:28.164570 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb3074-90f0-49e5-8640-8d4dda812bc5 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:28.204711 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28b303-deab-487f-aa6a-89ad7dccf07f None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:28.204998 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28b303-deab-487f-aa6a-89ad7dccf07f None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:28.205194 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28b303-deab-487f-aa6a-89ad7dccf07f None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:28.207001 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 52/103] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:54:28.213731 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed8752-ec4f-4b8b-812c-2845ba7c68d0 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:28.214278 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed8752-ec4f-4b8b-812c-2845ba7c68d0 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:28.214774 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed8752-ec4f-4b8b-812c-2845ba7c68d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:28.236626 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-bbed8752-ec4f-4b8b-812c-2845ba7c68d0 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:28.238354 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-bbed8752-ec4f-4b8b-812c-2845ba7c68d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:28.249365 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 52/104] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:54:28 2021] PUT /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723/users/2323192b0179440984840bcf5178ed35/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:54:28.256834 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a921d04-4980-4f19-a75b-46e0bebe5e89 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:28.257459 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a921d04-4980-4f19-a75b-46e0bebe5e89 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:28.257937 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a921d04-4980-4f19-a75b-46e0bebe5e89 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:28.260273 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 53/105] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:28 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:54:28.266657 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076cd1c-be69-4f70-89a0-097b736742ac None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:28.267301 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076cd1c-be69-4f70-89a0-097b736742ac None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:28.267812 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076cd1c-be69-4f70-89a0-097b736742ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:28.310685 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-2076cd1c-be69-4f70-89a0-097b736742ac None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:28.315941 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-2076cd1c-be69-4f70-89a0-097b736742ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:28.399325 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 53/106] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:28.431748 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 54/107] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:28.435286 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed8752-ec4f-4b8b-812c-2845ba7c68d0 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:28.446802 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed8752-ec4f-4b8b-812c-2845ba7c68d0 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:28.455066 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7583fc5-70ae-4b8e-94e5-5bc5fccd862c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:28.456234 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7583fc5-70ae-4b8e-94e5-5bc5fccd862c admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:28.456741 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7583fc5-70ae-4b8e-94e5-5bc5fccd862c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:28.457212 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7583fc5-70ae-4b8e-94e5-5bc5fccd862c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:28.472529 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076cd1c-be69-4f70-89a0-097b736742ac None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:28.485578 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7583fc5-70ae-4b8e-94e5-5bc5fccd862c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:28.488088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076cd1c-be69-4f70-89a0-097b736742ac None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:28.496884 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-e7583fc5-70ae-4b8e-94e5-5bc5fccd862c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 03:54:28.501145 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75785ab8-2a91-48bf-8df0-535399affff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:28.502197 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75785ab8-2a91-48bf-8df0-535399affff8 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:28.502691 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75785ab8-2a91-48bf-8df0-535399affff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:28.503180 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75785ab8-2a91-48bf-8df0-535399affff8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:28.510984 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 54/108] 10.222.0.54 () {56 vars in 1135 bytes} [Tue Nov 23 03:54:28 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:28.518033 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7583fc5-70ae-4b8e-94e5-5bc5fccd862c admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:28.532841 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75785ab8-2a91-48bf-8df0-535399affff8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:28.540935 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-75785ab8-2a91-48bf-8df0-535399affff8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 03:54:28.543400 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7583fc5-70ae-4b8e-94e5-5bc5fccd862c admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:28.547575 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 55/109] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:28 2021] GET /identity/v3/roles/member => generated 84 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:54:28.555611 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75785ab8-2a91-48bf-8df0-535399affff8 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:28.556536 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355dd5d-d5ab-43d4-84f6-3e34a908ff68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:28.557454 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355dd5d-d5ab-43d4-84f6-3e34a908ff68 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:28.557933 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355dd5d-d5ab-43d4-84f6-3e34a908ff68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:28.558432 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355dd5d-d5ab-43d4-84f6-3e34a908ff68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:28.559435 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355dd5d-d5ab-43d4-84f6-3e34a908ff68 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:28.559954 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355dd5d-d5ab-43d4-84f6-3e34a908ff68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:28.561763 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355dd5d-d5ab-43d4-84f6-3e34a908ff68 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:28.581453 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75785ab8-2a91-48bf-8df0-535399affff8 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:28.584013 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 55/110] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:54:28 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:28.590444 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355dd5d-d5ab-43d4-84f6-3e34a908ff68 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:28.604611 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11fc56-232b-4316-815a-c01e4bd30d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:28.605651 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11fc56-232b-4316-815a-c01e4bd30d88 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:28.606160 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11fc56-232b-4316-815a-c01e4bd30d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:28.606643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11fc56-232b-4316-815a-c01e4bd30d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:28.607666 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11fc56-232b-4316-815a-c01e4bd30d88 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:28.608177 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11fc56-232b-4316-815a-c01e4bd30d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:28.610075 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11fc56-232b-4316-815a-c01e4bd30d88 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:28.616528 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355dd5d-d5ab-43d4-84f6-3e34a908ff68 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:28.633801 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 56/111] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:28 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:28.636465 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed520216-1465-4c3e-aec2-816d7b1d7b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:28.637746 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed520216-1465-4c3e-aec2-816d7b1d7b7b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:28.638307 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed520216-1465-4c3e-aec2-816d7b1d7b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:28.638808 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed520216-1465-4c3e-aec2-816d7b1d7b7b admin admin] PATH_INFO: `/v3/users/f201b7997ba3410f852f300ba0cbfbe3` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:28.640797 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11fc56-232b-4316-815a-c01e4bd30d88 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:28.641847 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed520216-1465-4c3e-aec2-816d7b1d7b7b admin admin] RBAC: Authorizing `identity:get_user(user_id=f201b7997ba3410f852f300ba0cbfbe3)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:28.644387 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed520216-1465-4c3e-aec2-816d7b1d7b7b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:28.648861 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 56/112] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:28 2021] GET /identity/v3/users/f201b7997ba3410f852f300ba0cbfbe3 => generated 275 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:28.659199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed520216-1465-4c3e-aec2-816d7b1d7b7b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:28.689576 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11fc56-232b-4316-815a-c01e4bd30d88 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:28.695341 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed520216-1465-4c3e-aec2-816d7b1d7b7b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:28.700561 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad1fb6-1d7c-47a9-a1b8-34e53bc05788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:28.701766 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad1fb6-1d7c-47a9-a1b8-34e53bc05788 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:28.702699 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad1fb6-1d7c-47a9-a1b8-34e53bc05788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:28.708565 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad1fb6-1d7c-47a9-a1b8-34e53bc05788 admin admin] PATH_INFO: `/v3/users/f201b7997ba3410f852f300ba0cbfbe3` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:28.709999 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad1fb6-1d7c-47a9-a1b8-34e53bc05788 admin admin] RBAC: Authorizing `identity:get_user(user_id=f201b7997ba3410f852f300ba0cbfbe3)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:28.712322 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad1fb6-1d7c-47a9-a1b8-34e53bc05788 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:28.713167 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6d455-59e2-48db-9991-e4541df375cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:28.713962 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 57/113] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:28 2021] GET /identity/v3/users/f201b7997ba3410f852f300ba0cbfbe3 => generated 275 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:28.714536 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6d455-59e2-48db-9991-e4541df375cd admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:28.715069 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6d455-59e2-48db-9991-e4541df375cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:28.715570 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6d455-59e2-48db-9991-e4541df375cd admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:28.719905 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6d455-59e2-48db-9991-e4541df375cd admin admin] RBAC: Authorizing `identity:get_project(project_id=04deb99f5f1a4beba726c6ac86a84723)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:28.720313 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad1fb6-1d7c-47a9-a1b8-34e53bc05788 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:28.722495 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6d455-59e2-48db-9991-e4541df375cd admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:28.724715 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 57/114] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:28 2021] GET /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723 => generated 298 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:28.732018 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6d455-59e2-48db-9991-e4541df375cd admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:28.739730 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad1fb6-1d7c-47a9-a1b8-34e53bc05788 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:28.747472 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6d455-59e2-48db-9991-e4541df375cd admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:28.752291 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06624c0e-c23b-498f-af0e-abe72917dd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:28.753159 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06624c0e-c23b-498f-af0e-abe72917dd24 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:28.753444 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06624c0e-c23b-498f-af0e-abe72917dd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:28.753723 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06624c0e-c23b-498f-af0e-abe72917dd24 admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:28.756044 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06624c0e-c23b-498f-af0e-abe72917dd24 admin admin] RBAC: Authorizing `identity:get_project(project_id=04deb99f5f1a4beba726c6ac86a84723)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:28.758999 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1d56e-0527-4e39-aedf-d1456bdd0d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:28.759917 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1d56e-0527-4e39-aedf-d1456bdd0d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:28.760199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1d56e-0527-4e39-aedf-d1456bdd0d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:28.760470 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1d56e-0527-4e39-aedf-d1456bdd0d3f admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723/users/f201b7997ba3410f852f300ba0cbfbe3/roles/e8e5c21f4bea46318bef0c9784214ce6` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:28.762176 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06624c0e-c23b-498f-af0e-abe72917dd24 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:28.763947 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 58/115] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:28 2021] GET /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:28.765188 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1d56e-0527-4e39-aedf-d1456bdd0d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=04deb99f5f1a4beba726c6ac86a84723, user_id=f201b7997ba3410f852f300ba0cbfbe3, role_id=e8e5c21f4bea46318bef0c9784214ce6)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:28.767858 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1d56e-0527-4e39-aedf-d1456bdd0d3f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:28.771134 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06624c0e-c23b-498f-af0e-abe72917dd24 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:28.782874 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06624c0e-c23b-498f-af0e-abe72917dd24 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:28.787919 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fcc2f-c1b9-49ef-8813-41192afc8b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:28.789243 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fcc2f-c1b9-49ef-8813-41192afc8b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:28.789573 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fcc2f-c1b9-49ef-8813-41192afc8b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:28.789914 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fcc2f-c1b9-49ef-8813-41192afc8b44 admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723/users/f201b7997ba3410f852f300ba0cbfbe3/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:28.792102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fcc2f-c1b9-49ef-8813-41192afc8b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04deb99f5f1a4beba726c6ac86a84723, user_id=f201b7997ba3410f852f300ba0cbfbe3, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:28.794996 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fcc2f-c1b9-49ef-8813-41192afc8b44 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:28.896486 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 58/116] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:54:28 2021] PUT /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723/users/f201b7997ba3410f852f300ba0cbfbe3/roles/e8e5c21f4bea46318bef0c9784214ce6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 03:54:28.897881 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68268c-e93e-458c-a51b-c4a17a9e41c1 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:28.898176 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68268c-e93e-458c-a51b-c4a17a9e41c1 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:28.898462 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68268c-e93e-458c-a51b-c4a17a9e41c1 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:28.900275 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 59/117] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:28.908545 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054d344-90e2-4632-9a52-57dc3a0be6be None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:28.908861 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054d344-90e2-4632-9a52-57dc3a0be6be None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:28.909123 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054d344-90e2-4632-9a52-57dc3a0be6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:28.935911 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-c054d344-90e2-4632-9a52-57dc3a0be6be None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:28.937159 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-c054d344-90e2-4632-9a52-57dc3a0be6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:28.966323 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 59/118] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:54:28 2021] PUT /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723/users/f201b7997ba3410f852f300ba0cbfbe3/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:54:29.023088 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 60/119] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:29.058851 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fcc2f-c1b9-49ef-8813-41192afc8b44 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:29.161325 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fcc2f-c1b9-49ef-8813-41192afc8b44 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:29.171821 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bde57-1f52-4b39-bbaa-9240479d6230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:29.172652 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bde57-1f52-4b39-bbaa-9240479d6230 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:29.172943 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bde57-1f52-4b39-bbaa-9240479d6230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:29.173225 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bde57-1f52-4b39-bbaa-9240479d6230 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:29.189421 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bde57-1f52-4b39-bbaa-9240479d6230 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:29.192995 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37080ec-e2b0-4df8-8097-5c21e5bb0a20 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:29.193637 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37080ec-e2b0-4df8-8097-5c21e5bb0a20 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:29.193933 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37080ec-e2b0-4df8-8097-5c21e5bb0a20 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:29.195819 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 61/120] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:29.202015 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ab9d6-d737-4650-be54-10435c25dba5 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:29.202295 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ab9d6-d737-4650-be54-10435c25dba5 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:29.202570 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ab9d6-d737-4650-be54-10435c25dba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:29.208621 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-e83bde57-1f52-4b39-bbaa-9240479d6230 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 03:54:29.209883 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 60/121] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:29.224108 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bde57-1f52-4b39-bbaa-9240479d6230 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:29.236310 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-df1ab9d6-d737-4650-be54-10435c25dba5 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:29.237548 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-df1ab9d6-d737-4650-be54-10435c25dba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:29.242162 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bde57-1f52-4b39-bbaa-9240479d6230 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:29.251370 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39f4b7-002f-407c-87ce-d6f5166a65a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:29.252054 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39f4b7-002f-407c-87ce-d6f5166a65a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:29.252351 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39f4b7-002f-407c-87ce-d6f5166a65a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:29.252635 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39f4b7-002f-407c-87ce-d6f5166a65a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:29.253427 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39f4b7-002f-407c-87ce-d6f5166a65a6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:29.253737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39f4b7-002f-407c-87ce-d6f5166a65a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:29.255949 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39f4b7-002f-407c-87ce-d6f5166a65a6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:29.259669 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 62/122] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:29.268076 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 61/123] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:29.274714 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ab9d6-d737-4650-be54-10435c25dba5 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:29.284603 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ab9d6-d737-4650-be54-10435c25dba5 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:29.290148 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41652144-42bc-448f-ab2d-e8735ef3200e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:29.291036 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41652144-42bc-448f-ab2d-e8735ef3200e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:29.291357 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41652144-42bc-448f-ab2d-e8735ef3200e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:29.291641 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41652144-42bc-448f-ab2d-e8735ef3200e admin admin] PATH_INFO: `/v3/users/f201b7997ba3410f852f300ba0cbfbe3` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:29.292924 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41652144-42bc-448f-ab2d-e8735ef3200e admin admin] RBAC: Authorizing `identity:get_user(user_id=f201b7997ba3410f852f300ba0cbfbe3)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:29.295128 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41652144-42bc-448f-ab2d-e8735ef3200e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:29.297152 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 63/124] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:29 2021] GET /identity/v3/users/f201b7997ba3410f852f300ba0cbfbe3 => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:29.303355 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39f4b7-002f-407c-87ce-d6f5166a65a6 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:29.313552 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39f4b7-002f-407c-87ce-d6f5166a65a6 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:29.315119 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41652144-42bc-448f-ab2d-e8735ef3200e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:29.328227 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd233127-d510-4f89-9422-a763e80c453a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:29.329106 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd233127-d510-4f89-9422-a763e80c453a admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:29.329390 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd233127-d510-4f89-9422-a763e80c453a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:29.329672 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd233127-d510-4f89-9422-a763e80c453a admin admin] PATH_INFO: `/v3/projects/0687659ebfd84f1bbeca4f4e3d7b196b` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:29.331120 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd233127-d510-4f89-9422-a763e80c453a admin admin] RBAC: Authorizing `identity:get_project(project_id=0687659ebfd84f1bbeca4f4e3d7b196b)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:29.333722 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd233127-d510-4f89-9422-a763e80c453a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:29.335536 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 62/125] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:29 2021] GET /identity/v3/projects/0687659ebfd84f1bbeca4f4e3d7b196b => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:29.337819 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41652144-42bc-448f-ab2d-e8735ef3200e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:29.346437 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244dcf49-d279-4b45-95ff-ed74842ea939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:29.347273 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244dcf49-d279-4b45-95ff-ed74842ea939 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:29.347564 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244dcf49-d279-4b45-95ff-ed74842ea939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:29.347846 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244dcf49-d279-4b45-95ff-ed74842ea939 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:29.351557 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd233127-d510-4f89-9422-a763e80c453a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:29.365324 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd233127-d510-4f89-9422-a763e80c453a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:29.375069 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244dcf49-d279-4b45-95ff-ed74842ea939 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:29.382664 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-244dcf49-d279-4b45-95ff-ed74842ea939 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 23 03:54:29.384946 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409ad10-0126-4973-9c88-604569ebbb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:29.385845 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409ad10-0126-4973-9c88-604569ebbb17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:29.386132 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409ad10-0126-4973-9c88-604569ebbb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:29.386412 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409ad10-0126-4973-9c88-604569ebbb17 admin admin] PATH_INFO: `/v3/projects/0687659ebfd84f1bbeca4f4e3d7b196b/users/f201b7997ba3410f852f300ba0cbfbe3/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:29.388909 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409ad10-0126-4973-9c88-604569ebbb17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0687659ebfd84f1bbeca4f4e3d7b196b, user_id=f201b7997ba3410f852f300ba0cbfbe3, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:29.390400 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 64/126] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:29 2021] GET /identity/v3/roles/reader => generated 84 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:29.391602 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409ad10-0126-4973-9c88-604569ebbb17 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:29.397440 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244dcf49-d279-4b45-95ff-ed74842ea939 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:29.408080 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244dcf49-d279-4b45-95ff-ed74842ea939 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:29.413542 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ce3e6-1183-4d82-90ff-4b45411c8132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:29.414243 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ce3e6-1183-4d82-90ff-4b45411c8132 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:29.420945 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ce3e6-1183-4d82-90ff-4b45411c8132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:29.420945 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ce3e6-1183-4d82-90ff-4b45411c8132 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:29.420945 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ce3e6-1183-4d82-90ff-4b45411c8132 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:29.420945 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ce3e6-1183-4d82-90ff-4b45411c8132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:29.420945 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ce3e6-1183-4d82-90ff-4b45411c8132 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:29.427831 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 65/127] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:29 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:29.434146 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ce3e6-1183-4d82-90ff-4b45411c8132 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:29.445735 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ce3e6-1183-4d82-90ff-4b45411c8132 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:29.452971 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b46d32-208d-406e-bf1e-83e02e276520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:29.453943 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b46d32-208d-406e-bf1e-83e02e276520 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:29.454217 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b46d32-208d-406e-bf1e-83e02e276520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:29.454500 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b46d32-208d-406e-bf1e-83e02e276520 admin admin] PATH_INFO: `/v3/users/9ab17bc1b68f4696832c3e9bb67a75e6` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:29.471104 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b46d32-208d-406e-bf1e-83e02e276520 admin admin] RBAC: Authorizing `identity:get_user(user_id=9ab17bc1b68f4696832c3e9bb67a75e6)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:29.479363 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 63/128] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:54:29 2021] PUT /identity/v3/projects/0687659ebfd84f1bbeca4f4e3d7b196b/users/f201b7997ba3410f852f300ba0cbfbe3/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:54:29.480926 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b46d32-208d-406e-bf1e-83e02e276520 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:29.483051 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 66/129] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:29 2021] GET /identity/v3/users/9ab17bc1b68f4696832c3e9bb67a75e6 => generated 289 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:29.489990 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409ad10-0126-4973-9c88-604569ebbb17 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:29.561478 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409ad10-0126-4973-9c88-604569ebbb17 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:29.566339 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732e7e2-d22c-413f-a175-0da56a62036e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:29.567121 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732e7e2-d22c-413f-a175-0da56a62036e admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:29.567439 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732e7e2-d22c-413f-a175-0da56a62036e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:29.567804 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732e7e2-d22c-413f-a175-0da56a62036e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:29.576990 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732e7e2-d22c-413f-a175-0da56a62036e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:29.578841 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732e7e2-d22c-413f-a175-0da56a62036e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:29.589868 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 64/130] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:29 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:29.595886 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b46d32-208d-406e-bf1e-83e02e276520 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:29.606772 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b46d32-208d-406e-bf1e-83e02e276520 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:29.611623 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5170a-ceae-4786-a9fd-f83cd86441db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:29.612541 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5170a-ceae-4786-a9fd-f83cd86441db admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:29.612827 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5170a-ceae-4786-a9fd-f83cd86441db admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:29.613107 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5170a-ceae-4786-a9fd-f83cd86441db admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:29.614991 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5170a-ceae-4786-a9fd-f83cd86441db admin admin] RBAC: Authorizing `identity:get_project(project_id=04deb99f5f1a4beba726c6ac86a84723)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:29.617425 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5170a-ceae-4786-a9fd-f83cd86441db admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:29.619408 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 67/131] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:29 2021] GET /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:29.625664 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732e7e2-d22c-413f-a175-0da56a62036e admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:29.635319 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732e7e2-d22c-413f-a175-0da56a62036e admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:29.640340 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065067b-3b66-40b7-a09d-a5e35e6c3531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:29.641205 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065067b-3b66-40b7-a09d-a5e35e6c3531 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:29.641498 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065067b-3b66-40b7-a09d-a5e35e6c3531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:29.641782 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065067b-3b66-40b7-a09d-a5e35e6c3531 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:29.642724 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065067b-3b66-40b7-a09d-a5e35e6c3531 admin admin] RBAC: Adding query filter params (role.id=328414d877bc4b1abec0f915479039cd, scope.project.id=04deb99f5f1a4beba726c6ac86a84723, user.id=9ab17bc1b68f4696832c3e9bb67a75e6) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:29.643042 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065067b-3b66-40b7-a09d-a5e35e6c3531 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:29.645855 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065067b-3b66-40b7-a09d-a5e35e6c3531 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:29.652682 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 65/132] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:54:29 2021] GET /identity/v3/role_assignments?user.id=9ab17bc1b68f4696832c3e9bb67a75e6&scope.project.id=04deb99f5f1a4beba726c6ac86a84723&role.id=328414d877bc4b1abec0f915479039cd => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:29.685824 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d79baf-c04e-40c5-b2f4-396cd22b79a2 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:29.686115 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d79baf-c04e-40c5-b2f4-396cd22b79a2 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:29.686388 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d79baf-c04e-40c5-b2f4-396cd22b79a2 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:29.688615 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 68/133] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:29.717400 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef993dd-d97c-4ea1-98a4-b34a62293dbe None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:29.717742 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef993dd-d97c-4ea1-98a4-b34a62293dbe None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:29.717957 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef993dd-d97c-4ea1-98a4-b34a62293dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:29.744477 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-9ef993dd-d97c-4ea1-98a4-b34a62293dbe None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:29.745780 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-9ef993dd-d97c-4ea1-98a4-b34a62293dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:29.754109 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 66/134] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:29.799745 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d79baf-c04e-40c5-b2f4-396cd22b79a2 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:29.815092 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d79baf-c04e-40c5-b2f4-396cd22b79a2 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:29.820342 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16b75b-96b6-4f8a-8e74-000c3b137f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:29.821205 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16b75b-96b6-4f8a-8e74-000c3b137f38 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:29.821492 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16b75b-96b6-4f8a-8e74-000c3b137f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:29.821773 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16b75b-96b6-4f8a-8e74-000c3b137f38 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:29.823029 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16b75b-96b6-4f8a-8e74-000c3b137f38 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:29.824896 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16b75b-96b6-4f8a-8e74-000c3b137f38 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:29.826921 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 69/135] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:54:29 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:29.834014 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef993dd-d97c-4ea1-98a4-b34a62293dbe None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:29.844109 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef993dd-d97c-4ea1-98a4-b34a62293dbe None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:29.851040 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce356b4e-0458-4e61-b732-ee158a841a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:29.851804 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce356b4e-0458-4e61-b732-ee158a841a3c admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:29.852092 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce356b4e-0458-4e61-b732-ee158a841a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:29.852376 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce356b4e-0458-4e61-b732-ee158a841a3c admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:29.853132 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce356b4e-0458-4e61-b732-ee158a841a3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:29.855224 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce356b4e-0458-4e61-b732-ee158a841a3c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:29.945118 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 67/136] 10.222.0.54 () {60 vars in 1162 bytes} [Tue Nov 23 03:54:29 2021] POST /identity/v3/projects => generated 302 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:54:31.929227 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8973d7-1e69-4175-974e-6f4e2d0293db None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:31.929877 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8973d7-1e69-4175-974e-6f4e2d0293db None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:31.929877 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8973d7-1e69-4175-974e-6f4e2d0293db None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:31.931532 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 70/137] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:31.937647 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348580e-c90d-429d-af7a-635ec64a9ce6 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:31.938106 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348580e-c90d-429d-af7a-635ec64a9ce6 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:31.938253 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348580e-c90d-429d-af7a-635ec64a9ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:31.964246 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-6348580e-c90d-429d-af7a-635ec64a9ce6 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:31.965511 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-6348580e-c90d-429d-af7a-635ec64a9ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:32.032923 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 68/138] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:32.058221 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8973d7-1e69-4175-974e-6f4e2d0293db None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:32.071736 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8973d7-1e69-4175-974e-6f4e2d0293db None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:32.079377 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b623348-5db1-4c16-aba4-0bdefbd049db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:32.080190 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b623348-5db1-4c16-aba4-0bdefbd049db admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:32.094199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b623348-5db1-4c16-aba4-0bdefbd049db admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:32.094199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b623348-5db1-4c16-aba4-0bdefbd049db admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:32.097404 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b623348-5db1-4c16-aba4-0bdefbd049db admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:32.105378 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-6b623348-5db1-4c16-aba4-0bdefbd049db admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 03:54:32.106607 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 71/139] 10.222.0.54 () {56 vars in 1135 bytes} [Tue Nov 23 03:54:32 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:32.112883 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348580e-c90d-429d-af7a-635ec64a9ce6 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:32.122462 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348580e-c90d-429d-af7a-635ec64a9ce6 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:32.137327 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617e0b0-60af-4d4e-9487-c2d314b56aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:32.138329 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617e0b0-60af-4d4e-9487-c2d314b56aca admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:32.139955 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617e0b0-60af-4d4e-9487-c2d314b56aca admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:32.139955 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617e0b0-60af-4d4e-9487-c2d314b56aca admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:32.139955 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617e0b0-60af-4d4e-9487-c2d314b56aca admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:32.140195 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617e0b0-60af-4d4e-9487-c2d314b56aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:32.141955 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617e0b0-60af-4d4e-9487-c2d314b56aca admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:32.154759 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 69/140] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:54:32 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:32.161208 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b623348-5db1-4c16-aba4-0bdefbd049db admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:32.172944 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b623348-5db1-4c16-aba4-0bdefbd049db admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:32.176721 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07f933-238f-4167-9cc7-e3b7b6d6619c None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:32.177020 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07f933-238f-4167-9cc7-e3b7b6d6619c None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:32.177304 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07f933-238f-4167-9cc7-e3b7b6d6619c None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:32.179181 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 70/141] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:32.184157 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4485d-6bfa-472b-939e-0995a673e5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:32.184974 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4485d-6bfa-472b-939e-0995a673e5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:32.185257 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4485d-6bfa-472b-939e-0995a673e5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:32.185536 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4485d-6bfa-472b-939e-0995a673e5f5 admin admin] PATH_INFO: `/v3/users/f201b7997ba3410f852f300ba0cbfbe3` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:32.189771 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4485d-6bfa-472b-939e-0995a673e5f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=f201b7997ba3410f852f300ba0cbfbe3)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:32.192833 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4485d-6bfa-472b-939e-0995a673e5f5 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:32.194741 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 72/142] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:32 2021] GET /identity/v3/users/f201b7997ba3410f852f300ba0cbfbe3 => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:32.200793 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07f933-238f-4167-9cc7-e3b7b6d6619c None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:32.208631 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92185627-5401-4bd2-9fb7-a4e1f335515f None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:32.208925 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92185627-5401-4bd2-9fb7-a4e1f335515f None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:32.209210 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92185627-5401-4bd2-9fb7-a4e1f335515f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:32.224290 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07f933-238f-4167-9cc7-e3b7b6d6619c None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:32.235127 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210f82c-c42e-4b30-9c12-40abf698598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:32.235805 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210f82c-c42e-4b30-9c12-40abf698598b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:32.236093 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210f82c-c42e-4b30-9c12-40abf698598b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:32.236373 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210f82c-c42e-4b30-9c12-40abf698598b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:32.251964 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-92185627-5401-4bd2-9fb7-a4e1f335515f None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:32.253159 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-92185627-5401-4bd2-9fb7-a4e1f335515f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:32.257344 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210f82c-c42e-4b30-9c12-40abf698598b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:32.259106 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210f82c-c42e-4b30-9c12-40abf698598b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:32.278593 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 71/143] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:32 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:32.280796 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 73/144] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:32.288327 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210f82c-c42e-4b30-9c12-40abf698598b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:32.297213 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210f82c-c42e-4b30-9c12-40abf698598b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:32.307373 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ec919-9d6f-491d-ae00-c811d1f0a0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:32.308226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ec919-9d6f-491d-ae00-c811d1f0a0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:32.308513 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ec919-9d6f-491d-ae00-c811d1f0a0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:32.308794 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ec919-9d6f-491d-ae00-c811d1f0a0e6 admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:32.310029 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ec919-9d6f-491d-ae00-c811d1f0a0e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=04deb99f5f1a4beba726c6ac86a84723)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:32.312139 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ec919-9d6f-491d-ae00-c811d1f0a0e6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:32.313817 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 72/145] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:32 2021] GET /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:32.317946 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92185627-5401-4bd2-9fb7-a4e1f335515f None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:32.327561 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ec919-9d6f-491d-ae00-c811d1f0a0e6 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:32.335782 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92185627-5401-4bd2-9fb7-a4e1f335515f None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:32.346394 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba96dbe-ee2f-4f3b-9013-6f9c7564a7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:32.347264 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba96dbe-ee2f-4f3b-9013-6f9c7564a7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:32.347556 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba96dbe-ee2f-4f3b-9013-6f9c7564a7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:32.347886 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba96dbe-ee2f-4f3b-9013-6f9c7564a7c2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:32.351516 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ec919-9d6f-491d-ae00-c811d1f0a0e6 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:32.371089 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f68ca4-90c8-48c0-85b9-1f139a536d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:32.371777 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f68ca4-90c8-48c0-85b9-1f139a536d1c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:32.372066 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f68ca4-90c8-48c0-85b9-1f139a536d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:32.372348 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f68ca4-90c8-48c0-85b9-1f139a536d1c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:32.373206 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f68ca4-90c8-48c0-85b9-1f139a536d1c admin admin] RBAC: Adding query filter params (role.id=e8e5c21f4bea46318bef0c9784214ce6, scope.project.id=04deb99f5f1a4beba726c6ac86a84723, user.id=f201b7997ba3410f852f300ba0cbfbe3) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:32.373528 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f68ca4-90c8-48c0-85b9-1f139a536d1c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:32.375406 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f68ca4-90c8-48c0-85b9-1f139a536d1c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:32.380748 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba96dbe-ee2f-4f3b-9013-6f9c7564a7c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:32.387707 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-dba96dbe-ee2f-4f3b-9013-6f9c7564a7c2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:54:32.389085 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 74/146] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:54:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:32.398609 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 73/147] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:54:32 2021] GET /identity/v3/role_assignments?user.id=f201b7997ba3410f852f300ba0cbfbe3&scope.project.id=04deb99f5f1a4beba726c6ac86a84723&role.id=e8e5c21f4bea46318bef0c9784214ce6 => generated 608 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:32.399000 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba96dbe-ee2f-4f3b-9013-6f9c7564a7c2 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:32.413279 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba96dbe-ee2f-4f3b-9013-6f9c7564a7c2 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:32.421841 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6c8b1-e5be-4c26-9d61-5d6a43915498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:32.422536 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6c8b1-e5be-4c26-9d61-5d6a43915498 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:32.422823 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6c8b1-e5be-4c26-9d61-5d6a43915498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:32.423104 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6c8b1-e5be-4c26-9d61-5d6a43915498 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:32.423914 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6c8b1-e5be-4c26-9d61-5d6a43915498 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:32.424478 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6c8b1-e5be-4c26-9d61-5d6a43915498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:32.425880 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6c8b1-e5be-4c26-9d61-5d6a43915498 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:32.438970 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 75/148] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:32.445678 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f68ca4-90c8-48c0-85b9-1f139a536d1c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:32.460768 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f68ca4-90c8-48c0-85b9-1f139a536d1c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:32.468501 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520331a-afc4-424e-a3c9-4ea09184206e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:32.469390 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520331a-afc4-424e-a3c9-4ea09184206e admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:32.469679 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520331a-afc4-424e-a3c9-4ea09184206e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:32.469959 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520331a-afc4-424e-a3c9-4ea09184206e admin admin] PATH_INFO: `/v3/users/2323192b0179440984840bcf5178ed35` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:32.471299 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520331a-afc4-424e-a3c9-4ea09184206e admin admin] RBAC: Authorizing `identity:get_user(user_id=2323192b0179440984840bcf5178ed35)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:32.473181 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520331a-afc4-424e-a3c9-4ea09184206e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:32.475021 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 74/149] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:32 2021] GET /identity/v3/users/2323192b0179440984840bcf5178ed35 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:32.481195 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6c8b1-e5be-4c26-9d61-5d6a43915498 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:32.496531 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6c8b1-e5be-4c26-9d61-5d6a43915498 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:32.503849 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463262d9-c680-4391-a855-ea55060bec63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:32.504598 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463262d9-c680-4391-a855-ea55060bec63 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:32.504889 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463262d9-c680-4391-a855-ea55060bec63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:32.505180 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463262d9-c680-4391-a855-ea55060bec63 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:32.513972 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463262d9-c680-4391-a855-ea55060bec63 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:32.515780 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463262d9-c680-4391-a855-ea55060bec63 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:32.529116 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 76/150] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:32 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:32.535441 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520331a-afc4-424e-a3c9-4ea09184206e admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:32.548402 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520331a-afc4-424e-a3c9-4ea09184206e admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:32.553639 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d74d93-e6ef-4de4-88fd-416ee07a412f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:32.554559 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d74d93-e6ef-4de4-88fd-416ee07a412f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:32.554845 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d74d93-e6ef-4de4-88fd-416ee07a412f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:32.555138 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d74d93-e6ef-4de4-88fd-416ee07a412f admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:32.556417 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d74d93-e6ef-4de4-88fd-416ee07a412f admin admin] RBAC: Authorizing `identity:get_project(project_id=04deb99f5f1a4beba726c6ac86a84723)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:32.558666 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d74d93-e6ef-4de4-88fd-416ee07a412f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:32.560737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 75/151] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:32 2021] GET /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:32.567046 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463262d9-c680-4391-a855-ea55060bec63 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:32.576997 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463262d9-c680-4391-a855-ea55060bec63 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:32.581919 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c126efc-5d21-46d6-97ee-b4519e9ff6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:32.583309 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c126efc-5d21-46d6-97ee-b4519e9ff6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:32.583592 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c126efc-5d21-46d6-97ee-b4519e9ff6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:32.583935 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c126efc-5d21-46d6-97ee-b4519e9ff6b5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:32.584844 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c126efc-5d21-46d6-97ee-b4519e9ff6b5 admin admin] RBAC: Adding query filter params (role.id=3db7012b41944542a50049819500eadd, scope.project.id=04deb99f5f1a4beba726c6ac86a84723, user.id=2323192b0179440984840bcf5178ed35) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:32.585157 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c126efc-5d21-46d6-97ee-b4519e9ff6b5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:32.587114 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c126efc-5d21-46d6-97ee-b4519e9ff6b5 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:32.594291 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 77/152] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:54:32 2021] GET /identity/v3/role_assignments?user.id=2323192b0179440984840bcf5178ed35&scope.project.id=04deb99f5f1a4beba726c6ac86a84723&role.id=3db7012b41944542a50049819500eadd => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:32.861222 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404248e-5c32-4188-b236-b4af61ecd9f3 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:32.861907 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404248e-5c32-4188-b236-b4af61ecd9f3 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:32.862432 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404248e-5c32-4188-b236-b4af61ecd9f3 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:32.864573 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 76/153] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:32.870897 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd333a-706b-430b-ad82-d1ecddad28ab None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:32.871484 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd333a-706b-430b-ad82-d1ecddad28ab None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:32.871957 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd333a-706b-430b-ad82-d1ecddad28ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:32.895583 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-02bd333a-706b-430b-ad82-d1ecddad28ab None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:32.897162 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-02bd333a-706b-430b-ad82-d1ecddad28ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:32.905372 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 78/154] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:32.943985 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404248e-5c32-4188-b236-b4af61ecd9f3 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:32.959164 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404248e-5c32-4188-b236-b4af61ecd9f3 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:32.964609 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b9b58-2441-4474-98f9-778c3d380c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:32.965813 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b9b58-2441-4474-98f9-778c3d380c22 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:32.966305 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b9b58-2441-4474-98f9-778c3d380c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:32.966803 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b9b58-2441-4474-98f9-778c3d380c22 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:32.986120 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4357f7-3931-46cc-9b8c-31e1a04722f6 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:32.987058 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4357f7-3931-46cc-9b8c-31e1a04722f6 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:32.987597 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4357f7-3931-46cc-9b8c-31e1a04722f6 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:32.989824 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 79/155] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:32 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:54:32.990206 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b9b58-2441-4474-98f9-778c3d380c22 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:32.995995 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a3b5d-974f-493b-b8ed-5e1e4309b5e7 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:32.996523 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a3b5d-974f-493b-b8ed-5e1e4309b5e7 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:32.996994 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a3b5d-974f-493b-b8ed-5e1e4309b5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.003684 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-e38b9b58-2441-4474-98f9-778c3d380c22 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 03:54:33.006063 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 77/156] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:32 2021] GET /identity/v3/roles/member => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:33.012189 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b9b58-2441-4474-98f9-778c3d380c22 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:33.017182 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-d22a3b5d-974f-493b-b8ed-5e1e4309b5e7 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:33.018456 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-d22a3b5d-974f-493b-b8ed-5e1e4309b5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:33.024656 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b9b58-2441-4474-98f9-778c3d380c22 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:33.034143 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 80/157] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:33.035089 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0a5aa-9366-4ada-ba56-5101db979910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:33.036609 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0a5aa-9366-4ada-ba56-5101db979910 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:33.037250 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0a5aa-9366-4ada-ba56-5101db979910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:33.037725 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0a5aa-9366-4ada-ba56-5101db979910 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.038755 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0a5aa-9366-4ada-ba56-5101db979910 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:33.039333 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0a5aa-9366-4ada-ba56-5101db979910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:33.041143 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0a5aa-9366-4ada-ba56-5101db979910 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:33.050114 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 78/158] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:33.056245 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a3b5d-974f-493b-b8ed-5e1e4309b5e7 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:33.065946 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a3b5d-974f-493b-b8ed-5e1e4309b5e7 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:33.068654 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0a5aa-9366-4ada-ba56-5101db979910 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:33.072057 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd13e31-7815-479c-80cf-5d303f21c3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:33.072936 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd13e31-7815-479c-80cf-5d303f21c3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:33.073219 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd13e31-7815-479c-80cf-5d303f21c3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:33.073493 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd13e31-7815-479c-80cf-5d303f21c3a3 admin admin] PATH_INFO: `/v3/users/f201b7997ba3410f852f300ba0cbfbe3` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.075322 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd13e31-7815-479c-80cf-5d303f21c3a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=f201b7997ba3410f852f300ba0cbfbe3)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:33.077479 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd13e31-7815-479c-80cf-5d303f21c3a3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:33.085133 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 81/159] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:33 2021] GET /identity/v3/users/f201b7997ba3410f852f300ba0cbfbe3 => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:33.085251 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0a5aa-9366-4ada-ba56-5101db979910 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:33.086263 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd13e31-7815-479c-80cf-5d303f21c3a3 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:33.092292 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7afb07-ce3a-4e2b-9a42-67212735a9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:33.093110 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7afb07-ce3a-4e2b-9a42-67212735a9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:33.094887 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7afb07-ce3a-4e2b-9a42-67212735a9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:33.095289 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7afb07-ce3a-4e2b-9a42-67212735a9c3 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.104681 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd13e31-7815-479c-80cf-5d303f21c3a3 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:33.111595 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7afb07-ce3a-4e2b-9a42-67212735a9c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:33.113094 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41793bc8-1876-4cb0-a8b8-95f7647a52f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:33.113938 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41793bc8-1876-4cb0-a8b8-95f7647a52f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:33.114219 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41793bc8-1876-4cb0-a8b8-95f7647a52f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:33.114503 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41793bc8-1876-4cb0-a8b8-95f7647a52f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.119971 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-2a7afb07-ce3a-4e2b-9a42-67212735a9c3 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 23 03:54:33.121630 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 79/160] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:33 2021] GET /identity/v3/roles/reader => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:33.126726 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41793bc8-1876-4cb0-a8b8-95f7647a52f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:33.127599 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7afb07-ce3a-4e2b-9a42-67212735a9c3 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:33.128695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41793bc8-1876-4cb0-a8b8-95f7647a52f9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:33.138474 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7afb07-ce3a-4e2b-9a42-67212735a9c3 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:33.140107 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 82/161] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 23 03:54:33.143834 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a49086-82c5-4134-8c18-44fdf74791ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:33.144500 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a49086-82c5-4134-8c18-44fdf74791ac admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:33.144787 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a49086-82c5-4134-8c18-44fdf74791ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:33.144787 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a49086-82c5-4134-8c18-44fdf74791ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.145891 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a49086-82c5-4134-8c18-44fdf74791ac admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:33.146197 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a49086-82c5-4134-8c18-44fdf74791ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:33.147830 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a49086-82c5-4134-8c18-44fdf74791ac admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:33.147940 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41793bc8-1876-4cb0-a8b8-95f7647a52f9 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:33.157362 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41793bc8-1876-4cb0-a8b8-95f7647a52f9 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:33.157847 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 80/162] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:33 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:33.163763 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee868a79-e875-429d-b0a0-0deb38637b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:33.164370 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a49086-82c5-4134-8c18-44fdf74791ac admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:33.164710 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee868a79-e875-429d-b0a0-0deb38637b4d admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:33.165081 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee868a79-e875-429d-b0a0-0deb38637b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:33.165512 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee868a79-e875-429d-b0a0-0deb38637b4d admin admin] PATH_INFO: `/v3/projects/0687659ebfd84f1bbeca4f4e3d7b196b` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.166758 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee868a79-e875-429d-b0a0-0deb38637b4d admin admin] RBAC: Authorizing `identity:get_project(project_id=0687659ebfd84f1bbeca4f4e3d7b196b)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:33.169040 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee868a79-e875-429d-b0a0-0deb38637b4d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:33.172904 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 83/163] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:33 2021] GET /identity/v3/projects/0687659ebfd84f1bbeca4f4e3d7b196b => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:33.177543 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a49086-82c5-4134-8c18-44fdf74791ac admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:33.181615 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee868a79-e875-429d-b0a0-0deb38637b4d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:33.189769 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717238ee-3bac-4d4e-b3af-0cf1b276519b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:33.190642 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717238ee-3bac-4d4e-b3af-0cf1b276519b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:33.190926 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717238ee-3bac-4d4e-b3af-0cf1b276519b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:33.191204 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717238ee-3bac-4d4e-b3af-0cf1b276519b admin admin] PATH_INFO: `/v3/users/9ab17bc1b68f4696832c3e9bb67a75e6` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.193554 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717238ee-3bac-4d4e-b3af-0cf1b276519b admin admin] RBAC: Authorizing `identity:get_user(user_id=9ab17bc1b68f4696832c3e9bb67a75e6)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:33.195500 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee868a79-e875-429d-b0a0-0deb38637b4d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:33.195750 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717238ee-3bac-4d4e-b3af-0cf1b276519b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:33.197662 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 81/164] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:33 2021] GET /identity/v3/users/9ab17bc1b68f4696832c3e9bb67a75e6 => generated 289 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:33.198893 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032d5b2-07fb-45ed-81d7-af7daea3e8cc None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:33.199178 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032d5b2-07fb-45ed-81d7-af7daea3e8cc None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:33.199472 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032d5b2-07fb-45ed-81d7-af7daea3e8cc None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.201260 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 82/165] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:33.204320 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032d5b2-07fb-45ed-81d7-af7daea3e8cc None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:33.205769 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36aaf7-4d48-48ac-9e56-ec08c383ce5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:33.206435 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36aaf7-4d48-48ac-9e56-ec08c383ce5f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:33.206722 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36aaf7-4d48-48ac-9e56-ec08c383ce5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:33.207001 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36aaf7-4d48-48ac-9e56-ec08c383ce5f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.208111 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36aaf7-4d48-48ac-9e56-ec08c383ce5f admin admin] RBAC: Adding query filter params (role.id=c817e9fe7d034dd4ac25b1f45fd209c7, scope.project.id=0687659ebfd84f1bbeca4f4e3d7b196b, user.id=f201b7997ba3410f852f300ba0cbfbe3) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:33.208519 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36aaf7-4d48-48ac-9e56-ec08c383ce5f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:33.210495 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36aaf7-4d48-48ac-9e56-ec08c383ce5f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:33.219306 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032d5b2-07fb-45ed-81d7-af7daea3e8cc None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:33.220033 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 84/166] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:54:33 2021] GET /identity/v3/role_assignments?user.id=f201b7997ba3410f852f300ba0cbfbe3&scope.project.id=0687659ebfd84f1bbeca4f4e3d7b196b&role.id=c817e9fe7d034dd4ac25b1f45fd209c7 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:33.221133 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cc2b9-f4c2-4254-93dd-1d65ee6ac40b None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:33.221431 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cc2b9-f4c2-4254-93dd-1d65ee6ac40b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:33.221763 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cc2b9-f4c2-4254-93dd-1d65ee6ac40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.224602 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ead1b-3373-492b-a707-5939fdfb1818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:33.225455 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ead1b-3373-492b-a707-5939fdfb1818 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:33.225737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ead1b-3373-492b-a707-5939fdfb1818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:33.226010 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ead1b-3373-492b-a707-5939fdfb1818 admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.228147 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ead1b-3373-492b-a707-5939fdfb1818 admin admin] RBAC: Authorizing `identity:get_project(project_id=04deb99f5f1a4beba726c6ac86a84723)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:33.230680 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ead1b-3373-492b-a707-5939fdfb1818 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:33.233182 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 83/167] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:33 2021] GET /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:33.242181 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ead1b-3373-492b-a707-5939fdfb1818 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:33.243675 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-cb3cc2b9-f4c2-4254-93dd-1d65ee6ac40b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:33.245024 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-cb3cc2b9-f4c2-4254-93dd-1d65ee6ac40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:33.253205 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 85/168] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:33.254785 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ead1b-3373-492b-a707-5939fdfb1818 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:33.261001 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20537910-88d4-441a-ad68-287e243f9ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:33.262218 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20537910-88d4-441a-ad68-287e243f9ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:33.262690 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20537910-88d4-441a-ad68-287e243f9ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:33.263139 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20537910-88d4-441a-ad68-287e243f9ab4 admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723/users/9ab17bc1b68f4696832c3e9bb67a75e6/roles/328414d877bc4b1abec0f915479039cd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.265472 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20537910-88d4-441a-ad68-287e243f9ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04deb99f5f1a4beba726c6ac86a84723, user_id=9ab17bc1b68f4696832c3e9bb67a75e6, role_id=328414d877bc4b1abec0f915479039cd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:33.268433 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20537910-88d4-441a-ad68-287e243f9ab4 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:33.279526 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cc2b9-f4c2-4254-93dd-1d65ee6ac40b None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:33.290102 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cc2b9-f4c2-4254-93dd-1d65ee6ac40b None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:33.294968 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5af24-e384-4b2a-b54f-8562d7ac50cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:33.295909 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5af24-e384-4b2a-b54f-8562d7ac50cf admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:33.296225 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5af24-e384-4b2a-b54f-8562d7ac50cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:33.296544 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5af24-e384-4b2a-b54f-8562d7ac50cf admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.310737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5af24-e384-4b2a-b54f-8562d7ac50cf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:33.318778 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-79f5af24-e384-4b2a-b54f-8562d7ac50cf admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 03:54:33.320286 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 86/169] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:54:33.326777 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5af24-e384-4b2a-b54f-8562d7ac50cf admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:33.338955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5af24-e384-4b2a-b54f-8562d7ac50cf admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:33.342183 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 84/170] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:54:33 2021] PUT /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723/users/9ab17bc1b68f4696832c3e9bb67a75e6/roles/328414d877bc4b1abec0f915479039cd => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 03:54:33.410291 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f994b4-7d67-4e59-ab03-a6c34fb2314b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:33.411294 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f994b4-7d67-4e59-ab03-a6c34fb2314b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:33.411651 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f994b4-7d67-4e59-ab03-a6c34fb2314b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:33.411942 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f994b4-7d67-4e59-ab03-a6c34fb2314b admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.412781 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f994b4-7d67-4e59-ab03-a6c34fb2314b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:33.413158 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f994b4-7d67-4e59-ab03-a6c34fb2314b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:33.415238 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f994b4-7d67-4e59-ab03-a6c34fb2314b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:33.425715 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 87/171] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:33.432583 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20537910-88d4-441a-ad68-287e243f9ab4 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:33.449012 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20537910-88d4-441a-ad68-287e243f9ab4 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:33.454296 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd1018-0abf-4995-b147-489bb86ebaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:33.455307 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd1018-0abf-4995-b147-489bb86ebaef admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:33.455661 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd1018-0abf-4995-b147-489bb86ebaef admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:33.456005 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd1018-0abf-4995-b147-489bb86ebaef admin admin] PATH_INFO: `/v3/users/f201b7997ba3410f852f300ba0cbfbe3` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.457888 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd1018-0abf-4995-b147-489bb86ebaef admin admin] RBAC: Authorizing `identity:get_user(user_id=f201b7997ba3410f852f300ba0cbfbe3)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:33.460363 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd1018-0abf-4995-b147-489bb86ebaef admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:33.462395 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 85/172] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:33 2021] GET /identity/v3/users/f201b7997ba3410f852f300ba0cbfbe3 => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:33.468240 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f994b4-7d67-4e59-ab03-a6c34fb2314b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:33.478783 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f994b4-7d67-4e59-ab03-a6c34fb2314b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:33.483578 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fa008-b1f3-45b5-8ffd-e595716eb2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:33.484286 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fa008-b1f3-45b5-8ffd-e595716eb2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:33.484557 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fa008-b1f3-45b5-8ffd-e595716eb2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:33.484831 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fa008-b1f3-45b5-8ffd-e595716eb2e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.495056 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fa008-b1f3-45b5-8ffd-e595716eb2e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:33.497055 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fa008-b1f3-45b5-8ffd-e595716eb2e5 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:33.507338 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 88/173] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:33.513614 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd1018-0abf-4995-b147-489bb86ebaef admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:33.520505 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be60019-c4ac-4ab9-8020-7274af3e433d None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:33.521138 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be60019-c4ac-4ab9-8020-7274af3e433d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:33.521450 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be60019-c4ac-4ab9-8020-7274af3e433d None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.523448 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 89/174] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:54:33.525556 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd1018-0abf-4995-b147-489bb86ebaef admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:33.529702 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd423a-d0de-48e6-9f09-6252fac4c700 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:33.529994 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd423a-d0de-48e6-9f09-6252fac4c700 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:33.530274 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd423a-d0de-48e6-9f09-6252fac4c700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.538077 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a581e-07c0-418c-87ad-28bba7a9f80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:33.539374 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a581e-07c0-418c-87ad-28bba7a9f80c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:33.539941 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a581e-07c0-418c-87ad-28bba7a9f80c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:33.540432 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a581e-07c0-418c-87ad-28bba7a9f80c admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.541982 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a581e-07c0-418c-87ad-28bba7a9f80c admin admin] RBAC: Authorizing `identity:get_project(project_id=04deb99f5f1a4beba726c6ac86a84723)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:33.544410 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a581e-07c0-418c-87ad-28bba7a9f80c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:33.546385 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 86/175] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:33 2021] GET /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:33.549410 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-bebd423a-d0de-48e6-9f09-6252fac4c700 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:33.550627 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-bebd423a-d0de-48e6-9f09-6252fac4c700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:33.554578 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a581e-07c0-418c-87ad-28bba7a9f80c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:33.562146 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 90/176] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:33.572024 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a581e-07c0-418c-87ad-28bba7a9f80c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:33.576534 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86d6a0-bb82-4b83-a4f7-992c02e51a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:33.577183 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86d6a0-bb82-4b83-a4f7-992c02e51a7b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:33.577474 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86d6a0-bb82-4b83-a4f7-992c02e51a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:33.577766 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86d6a0-bb82-4b83-a4f7-992c02e51a7b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.578602 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86d6a0-bb82-4b83-a4f7-992c02e51a7b admin admin] RBAC: Adding query filter params (role.id=c817e9fe7d034dd4ac25b1f45fd209c7, scope.project.id=04deb99f5f1a4beba726c6ac86a84723, user.id=f201b7997ba3410f852f300ba0cbfbe3) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:33.579048 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86d6a0-bb82-4b83-a4f7-992c02e51a7b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:33.580798 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86d6a0-bb82-4b83-a4f7-992c02e51a7b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:33.588046 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 87/177] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:54:33 2021] GET /identity/v3/role_assignments?user.id=f201b7997ba3410f852f300ba0cbfbe3&scope.project.id=04deb99f5f1a4beba726c6ac86a84723&role.id=c817e9fe7d034dd4ac25b1f45fd209c7 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:33.591788 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd423a-d0de-48e6-9f09-6252fac4c700 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:33.601393 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd423a-d0de-48e6-9f09-6252fac4c700 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:33.605939 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d276c7-0197-4226-833c-9ff6ddb7f650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:33.606768 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d276c7-0197-4226-833c-9ff6ddb7f650 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:33.607049 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d276c7-0197-4226-833c-9ff6ddb7f650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:33.607379 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d276c7-0197-4226-833c-9ff6ddb7f650 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.608656 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d276c7-0197-4226-833c-9ff6ddb7f650 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:33.610391 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d276c7-0197-4226-833c-9ff6ddb7f650 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:33.612388 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 91/178] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:54:33 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:33.618256 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86d6a0-bb82-4b83-a4f7-992c02e51a7b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:33.628455 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86d6a0-bb82-4b83-a4f7-992c02e51a7b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:33.633526 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4b44c-1aae-4fd4-8399-dbfc771f424a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:33.634204 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4b44c-1aae-4fd4-8399-dbfc771f424a admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:33.634491 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4b44c-1aae-4fd4-8399-dbfc771f424a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:33.634770 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4b44c-1aae-4fd4-8399-dbfc771f424a admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:33.635568 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4b44c-1aae-4fd4-8399-dbfc771f424a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:33.637509 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4b44c-1aae-4fd4-8399-dbfc771f424a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:33.712558 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 88/179] 10.222.0.54 () {60 vars in 1153 bytes} [Tue Nov 23 03:54:33 2021] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:54:35.917159 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555bb7b-a8ce-4232-be0a-3bd9138b4ba0 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:35.918146 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555bb7b-a8ce-4232-be0a-3bd9138b4ba0 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:35.918651 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555bb7b-a8ce-4232-be0a-3bd9138b4ba0 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:35.920668 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 92/180] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:35 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:35.926814 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333d801-818c-4435-930c-6538cd951024 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:35.927397 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333d801-818c-4435-930c-6538cd951024 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:35.927397 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333d801-818c-4435-930c-6538cd951024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:35.955352 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-1333d801-818c-4435-930c-6538cd951024 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:35.956461 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-1333d801-818c-4435-930c-6538cd951024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:35.970347 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 89/181] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:36.012657 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555bb7b-a8ce-4232-be0a-3bd9138b4ba0 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:36.039855 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555bb7b-a8ce-4232-be0a-3bd9138b4ba0 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:36.047781 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e903f39-2364-4995-b2b7-3bf92b06cbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:36.048844 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e903f39-2364-4995-b2b7-3bf92b06cbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:36.049326 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e903f39-2364-4995-b2b7-3bf92b06cbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:36.049790 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e903f39-2364-4995-b2b7-3bf92b06cbe4 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:36.063888 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e903f39-2364-4995-b2b7-3bf92b06cbe4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:36.076085 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-1e903f39-2364-4995-b2b7-3bf92b06cbe4 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 23 03:54:36.077574 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 93/182] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:36 2021] GET /identity/v3/roles/reader => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:36.083987 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333d801-818c-4435-930c-6538cd951024 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:36.100789 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333d801-818c-4435-930c-6538cd951024 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:36.110144 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0121439-9464-4022-86ec-58954590921f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:36.110824 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0121439-9464-4022-86ec-58954590921f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:36.111106 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0121439-9464-4022-86ec-58954590921f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:36.111402 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0121439-9464-4022-86ec-58954590921f admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:36.112181 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0121439-9464-4022-86ec-58954590921f admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:36.112485 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0121439-9464-4022-86ec-58954590921f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:36.114817 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0121439-9464-4022-86ec-58954590921f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:36.130461 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 90/183] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:36 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:36.136449 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e903f39-2364-4995-b2b7-3bf92b06cbe4 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:36.152718 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e903f39-2364-4995-b2b7-3bf92b06cbe4 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:36.160053 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc5b07-20c2-4a81-96ce-921a40a0a705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:36.161688 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc5b07-20c2-4a81-96ce-921a40a0a705 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:36.162145 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc5b07-20c2-4a81-96ce-921a40a0a705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:36.162586 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc5b07-20c2-4a81-96ce-921a40a0a705 admin admin] PATH_INFO: `/v3/users/9ab17bc1b68f4696832c3e9bb67a75e6` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:36.167939 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc5b07-20c2-4a81-96ce-921a40a0a705 admin admin] RBAC: Authorizing `identity:get_user(user_id=9ab17bc1b68f4696832c3e9bb67a75e6)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:36.170271 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc5b07-20c2-4a81-96ce-921a40a0a705 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:36.172146 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 94/184] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:36 2021] GET /identity/v3/users/9ab17bc1b68f4696832c3e9bb67a75e6 => generated 289 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:36.178347 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0121439-9464-4022-86ec-58954590921f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:36.192873 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0121439-9464-4022-86ec-58954590921f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:36.202198 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fed769-a0c6-4f25-a137-9fd619618002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:36.202848 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fed769-a0c6-4f25-a137-9fd619618002 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:36.203134 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fed769-a0c6-4f25-a137-9fd619618002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:36.203436 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fed769-a0c6-4f25-a137-9fd619618002 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:36.217261 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fed769-a0c6-4f25-a137-9fd619618002 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:36.218938 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fed769-a0c6-4f25-a137-9fd619618002 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:36.233032 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 91/185] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:36 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:36.240083 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc5b07-20c2-4a81-96ce-921a40a0a705 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:36.257038 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc5b07-20c2-4a81-96ce-921a40a0a705 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:36.266852 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5776dff-0dbf-4e70-95e2-e4d8173f5691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:36.267949 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5776dff-0dbf-4e70-95e2-e4d8173f5691 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:36.268409 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5776dff-0dbf-4e70-95e2-e4d8173f5691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:36.268879 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5776dff-0dbf-4e70-95e2-e4d8173f5691 admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:36.273729 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5776dff-0dbf-4e70-95e2-e4d8173f5691 admin admin] RBAC: Authorizing `identity:get_project(project_id=04deb99f5f1a4beba726c6ac86a84723)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:36.276030 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5776dff-0dbf-4e70-95e2-e4d8173f5691 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:36.278306 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 95/186] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:36 2021] GET /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:36.284342 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fed769-a0c6-4f25-a137-9fd619618002 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:36.296061 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fed769-a0c6-4f25-a137-9fd619618002 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:36.306123 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85fb4b4-3560-4756-9d00-154d9e4739db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:36.306768 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fb4b4-3560-4756-9d00-154d9e4739db admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:36.307053 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fb4b4-3560-4756-9d00-154d9e4739db admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:36.307365 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fb4b4-3560-4756-9d00-154d9e4739db admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:36.308217 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85fb4b4-3560-4756-9d00-154d9e4739db admin admin] RBAC: Adding query filter params (role.id=328414d877bc4b1abec0f915479039cd, scope.project.id=04deb99f5f1a4beba726c6ac86a84723, user.id=9ab17bc1b68f4696832c3e9bb67a75e6) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:36.308527 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85fb4b4-3560-4756-9d00-154d9e4739db admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:36.310355 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85fb4b4-3560-4756-9d00-154d9e4739db admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:36.320935 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 92/187] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:54:36 2021] GET /identity/v3/role_assignments?user.id=9ab17bc1b68f4696832c3e9bb67a75e6&scope.project.id=04deb99f5f1a4beba726c6ac86a84723&role.id=328414d877bc4b1abec0f915479039cd => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:36.572815 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79da55-02b1-4e95-88b8-d81d5849938c None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:36.573533 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79da55-02b1-4e95-88b8-d81d5849938c None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:36.574014 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79da55-02b1-4e95-88b8-d81d5849938c None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:36.576085 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 96/188] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:36.588610 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57210ddd-095a-4ac0-aa43-a6c936f9de85 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:36.588910 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57210ddd-095a-4ac0-aa43-a6c936f9de85 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:36.589175 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57210ddd-095a-4ac0-aa43-a6c936f9de85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:36.604451 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0538b-f050-4a56-a4fb-211d39df1695 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:36.605062 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0538b-f050-4a56-a4fb-211d39df1695 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:36.605555 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0538b-f050-4a56-a4fb-211d39df1695 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:36.608091 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 97/189] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:36 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:54:36.614438 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5731e03-fea7-4603-b4a5-0fa96121c623 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:36.615030 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5731e03-fea7-4603-b4a5-0fa96121c623 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:36.615531 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5731e03-fea7-4603-b4a5-0fa96121c623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:36.616993 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-57210ddd-095a-4ac0-aa43-a6c936f9de85 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:36.618310 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-57210ddd-095a-4ac0-aa43-a6c936f9de85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:36.635342 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 93/190] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:36.648100 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-e5731e03-fea7-4603-b4a5-0fa96121c623 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:36.649309 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e5731e03-fea7-4603-b4a5-0fa96121c623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:36.659434 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57210ddd-095a-4ac0-aa43-a6c936f9de85 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:36.675134 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57210ddd-095a-4ac0-aa43-a6c936f9de85 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:36.678136 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 98/191] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:36.688259 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103764eb-74a5-4308-962b-aca9974efbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:36.689364 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103764eb-74a5-4308-962b-aca9974efbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:36.689839 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103764eb-74a5-4308-962b-aca9974efbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:36.690355 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103764eb-74a5-4308-962b-aca9974efbd0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:36.702883 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5731e03-fea7-4603-b4a5-0fa96121c623 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:36.705999 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103764eb-74a5-4308-962b-aca9974efbd0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:36.715754 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5731e03-fea7-4603-b4a5-0fa96121c623 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:36.716193 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-103764eb-74a5-4308-962b-aca9974efbd0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 03:54:36.718018 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 94/192] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:36 2021] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:54:36.724574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103764eb-74a5-4308-962b-aca9974efbd0 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:36.726306 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e57d11-ae26-4861-b59e-0a4c466a64fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:36.727116 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e57d11-ae26-4861-b59e-0a4c466a64fc admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:36.727438 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e57d11-ae26-4861-b59e-0a4c466a64fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:36.727715 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e57d11-ae26-4861-b59e-0a4c466a64fc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:36.736817 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103764eb-74a5-4308-962b-aca9974efbd0 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:36.744063 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c9380-9b0d-44cd-9570-80ca2c0edde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:36.745097 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c9380-9b0d-44cd-9570-80ca2c0edde0 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:36.745574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c9380-9b0d-44cd-9570-80ca2c0edde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:36.746195 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c9380-9b0d-44cd-9570-80ca2c0edde0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:36.746970 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e57d11-ae26-4861-b59e-0a4c466a64fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:36.747421 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c9380-9b0d-44cd-9570-80ca2c0edde0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:36.747941 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c9380-9b0d-44cd-9570-80ca2c0edde0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:36.749780 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c9380-9b0d-44cd-9570-80ca2c0edde0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:36.753930 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-98e57d11-ae26-4861-b59e-0a4c466a64fc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:54:36.756995 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 99/193] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:54:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:54:36.760967 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 95/194] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:36 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:36.764936 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e57d11-ae26-4861-b59e-0a4c466a64fc admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:36.774027 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c9380-9b0d-44cd-9570-80ca2c0edde0 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:36.780874 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e57d11-ae26-4861-b59e-0a4c466a64fc admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:36.786037 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c9380-9b0d-44cd-9570-80ca2c0edde0 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:36.792429 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe646a5-bcbd-494a-b962-e8fd0d004283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:36.794612 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe646a5-bcbd-494a-b962-e8fd0d004283 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:36.795659 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe646a5-bcbd-494a-b962-e8fd0d004283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:36.796113 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe646a5-bcbd-494a-b962-e8fd0d004283 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:36.796890 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe646a5-bcbd-494a-b962-e8fd0d004283 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:36.797198 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe646a5-bcbd-494a-b962-e8fd0d004283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:36.798817 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe646a5-bcbd-494a-b962-e8fd0d004283 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:36.801403 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc07bf7-65d5-4c3b-a461-11d509a99c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:36.802631 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc07bf7-65d5-4c3b-a461-11d509a99c3a admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:36.803130 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc07bf7-65d5-4c3b-a461-11d509a99c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:36.803687 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc07bf7-65d5-4c3b-a461-11d509a99c3a admin admin] PATH_INFO: `/v3/users/242495ec1ecf41a0b724acb554aea550` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:36.809335 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 100/195] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:36.816290 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe646a5-bcbd-494a-b962-e8fd0d004283 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:36.824758 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc07bf7-65d5-4c3b-a461-11d509a99c3a admin admin] RBAC: Authorizing `identity:get_user(user_id=242495ec1ecf41a0b724acb554aea550)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:36.827476 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc07bf7-65d5-4c3b-a461-11d509a99c3a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:36.828801 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe646a5-bcbd-494a-b962-e8fd0d004283 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:36.830305 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 96/196] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:36 2021] GET /identity/v3/users/242495ec1ecf41a0b724acb554aea550 => generated 283 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:36.839659 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc07bf7-65d5-4c3b-a461-11d509a99c3a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:36.840907 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc98c6-dbd0-467c-abc8-e5735dcc4213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:36.841803 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc98c6-dbd0-467c-abc8-e5735dcc4213 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:36.842086 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc98c6-dbd0-467c-abc8-e5735dcc4213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:36.844803 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc98c6-dbd0-467c-abc8-e5735dcc4213 admin admin] PATH_INFO: `/v3/users/242495ec1ecf41a0b724acb554aea550` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:36.847314 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc98c6-dbd0-467c-abc8-e5735dcc4213 admin admin] RBAC: Authorizing `identity:get_user(user_id=242495ec1ecf41a0b724acb554aea550)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:36.849540 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc98c6-dbd0-467c-abc8-e5735dcc4213 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:36.851367 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 101/197] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:36 2021] GET /identity/v3/users/242495ec1ecf41a0b724acb554aea550 => generated 283 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:36.854409 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc07bf7-65d5-4c3b-a461-11d509a99c3a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:36.857518 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc98c6-dbd0-467c-abc8-e5735dcc4213 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:36.862309 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f901716-0182-4917-97f6-db06deddc4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:36.863367 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f901716-0182-4917-97f6-db06deddc4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:36.863874 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f901716-0182-4917-97f6-db06deddc4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:36.864457 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f901716-0182-4917-97f6-db06deddc4b3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:36.872969 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc98c6-dbd0-467c-abc8-e5735dcc4213 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:36.874085 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f901716-0182-4917-97f6-db06deddc4b3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:36.876728 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f901716-0182-4917-97f6-db06deddc4b3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:36.878083 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb6d5e-5b38-4ede-8e80-9cab1529fe7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:36.878725 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb6d5e-5b38-4ede-8e80-9cab1529fe7f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:36.879577 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb6d5e-5b38-4ede-8e80-9cab1529fe7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:36.882478 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb6d5e-5b38-4ede-8e80-9cab1529fe7f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:36.888614 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 97/198] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:36 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 23 03:54:36.898897 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb6d5e-5b38-4ede-8e80-9cab1529fe7f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:36.899041 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f901716-0182-4917-97f6-db06deddc4b3 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:36.899114 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb6d5e-5b38-4ede-8e80-9cab1529fe7f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:36.904802 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f901716-0182-4917-97f6-db06deddc4b3 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:36.906565 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 102/199] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:36 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:36.909480 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1f1c0-86a2-4e18-bc2d-b6c87e7ceb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:36.910505 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1f1c0-86a2-4e18-bc2d-b6c87e7ceb39 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:36.910926 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1f1c0-86a2-4e18-bc2d-b6c87e7ceb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:36.911388 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1f1c0-86a2-4e18-bc2d-b6c87e7ceb39 admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:36.912728 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1f1c0-86a2-4e18-bc2d-b6c87e7ceb39 admin admin] RBAC: Authorizing `identity:get_project(project_id=66d1377d6a7d40f798138de207208f9e)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:36.912838 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb6d5e-5b38-4ede-8e80-9cab1529fe7f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:36.914984 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1f1c0-86a2-4e18-bc2d-b6c87e7ceb39 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:36.916881 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 98/200] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:36 2021] GET /identity/v3/projects/66d1377d6a7d40f798138de207208f9e => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:36.923585 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1f1c0-86a2-4e18-bc2d-b6c87e7ceb39 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:36.924752 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb6d5e-5b38-4ede-8e80-9cab1529fe7f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:36.929445 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1d7cd-976e-4989-8b6e-32dc912d60ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:36.930731 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1d7cd-976e-4989-8b6e-32dc912d60ec admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:36.930731 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1d7cd-976e-4989-8b6e-32dc912d60ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:36.930940 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1d7cd-976e-4989-8b6e-32dc912d60ec admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:36.932233 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1d7cd-976e-4989-8b6e-32dc912d60ec admin admin] RBAC: Authorizing `identity:get_project(project_id=66d1377d6a7d40f798138de207208f9e)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:36.934439 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1f1c0-86a2-4e18-bc2d-b6c87e7ceb39 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:36.934840 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1d7cd-976e-4989-8b6e-32dc912d60ec admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:36.936635 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 103/201] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:36 2021] GET /identity/v3/projects/66d1377d6a7d40f798138de207208f9e => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:36.939643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e8da5-0c6a-4ee6-9260-5fa8dd4fe58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:36.940425 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e8da5-0c6a-4ee6-9260-5fa8dd4fe58d admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:36.940843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e8da5-0c6a-4ee6-9260-5fa8dd4fe58d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:36.941250 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e8da5-0c6a-4ee6-9260-5fa8dd4fe58d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:36.943170 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e8da5-0c6a-4ee6-9260-5fa8dd4fe58d admin admin] RBAC: Adding query filter params (role.id=c817e9fe7d034dd4ac25b1f45fd209c7, scope.project.id=66d1377d6a7d40f798138de207208f9e, user.id=242495ec1ecf41a0b724acb554aea550) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:36.943506 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1d7cd-976e-4989-8b6e-32dc912d60ec admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:36.943836 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e8da5-0c6a-4ee6-9260-5fa8dd4fe58d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:36.945818 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e8da5-0c6a-4ee6-9260-5fa8dd4fe58d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:36.951943 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 99/202] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:54:36 2021] GET /identity/v3/role_assignments?user.id=242495ec1ecf41a0b724acb554aea550&scope.project.id=66d1377d6a7d40f798138de207208f9e&role.id=c817e9fe7d034dd4ac25b1f45fd209c7 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:36.959298 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1d7cd-976e-4989-8b6e-32dc912d60ec admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:36.959784 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59fe7e-796e-4d75-a810-4a43a09f00f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:36.960514 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59fe7e-796e-4d75-a810-4a43a09f00f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:36.960803 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59fe7e-796e-4d75-a810-4a43a09f00f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:36.961085 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59fe7e-796e-4d75-a810-4a43a09f00f4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:36.962004 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59fe7e-796e-4d75-a810-4a43a09f00f4 admin admin] RBAC: Adding query filter params (role.id=3db7012b41944542a50049819500eadd, scope.project.id=66d1377d6a7d40f798138de207208f9e, user.id=242495ec1ecf41a0b724acb554aea550) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:36.962319 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59fe7e-796e-4d75-a810-4a43a09f00f4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:36.964478 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59fe7e-796e-4d75-a810-4a43a09f00f4 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:36.971078 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 104/203] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:54:36 2021] GET /identity/v3/role_assignments?user.id=242495ec1ecf41a0b724acb554aea550&scope.project.id=66d1377d6a7d40f798138de207208f9e&role.id=3db7012b41944542a50049819500eadd => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:37.014054 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcedfa4-c123-4890-a25f-3b99c5df0813 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:37.014357 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcedfa4-c123-4890-a25f-3b99c5df0813 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:37.014623 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcedfa4-c123-4890-a25f-3b99c5df0813 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:37.016645 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 100/204] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:37.024526 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c41748-00fe-4055-b7f3-bbea13e97dff None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:37.024807 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c41748-00fe-4055-b7f3-bbea13e97dff None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:37.025090 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c41748-00fe-4055-b7f3-bbea13e97dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:37.045838 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-c2c41748-00fe-4055-b7f3-bbea13e97dff None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:37.047151 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-c2c41748-00fe-4055-b7f3-bbea13e97dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:37.056577 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 105/205] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:37.083111 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcedfa4-c123-4890-a25f-3b99c5df0813 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:37.095786 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcedfa4-c123-4890-a25f-3b99c5df0813 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:37.100602 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0169402-0f51-43c0-a31a-65f55b8042f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:37.101418 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0169402-0f51-43c0-a31a-65f55b8042f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:37.101703 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0169402-0f51-43c0-a31a-65f55b8042f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:37.101979 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0169402-0f51-43c0-a31a-65f55b8042f2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:37.103360 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0169402-0f51-43c0-a31a-65f55b8042f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:37.105126 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0169402-0f51-43c0-a31a-65f55b8042f2 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:37.106885 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 101/206] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:54:37 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:37.113322 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c41748-00fe-4055-b7f3-bbea13e97dff None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:37.124012 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c41748-00fe-4055-b7f3-bbea13e97dff None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:37.128873 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eaa2f-6b08-4760-8fcd-2126aca6f1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:37.130280 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eaa2f-6b08-4760-8fcd-2126aca6f1c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:37.130597 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eaa2f-6b08-4760-8fcd-2126aca6f1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:37.130826 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eaa2f-6b08-4760-8fcd-2126aca6f1c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:37.131662 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307eaa2f-6b08-4760-8fcd-2126aca6f1c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:37.133755 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307eaa2f-6b08-4760-8fcd-2126aca6f1c4 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:37.204833 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 106/207] 10.222.0.54 () {60 vars in 1153 bytes} [Tue Nov 23 03:54:37 2021] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:54:37.220034 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e459df-4d60-4c03-9c44-8798a433f4ce None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:37.220336 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e459df-4d60-4c03-9c44-8798a433f4ce None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:37.220561 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e459df-4d60-4c03-9c44-8798a433f4ce None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:37.222424 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 102/208] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:37.229393 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49622fd-1880-4a3d-9043-1c847964fb7f None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:37.229691 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49622fd-1880-4a3d-9043-1c847964fb7f None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:37.229952 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49622fd-1880-4a3d-9043-1c847964fb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:37.253837 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-d49622fd-1880-4a3d-9043-1c847964fb7f None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:37.255274 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-d49622fd-1880-4a3d-9043-1c847964fb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:37.263634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 107/209] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:37.290961 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e459df-4d60-4c03-9c44-8798a433f4ce None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:37.304603 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e459df-4d60-4c03-9c44-8798a433f4ce None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:37.309152 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03e129-d402-42ef-8f29-48de41e58be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:37.309978 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03e129-d402-42ef-8f29-48de41e58be0 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:37.310264 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03e129-d402-42ef-8f29-48de41e58be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:37.310545 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03e129-d402-42ef-8f29-48de41e58be0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:37.323665 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03e129-d402-42ef-8f29-48de41e58be0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:37.331383 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-3e03e129-d402-42ef-8f29-48de41e58be0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 03:54:37.339415 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 103/210] 10.222.0.54 () {56 vars in 1135 bytes} [Tue Nov 23 03:54:37 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:37.340739 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49622fd-1880-4a3d-9043-1c847964fb7f None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:37.351299 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49622fd-1880-4a3d-9043-1c847964fb7f None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:37.356012 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8dcaa-a13e-40e3-89d3-d291bb5643c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:37.356710 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8dcaa-a13e-40e3-89d3-d291bb5643c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:37.356994 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8dcaa-a13e-40e3-89d3-d291bb5643c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:37.357270 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8dcaa-a13e-40e3-89d3-d291bb5643c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:37.358062 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8dcaa-a13e-40e3-89d3-d291bb5643c6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:37.358376 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8dcaa-a13e-40e3-89d3-d291bb5643c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:37.360127 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8dcaa-a13e-40e3-89d3-d291bb5643c6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:37.375362 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 108/211] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:54:37 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:37.377081 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03e129-d402-42ef-8f29-48de41e58be0 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:37.390412 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03e129-d402-42ef-8f29-48de41e58be0 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:37.396230 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecae8f8-5b1d-4e9a-82b9-454b8af37648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:37.397176 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecae8f8-5b1d-4e9a-82b9-454b8af37648 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:37.397459 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecae8f8-5b1d-4e9a-82b9-454b8af37648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:37.397731 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecae8f8-5b1d-4e9a-82b9-454b8af37648 admin admin] PATH_INFO: `/v3/users/242495ec1ecf41a0b724acb554aea550` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:37.399097 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecae8f8-5b1d-4e9a-82b9-454b8af37648 admin admin] RBAC: Authorizing `identity:get_user(user_id=242495ec1ecf41a0b724acb554aea550)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:37.401465 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecae8f8-5b1d-4e9a-82b9-454b8af37648 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:37.403151 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 104/212] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:37 2021] GET /identity/v3/users/242495ec1ecf41a0b724acb554aea550 => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:37.409492 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8dcaa-a13e-40e3-89d3-d291bb5643c6 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:37.421091 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8dcaa-a13e-40e3-89d3-d291bb5643c6 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:37.425703 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155b19e-32f2-4788-9a87-90ffce3363ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:37.427093 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155b19e-32f2-4788-9a87-90ffce3363ac admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:37.427427 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155b19e-32f2-4788-9a87-90ffce3363ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:37.427759 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155b19e-32f2-4788-9a87-90ffce3363ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:37.436900 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155b19e-32f2-4788-9a87-90ffce3363ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:37.438705 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155b19e-32f2-4788-9a87-90ffce3363ac admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:37.449682 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 109/213] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:37 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:37.455789 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecae8f8-5b1d-4e9a-82b9-454b8af37648 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:37.466517 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecae8f8-5b1d-4e9a-82b9-454b8af37648 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:37.470927 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715d931-bae5-4560-8cc5-1d30c93c44d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:37.473548 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715d931-bae5-4560-8cc5-1d30c93c44d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:37.474065 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715d931-bae5-4560-8cc5-1d30c93c44d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:37.474555 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715d931-bae5-4560-8cc5-1d30c93c44d2 admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:37.476345 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715d931-bae5-4560-8cc5-1d30c93c44d2 admin admin] RBAC: Authorizing `identity:get_project(project_id=66d1377d6a7d40f798138de207208f9e)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:37.478775 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715d931-bae5-4560-8cc5-1d30c93c44d2 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:37.480812 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 105/214] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:37 2021] GET /identity/v3/projects/66d1377d6a7d40f798138de207208f9e => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:37.487166 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155b19e-32f2-4788-9a87-90ffce3363ac admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:37.499320 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155b19e-32f2-4788-9a87-90ffce3363ac admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:37.505684 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33492db-9b3d-43ee-a99c-eb35ed440f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:37.506634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33492db-9b3d-43ee-a99c-eb35ed440f5b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:37.507119 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33492db-9b3d-43ee-a99c-eb35ed440f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:37.507679 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33492db-9b3d-43ee-a99c-eb35ed440f5b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:37.508770 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33492db-9b3d-43ee-a99c-eb35ed440f5b admin admin] RBAC: Adding query filter params (role.id=e8e5c21f4bea46318bef0c9784214ce6, scope.project.id=66d1377d6a7d40f798138de207208f9e, user.id=242495ec1ecf41a0b724acb554aea550) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:37.509283 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33492db-9b3d-43ee-a99c-eb35ed440f5b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:37.511507 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33492db-9b3d-43ee-a99c-eb35ed440f5b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:37.517927 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 110/215] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:54:37 2021] GET /identity/v3/role_assignments?user.id=242495ec1ecf41a0b724acb554aea550&scope.project.id=66d1377d6a7d40f798138de207208f9e&role.id=e8e5c21f4bea46318bef0c9784214ce6 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:39.435726 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71154aa1-e116-4673-b191-ba6cbaff2b85 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:39.436726 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71154aa1-e116-4673-b191-ba6cbaff2b85 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:39.437219 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71154aa1-e116-4673-b191-ba6cbaff2b85 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:39.439525 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 106/216] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:39.447514 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed96bab-792b-4160-a02a-7b3d39c87be2 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:39.448392 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed96bab-792b-4160-a02a-7b3d39c87be2 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:39.448881 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed96bab-792b-4160-a02a-7b3d39c87be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:39.590152 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-2ed96bab-792b-4160-a02a-7b3d39c87be2 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:39.591722 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-2ed96bab-792b-4160-a02a-7b3d39c87be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:39.601103 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 111/217] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:39.646735 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71154aa1-e116-4673-b191-ba6cbaff2b85 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:39.665696 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71154aa1-e116-4673-b191-ba6cbaff2b85 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:39.680133 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56289c-a418-426f-9f1a-15b789c5e35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:39.680991 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56289c-a418-426f-9f1a-15b789c5e35b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:39.681281 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56289c-a418-426f-9f1a-15b789c5e35b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:39.681558 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56289c-a418-426f-9f1a-15b789c5e35b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:39.701402 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56289c-a418-426f-9f1a-15b789c5e35b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:39.713150 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-2d56289c-a418-426f-9f1a-15b789c5e35b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:54:39.714527 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 107/218] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:54:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:39.720722 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed96bab-792b-4160-a02a-7b3d39c87be2 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:39.730804 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed96bab-792b-4160-a02a-7b3d39c87be2 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:39.744810 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a69a5-502c-4818-9d75-4fb5517a5f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:39.745786 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a69a5-502c-4818-9d75-4fb5517a5f04 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:39.746270 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a69a5-502c-4818-9d75-4fb5517a5f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:39.746765 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a69a5-502c-4818-9d75-4fb5517a5f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:39.747769 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a69a5-502c-4818-9d75-4fb5517a5f04 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:39.748299 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a69a5-502c-4818-9d75-4fb5517a5f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:39.750092 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a69a5-502c-4818-9d75-4fb5517a5f04 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:39.765555 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 112/219] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:39.772391 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56289c-a418-426f-9f1a-15b789c5e35b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:39.788974 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56289c-a418-426f-9f1a-15b789c5e35b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:39.797119 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c016a-1f70-478b-b7a8-f01eb9b34e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:39.798264 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c016a-1f70-478b-b7a8-f01eb9b34e0c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:39.798551 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c016a-1f70-478b-b7a8-f01eb9b34e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:39.798826 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c016a-1f70-478b-b7a8-f01eb9b34e0c admin admin] PATH_INFO: `/v3/users/242495ec1ecf41a0b724acb554aea550` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:39.800684 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c016a-1f70-478b-b7a8-f01eb9b34e0c admin admin] RBAC: Authorizing `identity:get_user(user_id=242495ec1ecf41a0b724acb554aea550)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:39.803044 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c016a-1f70-478b-b7a8-f01eb9b34e0c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:39.805022 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 108/220] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:39 2021] GET /identity/v3/users/242495ec1ecf41a0b724acb554aea550 => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:39.810768 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a69a5-502c-4818-9d75-4fb5517a5f04 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:39.822714 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a69a5-502c-4818-9d75-4fb5517a5f04 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:39.836674 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b3940-be44-480d-ad59-e19d6c9d9499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:39.837931 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b3940-be44-480d-ad59-e19d6c9d9499 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:39.838423 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b3940-be44-480d-ad59-e19d6c9d9499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:39.838918 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b3940-be44-480d-ad59-e19d6c9d9499 admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:39.840475 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b3940-be44-480d-ad59-e19d6c9d9499 admin admin] RBAC: Authorizing `identity:get_project(project_id=66d1377d6a7d40f798138de207208f9e)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:39.842709 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b3940-be44-480d-ad59-e19d6c9d9499 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:39.844692 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 113/221] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:39 2021] GET /identity/v3/projects/66d1377d6a7d40f798138de207208f9e => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:39.850952 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c016a-1f70-478b-b7a8-f01eb9b34e0c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:39.859567 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790ceed-e075-4332-b21d-977807dbd52c None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:39.860165 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790ceed-e075-4332-b21d-977807dbd52c None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:39.860645 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790ceed-e075-4332-b21d-977807dbd52c None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:39.862685 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 114/222] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:54:39.868895 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733b6bf-1c6c-4d48-b7e4-84eacdf6d68a None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:39.869177 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733b6bf-1c6c-4d48-b7e4-84eacdf6d68a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:39.869456 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733b6bf-1c6c-4d48-b7e4-84eacdf6d68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:39.900473 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-4733b6bf-1c6c-4d48-b7e4-84eacdf6d68a None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:39.901700 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-4733b6bf-1c6c-4d48-b7e4-84eacdf6d68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:39.919949 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 115/223] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:39.965034 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733b6bf-1c6c-4d48-b7e4-84eacdf6d68a None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:39.978691 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c016a-1f70-478b-b7a8-f01eb9b34e0c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:39.982454 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733b6bf-1c6c-4d48-b7e4-84eacdf6d68a None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:39.983228 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204c4c1-e8d1-49a7-9fa3-f5e5e9f3f7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:39.984120 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204c4c1-e8d1-49a7-9fa3-f5e5e9f3f7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:39.984402 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204c4c1-e8d1-49a7-9fa3-f5e5e9f3f7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:39.984724 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204c4c1-e8d1-49a7-9fa3-f5e5e9f3f7b5 admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e/users/242495ec1ecf41a0b724acb554aea550/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:39.986793 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204c4c1-e8d1-49a7-9fa3-f5e5e9f3f7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d1377d6a7d40f798138de207208f9e, user_id=242495ec1ecf41a0b724acb554aea550, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:39.990344 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204c4c1-e8d1-49a7-9fa3-f5e5e9f3f7b5 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:39.999891 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26aff32-d7cd-4309-bfc9-c07264bb5325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:40.000704 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26aff32-d7cd-4309-bfc9-c07264bb5325 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.000990 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26aff32-d7cd-4309-bfc9-c07264bb5325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.001261 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26aff32-d7cd-4309-bfc9-c07264bb5325 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.015871 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26aff32-d7cd-4309-bfc9-c07264bb5325 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:40.023900 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-f26aff32-d7cd-4309-bfc9-c07264bb5325 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 03:54:40.025328 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 116/224] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:54:40.031707 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26aff32-d7cd-4309-bfc9-c07264bb5325 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:40.042229 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26aff32-d7cd-4309-bfc9-c07264bb5325 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:40.047084 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c13e7-6dd1-4e0d-8d4b-21306b6ef538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:40.048138 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c13e7-6dd1-4e0d-8d4b-21306b6ef538 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.048721 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c13e7-6dd1-4e0d-8d4b-21306b6ef538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.049212 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c13e7-6dd1-4e0d-8d4b-21306b6ef538 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.050301 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c13e7-6dd1-4e0d-8d4b-21306b6ef538 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:40.051435 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c13e7-6dd1-4e0d-8d4b-21306b6ef538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:40.053274 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c13e7-6dd1-4e0d-8d4b-21306b6ef538 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:40.061177 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 109/225] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:54:39 2021] PUT /identity/v3/projects/66d1377d6a7d40f798138de207208f9e/users/242495ec1ecf41a0b724acb554aea550/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:54:40.079183 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 117/226] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:40 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:40.092679 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204c4c1-e8d1-49a7-9fa3-f5e5e9f3f7b5 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:40.168823 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204c4c1-e8d1-49a7-9fa3-f5e5e9f3f7b5 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:40.175000 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01610322-673f-4530-bb88-625a8fdd2e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:40.176869 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01610322-673f-4530-bb88-625a8fdd2e7b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.177413 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01610322-673f-4530-bb88-625a8fdd2e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.177882 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01610322-673f-4530-bb88-625a8fdd2e7b admin admin] PATH_INFO: `/v3/users/242495ec1ecf41a0b724acb554aea550` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.182107 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01610322-673f-4530-bb88-625a8fdd2e7b admin admin] RBAC: Authorizing `identity:get_user(user_id=242495ec1ecf41a0b724acb554aea550)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:40.184741 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01610322-673f-4530-bb88-625a8fdd2e7b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:40.186814 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 110/227] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:40 2021] GET /identity/v3/users/242495ec1ecf41a0b724acb554aea550 => generated 283 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:40.193671 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c13e7-6dd1-4e0d-8d4b-21306b6ef538 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:40.205728 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c13e7-6dd1-4e0d-8d4b-21306b6ef538 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:40.213282 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5eed9-d83a-4e41-a288-9cdfafda3db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:40.215324 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5eed9-d83a-4e41-a288-9cdfafda3db7 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.216058 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5eed9-d83a-4e41-a288-9cdfafda3db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.216534 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5eed9-d83a-4e41-a288-9cdfafda3db7 admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.218894 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5eed9-d83a-4e41-a288-9cdfafda3db7 admin admin] RBAC: Authorizing `identity:get_project(project_id=66d1377d6a7d40f798138de207208f9e)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:40.222345 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5eed9-d83a-4e41-a288-9cdfafda3db7 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:40.225300 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 118/228] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:40 2021] GET /identity/v3/projects/66d1377d6a7d40f798138de207208f9e => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:40.232831 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01610322-673f-4530-bb88-625a8fdd2e7b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:40.248870 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01610322-673f-4530-bb88-625a8fdd2e7b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:40.254436 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350df50d-147a-4b9c-9069-5ba101ef055a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:40.255622 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350df50d-147a-4b9c-9069-5ba101ef055a admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.256098 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350df50d-147a-4b9c-9069-5ba101ef055a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.256615 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350df50d-147a-4b9c-9069-5ba101ef055a admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e/users/242495ec1ecf41a0b724acb554aea550/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.260545 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350df50d-147a-4b9c-9069-5ba101ef055a admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d1377d6a7d40f798138de207208f9e, user_id=242495ec1ecf41a0b724acb554aea550, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:40.263541 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350df50d-147a-4b9c-9069-5ba101ef055a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:40.274206 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc8a7f-e71e-46f6-82fd-a28687bfcaeb None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.274527 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc8a7f-e71e-46f6-82fd-a28687bfcaeb None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.274775 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc8a7f-e71e-46f6-82fd-a28687bfcaeb None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.276622 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 119/229] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:54:40.283005 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5b2ae-d41b-417a-aaee-e5cade179db2 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.283437 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5b2ae-d41b-417a-aaee-e5cade179db2 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.283777 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5b2ae-d41b-417a-aaee-e5cade179db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.305318 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-d1d5b2ae-d41b-417a-aaee-e5cade179db2 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:40.306793 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-d1d5b2ae-d41b-417a-aaee-e5cade179db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:40.319415 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 120/230] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:40.342359 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 111/231] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:54:40 2021] PUT /identity/v3/projects/66d1377d6a7d40f798138de207208f9e/users/242495ec1ecf41a0b724acb554aea550/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 03:54:40.343917 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5b2ae-d41b-417a-aaee-e5cade179db2 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:40.359534 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5b2ae-d41b-417a-aaee-e5cade179db2 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:40.361857 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f543b-8d2b-4a2d-8a3c-4262cc224037 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.362364 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f543b-8d2b-4a2d-8a3c-4262cc224037 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.362836 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f543b-8d2b-4a2d-8a3c-4262cc224037 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.365455 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 112/232] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:40.372150 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7de23-9acc-4ead-9de8-e69b9f0f2e3c None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.374908 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7de23-9acc-4ead-9de8-e69b9f0f2e3c None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.374908 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7de23-9acc-4ead-9de8-e69b9f0f2e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.401277 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-7cc7de23-9acc-4ead-9de8-e69b9f0f2e3c None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:40.403012 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-7cc7de23-9acc-4ead-9de8-e69b9f0f2e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:40.440834 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac850b2-ec1f-4527-a2f4-6f35ae0114c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:40.442244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac850b2-ec1f-4527-a2f4-6f35ae0114c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.442566 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac850b2-ec1f-4527-a2f4-6f35ae0114c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.443191 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac850b2-ec1f-4527-a2f4-6f35ae0114c2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.458455 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac850b2-ec1f-4527-a2f4-6f35ae0114c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:40.466122 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-4ac850b2-ec1f-4527-a2f4-6f35ae0114c2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 03:54:40.467339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 121/233] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:40 2021] GET /identity/v3/roles/member => generated 84 bytes in 124 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:40.469010 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6fba6-14c6-4281-86de-eea2273a0b81 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.469010 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6fba6-14c6-4281-86de-eea2273a0b81 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.469306 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6fba6-14c6-4281-86de-eea2273a0b81 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.471171 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 122/234] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:40.477298 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6fba6-14c6-4281-86de-eea2273a0b81 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:40.486086 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 113/235] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:40.488444 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e202763-49ee-46c5-8c63-bf285bb25f89 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.489128 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e202763-49ee-46c5-8c63-bf285bb25f89 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.489868 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e202763-49ee-46c5-8c63-bf285bb25f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.499550 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6fba6-14c6-4281-86de-eea2273a0b81 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:40.509638 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287f280-2596-4c35-a955-2d95192f4fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:40.510322 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287f280-2596-4c35-a955-2d95192f4fbb admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.510613 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287f280-2596-4c35-a955-2d95192f4fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.510893 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287f280-2596-4c35-a955-2d95192f4fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.511721 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287f280-2596-4c35-a955-2d95192f4fbb admin admin] RBAC: Adding query filter params (name=member) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:40.512030 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287f280-2596-4c35-a955-2d95192f4fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:40.512533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-5e202763-49ee-46c5-8c63-bf285bb25f89 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:40.513665 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287f280-2596-4c35-a955-2d95192f4fbb admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:40.514203 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-5e202763-49ee-46c5-8c63-bf285bb25f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:40.524598 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 123/236] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:40 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:40.524965 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 114/237] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:40.531276 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287f280-2596-4c35-a955-2d95192f4fbb admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:40.532600 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e202763-49ee-46c5-8c63-bf285bb25f89 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:40.543510 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e202763-49ee-46c5-8c63-bf285bb25f89 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:40.550722 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc4ba2-dc58-4caa-bd38-f1a64f2e3776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:40.551882 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc4ba2-dc58-4caa-bd38-f1a64f2e3776 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.551882 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc4ba2-dc58-4caa-bd38-f1a64f2e3776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.552153 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc4ba2-dc58-4caa-bd38-f1a64f2e3776 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.554097 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287f280-2596-4c35-a955-2d95192f4fbb admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:40.565934 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6435e-d0e0-4d60-a016-c3b99cc6eae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:40.567654 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6435e-d0e0-4d60-a016-c3b99cc6eae1 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.568391 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6435e-d0e0-4d60-a016-c3b99cc6eae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.568675 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6435e-d0e0-4d60-a016-c3b99cc6eae1 admin admin] PATH_INFO: `/v3/users/716f5254dfab4205ab85982ab7a232cd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.569483 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc4ba2-dc58-4caa-bd38-f1a64f2e3776 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:40.577011 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-efcc4ba2-dc58-4caa-bd38-f1a64f2e3776 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 03:54:40.578269 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 115/238] 10.222.0.54 () {56 vars in 1135 bytes} [Tue Nov 23 03:54:40 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:40.579060 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc4ba2-dc58-4caa-bd38-f1a64f2e3776 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:40.589760 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6435e-d0e0-4d60-a016-c3b99cc6eae1 admin admin] RBAC: Authorizing `identity:get_user(user_id=716f5254dfab4205ab85982ab7a232cd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:40.592467 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6435e-d0e0-4d60-a016-c3b99cc6eae1 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:40.593097 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc4ba2-dc58-4caa-bd38-f1a64f2e3776 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:40.597249 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 124/239] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:40 2021] GET /identity/v3/users/716f5254dfab4205ab85982ab7a232cd => generated 297 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:40.597249 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6435e-d0e0-4d60-a016-c3b99cc6eae1 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:40.603829 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77a1e6-3acb-4768-8f67-abde1a2a738e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:40.604880 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77a1e6-3acb-4768-8f67-abde1a2a738e admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.605341 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77a1e6-3acb-4768-8f67-abde1a2a738e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.605888 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77a1e6-3acb-4768-8f67-abde1a2a738e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.609032 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77a1e6-3acb-4768-8f67-abde1a2a738e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:40.610933 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77a1e6-3acb-4768-8f67-abde1a2a738e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:40.611481 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6435e-d0e0-4d60-a016-c3b99cc6eae1 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:40.613028 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 116/240] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:54:40 2021] GET /identity/v3/domains/default => generated 199 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:40.614069 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77a1e6-3acb-4768-8f67-abde1a2a738e admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:40.618305 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ef5eb-31ee-482d-9b4f-2b33590a390d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:40.620860 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ef5eb-31ee-482d-9b4f-2b33590a390d admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.621201 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ef5eb-31ee-482d-9b4f-2b33590a390d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.621487 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ef5eb-31ee-482d-9b4f-2b33590a390d admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.623431 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ef5eb-31ee-482d-9b4f-2b33590a390d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:40.623801 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ef5eb-31ee-482d-9b4f-2b33590a390d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:40.625554 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ef5eb-31ee-482d-9b4f-2b33590a390d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:40.632339 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77a1e6-3acb-4768-8f67-abde1a2a738e admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:40.636202 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 125/241] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:54:40 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:40.637069 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ef5eb-31ee-482d-9b4f-2b33590a390d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:40.641461 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c2d21-34a3-4e3c-9b26-72dc05ea2739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:40.642372 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c2d21-34a3-4e3c-9b26-72dc05ea2739 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.642839 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c2d21-34a3-4e3c-9b26-72dc05ea2739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.643118 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c2d21-34a3-4e3c-9b26-72dc05ea2739 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.647916 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ef5eb-31ee-482d-9b4f-2b33590a390d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:40.652299 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afa24f-3ea7-418f-809e-83c6c0a58b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:40.653019 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afa24f-3ea7-418f-809e-83c6c0a58b99 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.653322 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afa24f-3ea7-418f-809e-83c6c0a58b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.653588 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afa24f-3ea7-418f-809e-83c6c0a58b99 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.654313 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c2d21-34a3-4e3c-9b26-72dc05ea2739 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:40.654431 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afa24f-3ea7-418f-809e-83c6c0a58b99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:40.656246 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c2d21-34a3-4e3c-9b26-72dc05ea2739 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:40.656356 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afa24f-3ea7-418f-809e-83c6c0a58b99 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:40.667047 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 117/242] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:40 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:40.667950 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c2d21-34a3-4e3c-9b26-72dc05ea2739 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:40.677334 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c2d21-34a3-4e3c-9b26-72dc05ea2739 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:40.681911 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b37c59-d177-428d-a055-5dc900e22bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:40.682782 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b37c59-d177-428d-a055-5dc900e22bfa admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.683086 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b37c59-d177-428d-a055-5dc900e22bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.694008 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b37c59-d177-428d-a055-5dc900e22bfa admin admin] PATH_INFO: `/v3/users/242495ec1ecf41a0b724acb554aea550` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.694008 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b37c59-d177-428d-a055-5dc900e22bfa admin admin] RBAC: Authorizing `identity:get_user(user_id=242495ec1ecf41a0b724acb554aea550)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:40.694008 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b37c59-d177-428d-a055-5dc900e22bfa admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:40.694008 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 118/243] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:40 2021] GET /identity/v3/users/242495ec1ecf41a0b724acb554aea550 => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:40.694008 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b37c59-d177-428d-a055-5dc900e22bfa admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:40.703710 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b37c59-d177-428d-a055-5dc900e22bfa admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:40.709319 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0f0f1-3076-4773-a3d7-cd26946ead1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:40.710146 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0f0f1-3076-4773-a3d7-cd26946ead1f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.710570 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0f0f1-3076-4773-a3d7-cd26946ead1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.710818 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0f0f1-3076-4773-a3d7-cd26946ead1f admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.712054 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0f0f1-3076-4773-a3d7-cd26946ead1f admin admin] RBAC: Authorizing `identity:get_project(project_id=66d1377d6a7d40f798138de207208f9e)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:40.714040 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0f0f1-3076-4773-a3d7-cd26946ead1f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:40.715914 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 119/244] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:40 2021] GET /identity/v3/projects/66d1377d6a7d40f798138de207208f9e => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:40.717103 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0f0f1-3076-4773-a3d7-cd26946ead1f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:40.726949 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0f0f1-3076-4773-a3d7-cd26946ead1f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:40.731375 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7e17b-6ee2-4b20-bc72-c6d8cdb1dc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:40.732185 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7e17b-6ee2-4b20-bc72-c6d8cdb1dc6f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.732467 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7e17b-6ee2-4b20-bc72-c6d8cdb1dc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.732738 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7e17b-6ee2-4b20-bc72-c6d8cdb1dc6f admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.733995 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7e17b-6ee2-4b20-bc72-c6d8cdb1dc6f admin admin] RBAC: Authorizing `identity:get_project(project_id=66d1377d6a7d40f798138de207208f9e)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:40.736042 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7e17b-6ee2-4b20-bc72-c6d8cdb1dc6f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:40.737874 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 120/245] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:40 2021] GET /identity/v3/projects/66d1377d6a7d40f798138de207208f9e => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:40.739568 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7e17b-6ee2-4b20-bc72-c6d8cdb1dc6f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:40.749287 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7e17b-6ee2-4b20-bc72-c6d8cdb1dc6f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:40.750506 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 126/246] 10.222.0.54 () {60 vars in 1153 bytes} [Tue Nov 23 03:54:40 2021] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:54:40.751160 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afa24f-3ea7-418f-809e-83c6c0a58b99 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:40.764469 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7bf580-d1ce-4893-8641-35c81f0150d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:40.765139 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bf580-d1ce-4893-8641-35c81f0150d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.765421 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bf580-d1ce-4893-8641-35c81f0150d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.765695 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bf580-d1ce-4893-8641-35c81f0150d2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.766544 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7bf580-d1ce-4893-8641-35c81f0150d2 admin admin] RBAC: Adding query filter params (role.id=c817e9fe7d034dd4ac25b1f45fd209c7, scope.project.id=66d1377d6a7d40f798138de207208f9e, user.id=716f5254dfab4205ab85982ab7a232cd) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:40.766857 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7bf580-d1ce-4893-8641-35c81f0150d2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:40.768186 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afa24f-3ea7-418f-809e-83c6c0a58b99 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:40.768709 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7bf580-d1ce-4893-8641-35c81f0150d2 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:40.774995 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebaa1fd-8c2f-4c38-aaa7-528d0092c4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:40.776442 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebaa1fd-8c2f-4c38-aaa7-528d0092c4ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:40.776922 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebaa1fd-8c2f-4c38-aaa7-528d0092c4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:40.777444 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebaa1fd-8c2f-4c38-aaa7-528d0092c4ed admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e/users/242495ec1ecf41a0b724acb554aea550/roles/e8e5c21f4bea46318bef0c9784214ce6` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:40.780254 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebaa1fd-8c2f-4c38-aaa7-528d0092c4ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d1377d6a7d40f798138de207208f9e, user_id=242495ec1ecf41a0b724acb554aea550, role_id=e8e5c21f4bea46318bef0c9784214ce6)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:40.784652 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebaa1fd-8c2f-4c38-aaa7-528d0092c4ed admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:40.795250 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 121/247] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:54:40 2021] GET /identity/v3/role_assignments?user.id=716f5254dfab4205ab85982ab7a232cd&scope.project.id=66d1377d6a7d40f798138de207208f9e&role.id=c817e9fe7d034dd4ac25b1f45fd209c7 => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:40.913519 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 127/248] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:54:40 2021] PUT /identity/v3/projects/66d1377d6a7d40f798138de207208f9e/users/242495ec1ecf41a0b724acb554aea550/roles/e8e5c21f4bea46318bef0c9784214ce6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:54:42.892837 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658853b1-7e88-402a-a5c2-2ad86467999a None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:42.893353 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658853b1-7e88-402a-a5c2-2ad86467999a None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:42.893353 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658853b1-7e88-402a-a5c2-2ad86467999a None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:42.896034 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 122/249] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:42.902475 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fd55a-df90-4658-a5f7-9d90daf95e99 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:42.902925 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fd55a-df90-4658-a5f7-9d90daf95e99 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:42.903021 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fd55a-df90-4658-a5f7-9d90daf95e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:42.928566 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-db4fd55a-df90-4658-a5f7-9d90daf95e99 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:42.929792 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-db4fd55a-df90-4658-a5f7-9d90daf95e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:43.001635 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 128/250] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:43.052707 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658853b1-7e88-402a-a5c2-2ad86467999a None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:43.064880 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658853b1-7e88-402a-a5c2-2ad86467999a None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:43.073546 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefef64-1698-4f83-95cd-313280d5a1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:43.074337 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefef64-1698-4f83-95cd-313280d5a1cb admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:43.074619 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefef64-1698-4f83-95cd-313280d5a1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:43.074892 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefef64-1698-4f83-95cd-313280d5a1cb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:43.089173 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefef64-1698-4f83-95cd-313280d5a1cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:43.096063 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-1eefef64-1698-4f83-95cd-313280d5a1cb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:54:43.097322 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 123/251] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:54:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:43.103946 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fd55a-df90-4658-a5f7-9d90daf95e99 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:43.114075 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fd55a-df90-4658-a5f7-9d90daf95e99 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:43.123520 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74966fd5-396e-4c60-b920-c4af59b64b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:43.124383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74966fd5-396e-4c60-b920-c4af59b64b4e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:43.124806 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74966fd5-396e-4c60-b920-c4af59b64b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:43.125220 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74966fd5-396e-4c60-b920-c4af59b64b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:43.126128 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74966fd5-396e-4c60-b920-c4af59b64b4e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:43.132764 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74966fd5-396e-4c60-b920-c4af59b64b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:43.132764 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74966fd5-396e-4c60-b920-c4af59b64b4e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:43.141123 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 129/252] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:43.148345 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefef64-1698-4f83-95cd-313280d5a1cb admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:43.160823 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefef64-1698-4f83-95cd-313280d5a1cb admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:43.165452 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d24b1-2c2f-49a5-8f75-b6fdbe98e12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:43.166466 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d24b1-2c2f-49a5-8f75-b6fdbe98e12c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:43.166889 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d24b1-2c2f-49a5-8f75-b6fdbe98e12c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:43.167325 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d24b1-2c2f-49a5-8f75-b6fdbe98e12c admin admin] PATH_INFO: `/v3/users/242495ec1ecf41a0b724acb554aea550` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:43.171939 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d24b1-2c2f-49a5-8f75-b6fdbe98e12c admin admin] RBAC: Authorizing `identity:get_user(user_id=242495ec1ecf41a0b724acb554aea550)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:43.174197 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d24b1-2c2f-49a5-8f75-b6fdbe98e12c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:43.176499 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 124/253] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:43 2021] GET /identity/v3/users/242495ec1ecf41a0b724acb554aea550 => generated 283 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:43.182641 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74966fd5-396e-4c60-b920-c4af59b64b4e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:43.192671 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74966fd5-396e-4c60-b920-c4af59b64b4e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:43.203297 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa10e81-80ac-4fec-a887-7ff23d16621c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:43.204144 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa10e81-80ac-4fec-a887-7ff23d16621c admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:43.204565 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa10e81-80ac-4fec-a887-7ff23d16621c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:43.204978 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa10e81-80ac-4fec-a887-7ff23d16621c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:43.214353 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa10e81-80ac-4fec-a887-7ff23d16621c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:43.216306 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa10e81-80ac-4fec-a887-7ff23d16621c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:43.226116 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 130/254] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:43.232510 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d24b1-2c2f-49a5-8f75-b6fdbe98e12c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:43.246331 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d24b1-2c2f-49a5-8f75-b6fdbe98e12c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:43.251112 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679f26e-2c4f-42e7-951d-944771d5cde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:43.252209 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679f26e-2c4f-42e7-951d-944771d5cde4 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:43.252632 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679f26e-2c4f-42e7-951d-944771d5cde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:43.253041 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679f26e-2c4f-42e7-951d-944771d5cde4 admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:43.260000 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679f26e-2c4f-42e7-951d-944771d5cde4 admin admin] RBAC: Authorizing `identity:get_project(project_id=66d1377d6a7d40f798138de207208f9e)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:43.262230 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679f26e-2c4f-42e7-951d-944771d5cde4 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:43.264229 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 125/255] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:43 2021] GET /identity/v3/projects/66d1377d6a7d40f798138de207208f9e => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:43.270928 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81312b9a-1bca-492d-867f-0035b8cd4e39 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:43.271539 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81312b9a-1bca-492d-867f-0035b8cd4e39 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:43.271974 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81312b9a-1bca-492d-867f-0035b8cd4e39 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:43.273885 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 131/256] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:43.276117 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679f26e-2c4f-42e7-951d-944771d5cde4 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:43.279626 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536344a-ab9e-4e11-bba4-f730db665003 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:43.280060 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536344a-ab9e-4e11-bba4-f730db665003 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:43.280471 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536344a-ab9e-4e11-bba4-f730db665003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:43.302681 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679f26e-2c4f-42e7-951d-944771d5cde4 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:43.311052 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9c2e3-42de-4944-b15e-3b7ae8a263ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:43.311923 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9c2e3-42de-4944-b15e-3b7ae8a263ce admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:43.312344 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9c2e3-42de-4944-b15e-3b7ae8a263ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:43.312755 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9c2e3-42de-4944-b15e-3b7ae8a263ce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:43.313738 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9c2e3-42de-4944-b15e-3b7ae8a263ce admin admin] RBAC: Adding query filter params (role.id=3db7012b41944542a50049819500eadd, scope.project.id=66d1377d6a7d40f798138de207208f9e, user.id=242495ec1ecf41a0b724acb554aea550) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:43.314204 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9c2e3-42de-4944-b15e-3b7ae8a263ce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:43.316278 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9c2e3-42de-4944-b15e-3b7ae8a263ce admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:43.323259 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 126/257] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:54:43 2021] GET /identity/v3/role_assignments?user.id=242495ec1ecf41a0b724acb554aea550&scope.project.id=66d1377d6a7d40f798138de207208f9e&role.id=3db7012b41944542a50049819500eadd => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:43.360478 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-5536344a-ab9e-4e11-bba4-f730db665003 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:43.361935 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-5536344a-ab9e-4e11-bba4-f730db665003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:43.370097 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 132/258] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:43.412012 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9c2e3-42de-4944-b15e-3b7ae8a263ce admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:43.421986 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9c2e3-42de-4944-b15e-3b7ae8a263ce admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:43.431991 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef87d6-86cb-4d25-9361-ada22de7b193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:43.433039 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef87d6-86cb-4d25-9361-ada22de7b193 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:43.433763 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef87d6-86cb-4d25-9361-ada22de7b193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:43.434177 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef87d6-86cb-4d25-9361-ada22de7b193 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:43.446573 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef87d6-86cb-4d25-9361-ada22de7b193 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:43.453765 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-17ef87d6-86cb-4d25-9361-ada22de7b193 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 03:54:43.455151 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 127/259] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:43 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:43.462110 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536344a-ab9e-4e11-bba4-f730db665003 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:43.471698 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536344a-ab9e-4e11-bba4-f730db665003 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:43.483542 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915e91f-595a-4d13-a08e-9e73afc7197f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:43.484445 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915e91f-595a-4d13-a08e-9e73afc7197f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:43.484867 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915e91f-595a-4d13-a08e-9e73afc7197f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:43.485304 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915e91f-595a-4d13-a08e-9e73afc7197f admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:43.486209 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915e91f-595a-4d13-a08e-9e73afc7197f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:43.486652 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915e91f-595a-4d13-a08e-9e73afc7197f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:43.488473 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915e91f-595a-4d13-a08e-9e73afc7197f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:43.497745 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 133/260] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:43 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:43.504496 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef87d6-86cb-4d25-9361-ada22de7b193 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:43.521297 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef87d6-86cb-4d25-9361-ada22de7b193 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:43.528793 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5006e0d-4268-4ff2-b722-1c7704b65ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:43.529873 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5006e0d-4268-4ff2-b722-1c7704b65ffd admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:43.530290 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5006e0d-4268-4ff2-b722-1c7704b65ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:43.530721 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5006e0d-4268-4ff2-b722-1c7704b65ffd admin admin] PATH_INFO: `/v3/users/242495ec1ecf41a0b724acb554aea550` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:43.532121 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5006e0d-4268-4ff2-b722-1c7704b65ffd admin admin] RBAC: Authorizing `identity:get_user(user_id=242495ec1ecf41a0b724acb554aea550)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:43.539841 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5006e0d-4268-4ff2-b722-1c7704b65ffd admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:43.541915 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 128/261] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:43 2021] GET /identity/v3/users/242495ec1ecf41a0b724acb554aea550 => generated 283 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:43.547870 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915e91f-595a-4d13-a08e-9e73afc7197f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:43.558166 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915e91f-595a-4d13-a08e-9e73afc7197f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:43.568429 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70870dcd-4077-4b76-b878-d78af8300c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:43.569345 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70870dcd-4077-4b76-b878-d78af8300c7b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:43.569768 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70870dcd-4077-4b76-b878-d78af8300c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:43.570207 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70870dcd-4077-4b76-b878-d78af8300c7b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:43.589994 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70870dcd-4077-4b76-b878-d78af8300c7b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:43.592038 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70870dcd-4077-4b76-b878-d78af8300c7b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:43.602852 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 134/262] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:43.609219 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5006e0d-4268-4ff2-b722-1c7704b65ffd admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:43.624803 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5006e0d-4268-4ff2-b722-1c7704b65ffd admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:43.630335 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2043292-c449-426b-ac72-e533d8388188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:43.631456 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2043292-c449-426b-ac72-e533d8388188 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:43.631877 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2043292-c449-426b-ac72-e533d8388188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:43.632286 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2043292-c449-426b-ac72-e533d8388188 admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:43.636250 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2043292-c449-426b-ac72-e533d8388188 admin admin] RBAC: Authorizing `identity:get_project(project_id=66d1377d6a7d40f798138de207208f9e)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:43.638482 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2043292-c449-426b-ac72-e533d8388188 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:43.640792 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 129/263] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:43 2021] GET /identity/v3/projects/66d1377d6a7d40f798138de207208f9e => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:43.647077 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70870dcd-4077-4b76-b878-d78af8300c7b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:43.656394 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70870dcd-4077-4b76-b878-d78af8300c7b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:43.673870 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a8a46-71c4-4cee-9c25-9d6b25dca821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:43.674797 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a8a46-71c4-4cee-9c25-9d6b25dca821 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:43.675262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a8a46-71c4-4cee-9c25-9d6b25dca821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:43.675755 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a8a46-71c4-4cee-9c25-9d6b25dca821 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:43.676773 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a8a46-71c4-4cee-9c25-9d6b25dca821 admin admin] RBAC: Adding query filter params (role.id=c817e9fe7d034dd4ac25b1f45fd209c7, scope.project.id=66d1377d6a7d40f798138de207208f9e, user.id=242495ec1ecf41a0b724acb554aea550) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:43.677257 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a8a46-71c4-4cee-9c25-9d6b25dca821 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:43.679285 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a8a46-71c4-4cee-9c25-9d6b25dca821 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:43.693223 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 135/264] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:54:43 2021] GET /identity/v3/role_assignments?user.id=242495ec1ecf41a0b724acb554aea550&scope.project.id=66d1377d6a7d40f798138de207208f9e&role.id=c817e9fe7d034dd4ac25b1f45fd209c7 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:43.847248 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71361be1-0497-4d4c-a0bb-1ec5d68f7ff1 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:43.847629 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71361be1-0497-4d4c-a0bb-1ec5d68f7ff1 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:43.847990 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71361be1-0497-4d4c-a0bb-1ec5d68f7ff1 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:43.849848 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 130/265] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:43.860128 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95663126-01a4-4d91-bd40-847719a6c28d None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:43.860427 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95663126-01a4-4d91-bd40-847719a6c28d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:43.860689 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95663126-01a4-4d91-bd40-847719a6c28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:43.884662 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-95663126-01a4-4d91-bd40-847719a6c28d None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:43.885857 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-95663126-01a4-4d91-bd40-847719a6c28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:43.896365 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 136/266] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:43.933943 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71361be1-0497-4d4c-a0bb-1ec5d68f7ff1 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:43.948855 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71361be1-0497-4d4c-a0bb-1ec5d68f7ff1 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:43.953358 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad93c28-481f-4557-8b54-4b8c5d82f1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:43.954176 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad93c28-481f-4557-8b54-4b8c5d82f1fa admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:43.954486 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad93c28-481f-4557-8b54-4b8c5d82f1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:43.954722 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad93c28-481f-4557-8b54-4b8c5d82f1fa admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:43.971080 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad93c28-481f-4557-8b54-4b8c5d82f1fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:43.978582 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-9ad93c28-481f-4557-8b54-4b8c5d82f1fa admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 03:54:43.980183 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 131/267] 10.222.0.54 () {56 vars in 1135 bytes} [Tue Nov 23 03:54:43 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:43.986199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95663126-01a4-4d91-bd40-847719a6c28d None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:43.996436 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95663126-01a4-4d91-bd40-847719a6c28d None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:44.006736 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e50681-4768-4957-a545-0af0d9b78dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:44.007448 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e50681-4768-4957-a545-0af0d9b78dca admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:44.007729 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e50681-4768-4957-a545-0af0d9b78dca admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:44.007999 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e50681-4768-4957-a545-0af0d9b78dca admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:44.008779 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e50681-4768-4957-a545-0af0d9b78dca admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:44.009143 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e50681-4768-4957-a545-0af0d9b78dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:44.010766 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e50681-4768-4957-a545-0af0d9b78dca admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:44.020913 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 137/268] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:54:43 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:44.026426 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad93c28-481f-4557-8b54-4b8c5d82f1fa admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:44.037126 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad93c28-481f-4557-8b54-4b8c5d82f1fa admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:44.042998 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c05b7-0700-42d5-8cf5-a5eb2d0c46f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:44.043946 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c05b7-0700-42d5-8cf5-a5eb2d0c46f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:44.044319 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c05b7-0700-42d5-8cf5-a5eb2d0c46f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:44.044596 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c05b7-0700-42d5-8cf5-a5eb2d0c46f5 admin admin] PATH_INFO: `/v3/users/242495ec1ecf41a0b724acb554aea550` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:44.046359 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c05b7-0700-42d5-8cf5-a5eb2d0c46f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=242495ec1ecf41a0b724acb554aea550)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:44.048601 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c05b7-0700-42d5-8cf5-a5eb2d0c46f5 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:44.050482 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 132/269] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:44 2021] GET /identity/v3/users/242495ec1ecf41a0b724acb554aea550 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:44.056924 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e50681-4768-4957-a545-0af0d9b78dca admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:44.067498 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e50681-4768-4957-a545-0af0d9b78dca admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:44.076280 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560ffb3-d4ce-4998-b8ee-7086706cb9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:44.076974 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560ffb3-d4ce-4998-b8ee-7086706cb9df admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:44.077260 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560ffb3-d4ce-4998-b8ee-7086706cb9df admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:44.077630 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560ffb3-d4ce-4998-b8ee-7086706cb9df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:44.088566 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560ffb3-d4ce-4998-b8ee-7086706cb9df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:44.090387 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560ffb3-d4ce-4998-b8ee-7086706cb9df admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:44.101390 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 138/270] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:44 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:44.108381 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c05b7-0700-42d5-8cf5-a5eb2d0c46f5 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:44.121533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c05b7-0700-42d5-8cf5-a5eb2d0c46f5 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:44.132121 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c0562-ed75-4205-a59c-63e0c7df9c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:44.133059 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c0562-ed75-4205-a59c-63e0c7df9c98 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:44.133334 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c0562-ed75-4205-a59c-63e0c7df9c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:44.133659 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c0562-ed75-4205-a59c-63e0c7df9c98 admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:44.135339 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c0562-ed75-4205-a59c-63e0c7df9c98 admin admin] RBAC: Authorizing `identity:get_project(project_id=66d1377d6a7d40f798138de207208f9e)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:44.137437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c0562-ed75-4205-a59c-63e0c7df9c98 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:44.139448 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 133/271] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:44 2021] GET /identity/v3/projects/66d1377d6a7d40f798138de207208f9e => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:44.145580 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560ffb3-d4ce-4998-b8ee-7086706cb9df admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:44.154764 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560ffb3-d4ce-4998-b8ee-7086706cb9df admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:44.164030 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d87d6-1556-4b3f-9fb4-6d83fe577fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:44.164688 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d87d6-1556-4b3f-9fb4-6d83fe577fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:44.164968 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d87d6-1556-4b3f-9fb4-6d83fe577fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:44.165246 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d87d6-1556-4b3f-9fb4-6d83fe577fe7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:44.166090 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d87d6-1556-4b3f-9fb4-6d83fe577fe7 admin admin] RBAC: Adding query filter params (role.id=e8e5c21f4bea46318bef0c9784214ce6, scope.project.id=66d1377d6a7d40f798138de207208f9e, user.id=242495ec1ecf41a0b724acb554aea550) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:44.166400 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d87d6-1556-4b3f-9fb4-6d83fe577fe7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:44.168264 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d87d6-1556-4b3f-9fb4-6d83fe577fe7 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:44.174627 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 139/272] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:54:44 2021] GET /identity/v3/role_assignments?user.id=242495ec1ecf41a0b724acb554aea550&scope.project.id=66d1377d6a7d40f798138de207208f9e&role.id=e8e5c21f4bea46318bef0c9784214ce6 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:44.295951 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56bf8d-2019-4832-9c96-8694b5dcf07e None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:44.296289 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56bf8d-2019-4832-9c96-8694b5dcf07e None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:44.296531 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56bf8d-2019-4832-9c96-8694b5dcf07e None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:44.298324 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 134/273] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:44.305436 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d6af2-cce6-4968-aff8-fd0a85a8ad90 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:44.305706 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d6af2-cce6-4968-aff8-fd0a85a8ad90 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:44.305989 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d6af2-cce6-4968-aff8-fd0a85a8ad90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:44.328827 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-444d6af2-cce6-4968-aff8-fd0a85a8ad90 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:44.330033 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-444d6af2-cce6-4968-aff8-fd0a85a8ad90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:44.340640 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 140/274] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:44.368809 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56bf8d-2019-4832-9c96-8694b5dcf07e None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:44.381406 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56bf8d-2019-4832-9c96-8694b5dcf07e None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:44.388579 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e71caa-1cb2-4c9f-8e6f-901cb3fec2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:44.389529 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e71caa-1cb2-4c9f-8e6f-901cb3fec2ce admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:44.389813 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e71caa-1cb2-4c9f-8e6f-901cb3fec2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:44.390087 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e71caa-1cb2-4c9f-8e6f-901cb3fec2ce admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:44.405045 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e71caa-1cb2-4c9f-8e6f-901cb3fec2ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:44.413089 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-81e71caa-1cb2-4c9f-8e6f-901cb3fec2ce admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 03:54:44.414601 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 135/275] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:44 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:44.425249 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d6af2-cce6-4968-aff8-fd0a85a8ad90 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:44.436543 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d6af2-cce6-4968-aff8-fd0a85a8ad90 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:44.442363 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0427ab-46ad-4023-b920-75c05c10433e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:44.443802 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0427ab-46ad-4023-b920-75c05c10433e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:44.444289 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0427ab-46ad-4023-b920-75c05c10433e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:44.445571 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0427ab-46ad-4023-b920-75c05c10433e admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:44.446618 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0427ab-46ad-4023-b920-75c05c10433e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:44.447143 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0427ab-46ad-4023-b920-75c05c10433e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:44.448841 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0427ab-46ad-4023-b920-75c05c10433e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:44.461576 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 141/276] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:44 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:44.468432 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e71caa-1cb2-4c9f-8e6f-901cb3fec2ce admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:44.478610 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e71caa-1cb2-4c9f-8e6f-901cb3fec2ce admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:44.483347 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e745e-ff41-42eb-a98f-c35878b82d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:44.484421 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e745e-ff41-42eb-a98f-c35878b82d4c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:44.484875 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e745e-ff41-42eb-a98f-c35878b82d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:44.485325 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e745e-ff41-42eb-a98f-c35878b82d4c admin admin] PATH_INFO: `/v3/users/716f5254dfab4205ab85982ab7a232cd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:44.486706 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e745e-ff41-42eb-a98f-c35878b82d4c admin admin] RBAC: Authorizing `identity:get_user(user_id=716f5254dfab4205ab85982ab7a232cd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:44.489819 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e745e-ff41-42eb-a98f-c35878b82d4c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:44.491979 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 136/277] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:44 2021] GET /identity/v3/users/716f5254dfab4205ab85982ab7a232cd => generated 297 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:44.497971 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0427ab-46ad-4023-b920-75c05c10433e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:44.509045 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0427ab-46ad-4023-b920-75c05c10433e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:44.513831 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74172082-c151-4d8d-bd4b-9ab50e147d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:44.514892 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74172082-c151-4d8d-bd4b-9ab50e147d89 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:44.515513 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74172082-c151-4d8d-bd4b-9ab50e147d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:44.515981 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74172082-c151-4d8d-bd4b-9ab50e147d89 admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:44.517410 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74172082-c151-4d8d-bd4b-9ab50e147d89 admin admin] RBAC: Authorizing `identity:get_project(project_id=66d1377d6a7d40f798138de207208f9e)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:44.520315 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74172082-c151-4d8d-bd4b-9ab50e147d89 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:44.522242 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 142/278] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:44 2021] GET /identity/v3/projects/66d1377d6a7d40f798138de207208f9e => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:44.528463 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e745e-ff41-42eb-a98f-c35878b82d4c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:44.539327 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e745e-ff41-42eb-a98f-c35878b82d4c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:44.543534 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a67e8b-f0d1-4db4-b8d2-831b4446ed59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:44.544396 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a67e8b-f0d1-4db4-b8d2-831b4446ed59 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:44.544677 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a67e8b-f0d1-4db4-b8d2-831b4446ed59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:44.544944 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a67e8b-f0d1-4db4-b8d2-831b4446ed59 admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e/users/716f5254dfab4205ab85982ab7a232cd/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:44.546849 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a67e8b-f0d1-4db4-b8d2-831b4446ed59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d1377d6a7d40f798138de207208f9e, user_id=716f5254dfab4205ab85982ab7a232cd, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:44.549830 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a67e8b-f0d1-4db4-b8d2-831b4446ed59 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:44.607114 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468becf-88c1-4874-9f29-b4c500bcb8f5 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:44.607421 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468becf-88c1-4874-9f29-b4c500bcb8f5 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:44.607730 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468becf-88c1-4874-9f29-b4c500bcb8f5 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:44.609528 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 143/279] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:54:44.617016 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5f04e-5bd7-4a7f-89be-3de8855e5d5f None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:44.617313 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5f04e-5bd7-4a7f-89be-3de8855e5d5f None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:44.617594 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5f04e-5bd7-4a7f-89be-3de8855e5d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:44.637340 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-f9f5f04e-5bd7-4a7f-89be-3de8855e5d5f None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:44.638091 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 137/280] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:54:44 2021] PUT /identity/v3/projects/66d1377d6a7d40f798138de207208f9e/users/716f5254dfab4205ab85982ab7a232cd/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:54:44.638553 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-f9f5f04e-5bd7-4a7f-89be-3de8855e5d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:44.711296 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 144/281] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:44.737010 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a67e8b-f0d1-4db4-b8d2-831b4446ed59 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:44.747355 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a67e8b-f0d1-4db4-b8d2-831b4446ed59 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:44.751858 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8ce0b-c28a-4e8d-83f9-82c00dda0b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:44.752654 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8ce0b-c28a-4e8d-83f9-82c00dda0b85 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:44.752937 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8ce0b-c28a-4e8d-83f9-82c00dda0b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:44.753201 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8ce0b-c28a-4e8d-83f9-82c00dda0b85 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:44.754399 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8ce0b-c28a-4e8d-83f9-82c00dda0b85 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:44.756129 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8ce0b-c28a-4e8d-83f9-82c00dda0b85 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:44.758079 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 138/282] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:54:44 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:44.764101 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5f04e-5bd7-4a7f-89be-3de8855e5d5f None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:44.773989 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5f04e-5bd7-4a7f-89be-3de8855e5d5f None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:44.778248 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59f2f7-58be-4ec1-b24c-d5d6c069ff46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:44.778923 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59f2f7-58be-4ec1-b24c-d5d6c069ff46 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:44.779201 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59f2f7-58be-4ec1-b24c-d5d6c069ff46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:44.779497 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59f2f7-58be-4ec1-b24c-d5d6c069ff46 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:44.780264 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59f2f7-58be-4ec1-b24c-d5d6c069ff46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:44.782195 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59f2f7-58be-4ec1-b24c-d5d6c069ff46 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:44.816018 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42061103-ef2b-4cc6-9e87-630c58558f5a None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:44.816919 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42061103-ef2b-4cc6-9e87-630c58558f5a None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:44.817203 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42061103-ef2b-4cc6-9e87-630c58558f5a None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:44.819331 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 139/283] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:44 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:54:44.825737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c162f1-5f5b-4f04-ba76-f5e9a1efb898 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:44.826022 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c162f1-5f5b-4f04-ba76-f5e9a1efb898 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:44.826301 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c162f1-5f5b-4f04-ba76-f5e9a1efb898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:44.844910 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-70c162f1-5f5b-4f04-ba76-f5e9a1efb898 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:44.846495 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-70c162f1-5f5b-4f04-ba76-f5e9a1efb898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:44.855097 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 140/284] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:44.879329 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c162f1-5f5b-4f04-ba76-f5e9a1efb898 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:44.888713 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c162f1-5f5b-4f04-ba76-f5e9a1efb898 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:44.888956 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 145/285] 10.222.0.54 () {60 vars in 1153 bytes} [Tue Nov 23 03:54:44 2021] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:54:44.896413 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9697fd4-66ef-47ec-a434-2055cc869c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:44.897530 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9697fd4-66ef-47ec-a434-2055cc869c5d admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:44.897814 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9697fd4-66ef-47ec-a434-2055cc869c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:44.898211 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9697fd4-66ef-47ec-a434-2055cc869c5d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:44.910883 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9697fd4-66ef-47ec-a434-2055cc869c5d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:44.918239 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-c9697fd4-66ef-47ec-a434-2055cc869c5d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 23 03:54:44.919607 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 141/286] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:44 2021] GET /identity/v3/roles/reader => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:54:44.926017 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59f2f7-58be-4ec1-b24c-d5d6c069ff46 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:44.935874 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59f2f7-58be-4ec1-b24c-d5d6c069ff46 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:44.940179 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de241b5-a05f-4fbd-9975-0697cee62da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:44.940855 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de241b5-a05f-4fbd-9975-0697cee62da0 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:44.941684 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de241b5-a05f-4fbd-9975-0697cee62da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:44.941970 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de241b5-a05f-4fbd-9975-0697cee62da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:44.943047 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de241b5-a05f-4fbd-9975-0697cee62da0 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:44.943397 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de241b5-a05f-4fbd-9975-0697cee62da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:44.945019 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de241b5-a05f-4fbd-9975-0697cee62da0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:44.954902 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 146/287] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:44 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:44.961635 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9697fd4-66ef-47ec-a434-2055cc869c5d admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:44.971907 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9697fd4-66ef-47ec-a434-2055cc869c5d admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:44.976771 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ea52c-560c-4c9d-a9ac-f10c663725f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:44.977656 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ea52c-560c-4c9d-a9ac-f10c663725f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:44.977930 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ea52c-560c-4c9d-a9ac-f10c663725f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:44.978198 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ea52c-560c-4c9d-a9ac-f10c663725f5 admin admin] PATH_INFO: `/v3/users/cb598fcba83c4f85933984e7d57a5568` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:44.994270 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ea52c-560c-4c9d-a9ac-f10c663725f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=cb598fcba83c4f85933984e7d57a5568)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:44.996444 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ea52c-560c-4c9d-a9ac-f10c663725f5 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:44.998334 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 142/288] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:44 2021] GET /identity/v3/users/cb598fcba83c4f85933984e7d57a5568 => generated 297 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:45.004701 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de241b5-a05f-4fbd-9975-0697cee62da0 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:45.014762 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de241b5-a05f-4fbd-9975-0697cee62da0 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:45.020107 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893557d-2faf-4645-9404-39402d0cefb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:45.020948 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893557d-2faf-4645-9404-39402d0cefb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:45.021332 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893557d-2faf-4645-9404-39402d0cefb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:45.021703 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893557d-2faf-4645-9404-39402d0cefb2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:45.030489 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893557d-2faf-4645-9404-39402d0cefb2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:45.032434 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893557d-2faf-4645-9404-39402d0cefb2 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:45.042329 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 147/289] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:45 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:45.048413 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ea52c-560c-4c9d-a9ac-f10c663725f5 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:45.058588 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ea52c-560c-4c9d-a9ac-f10c663725f5 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:45.063150 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d782f-22c9-4015-9d3a-7c8928ffaa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:45.064207 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d782f-22c9-4015-9d3a-7c8928ffaa9c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:45.064568 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d782f-22c9-4015-9d3a-7c8928ffaa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:45.064940 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d782f-22c9-4015-9d3a-7c8928ffaa9c admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:45.066787 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d782f-22c9-4015-9d3a-7c8928ffaa9c admin admin] RBAC: Authorizing `identity:get_project(project_id=66d1377d6a7d40f798138de207208f9e)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:45.069539 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d782f-22c9-4015-9d3a-7c8928ffaa9c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:45.071727 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 143/290] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:45 2021] GET /identity/v3/projects/66d1377d6a7d40f798138de207208f9e => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:45.078083 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893557d-2faf-4645-9404-39402d0cefb2 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:45.088110 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893557d-2faf-4645-9404-39402d0cefb2 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:45.092545 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a886c3-8740-40a2-beb3-6106ed2ae381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:45.093358 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a886c3-8740-40a2-beb3-6106ed2ae381 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:45.093738 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a886c3-8740-40a2-beb3-6106ed2ae381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:45.094110 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a886c3-8740-40a2-beb3-6106ed2ae381 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:45.095046 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a886c3-8740-40a2-beb3-6106ed2ae381 admin admin] RBAC: Adding query filter params (role.id=328414d877bc4b1abec0f915479039cd, scope.project.id=66d1377d6a7d40f798138de207208f9e, user.id=cb598fcba83c4f85933984e7d57a5568) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:45.095482 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a886c3-8740-40a2-beb3-6106ed2ae381 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:45.097315 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a886c3-8740-40a2-beb3-6106ed2ae381 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:45.103826 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 148/291] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:54:45 2021] GET /identity/v3/role_assignments?user.id=cb598fcba83c4f85933984e7d57a5568&scope.project.id=66d1377d6a7d40f798138de207208f9e&role.id=328414d877bc4b1abec0f915479039cd => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:46.901952 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b7969-5993-4bb2-8114-9655a6779a68 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:46.902456 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b7969-5993-4bb2-8114-9655a6779a68 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:46.902530 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b7969-5993-4bb2-8114-9655a6779a68 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:46.904332 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 144/292] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:46.910757 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7a4a0-9bc5-4129-9979-b85dbbea1e9b None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:46.911180 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7a4a0-9bc5-4129-9979-b85dbbea1e9b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:46.911383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7a4a0-9bc5-4129-9979-b85dbbea1e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:46.929579 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-e1c7a4a0-9bc5-4129-9979-b85dbbea1e9b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:46.930693 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e1c7a4a0-9bc5-4129-9979-b85dbbea1e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:46.938597 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 149/293] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:46.963068 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b7969-5993-4bb2-8114-9655a6779a68 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:46.976014 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b7969-5993-4bb2-8114-9655a6779a68 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:46.980309 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96bfc7-902e-42da-8cef-5b92336efb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:46.981100 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96bfc7-902e-42da-8cef-5b92336efb0f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:46.981383 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96bfc7-902e-42da-8cef-5b92336efb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:46.981657 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96bfc7-902e-42da-8cef-5b92336efb0f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:46.992344 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96bfc7-902e-42da-8cef-5b92336efb0f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:46.999180 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-6f96bfc7-902e-42da-8cef-5b92336efb0f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 03:54:47.000388 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 145/294] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:46 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:47.006604 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7a4a0-9bc5-4129-9979-b85dbbea1e9b None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:47.015667 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7a4a0-9bc5-4129-9979-b85dbbea1e9b None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:47.020650 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15955369-3ce1-4ffa-8dfc-66aef6377c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:47.021307 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15955369-3ce1-4ffa-8dfc-66aef6377c66 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:47.021592 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15955369-3ce1-4ffa-8dfc-66aef6377c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:47.021869 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15955369-3ce1-4ffa-8dfc-66aef6377c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:47.022630 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15955369-3ce1-4ffa-8dfc-66aef6377c66 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:47.022935 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15955369-3ce1-4ffa-8dfc-66aef6377c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:47.024552 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15955369-3ce1-4ffa-8dfc-66aef6377c66 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:47.033265 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 150/295] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:47 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:47.043962 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96bfc7-902e-42da-8cef-5b92336efb0f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:47.055026 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96bfc7-902e-42da-8cef-5b92336efb0f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:47.059454 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9f51e-d0b4-44bb-8ead-cbda22f8dc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:47.060307 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9f51e-d0b4-44bb-8ead-cbda22f8dc66 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:47.060592 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9f51e-d0b4-44bb-8ead-cbda22f8dc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:47.060869 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9f51e-d0b4-44bb-8ead-cbda22f8dc66 admin admin] PATH_INFO: `/v3/users/716f5254dfab4205ab85982ab7a232cd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:47.062088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9f51e-d0b4-44bb-8ead-cbda22f8dc66 admin admin] RBAC: Authorizing `identity:get_user(user_id=716f5254dfab4205ab85982ab7a232cd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:47.064246 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9f51e-d0b4-44bb-8ead-cbda22f8dc66 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:47.066711 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 146/296] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:47 2021] GET /identity/v3/users/716f5254dfab4205ab85982ab7a232cd => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:47.073494 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15955369-3ce1-4ffa-8dfc-66aef6377c66 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:47.084038 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15955369-3ce1-4ffa-8dfc-66aef6377c66 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:47.088539 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21287349-3b29-4a2d-84a1-8d3094c007fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:47.089137 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21287349-3b29-4a2d-84a1-8d3094c007fd admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:47.089421 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21287349-3b29-4a2d-84a1-8d3094c007fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:47.089699 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21287349-3b29-4a2d-84a1-8d3094c007fd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:47.098956 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21287349-3b29-4a2d-84a1-8d3094c007fd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:47.100764 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21287349-3b29-4a2d-84a1-8d3094c007fd admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:47.109930 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 151/297] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:47 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:47.116989 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9f51e-d0b4-44bb-8ead-cbda22f8dc66 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:47.128048 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9f51e-d0b4-44bb-8ead-cbda22f8dc66 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:47.133937 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaecd0a-6707-4a96-ae0c-d8cf365b2107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:47.134851 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaecd0a-6707-4a96-ae0c-d8cf365b2107 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:47.135138 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaecd0a-6707-4a96-ae0c-d8cf365b2107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:47.135453 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaecd0a-6707-4a96-ae0c-d8cf365b2107 admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:47.136808 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaecd0a-6707-4a96-ae0c-d8cf365b2107 admin admin] RBAC: Authorizing `identity:get_project(project_id=66d1377d6a7d40f798138de207208f9e)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:47.139093 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaecd0a-6707-4a96-ae0c-d8cf365b2107 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:47.141242 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 147/298] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:47 2021] GET /identity/v3/projects/66d1377d6a7d40f798138de207208f9e => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:47.148454 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21287349-3b29-4a2d-84a1-8d3094c007fd admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:47.158310 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21287349-3b29-4a2d-84a1-8d3094c007fd admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:47.163700 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41134856-75ff-4586-8392-a8e9eb490162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:47.164376 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41134856-75ff-4586-8392-a8e9eb490162 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:47.164660 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41134856-75ff-4586-8392-a8e9eb490162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:47.164936 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41134856-75ff-4586-8392-a8e9eb490162 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:47.165794 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41134856-75ff-4586-8392-a8e9eb490162 admin admin] RBAC: Adding query filter params (role.id=c817e9fe7d034dd4ac25b1f45fd209c7, scope.project.id=66d1377d6a7d40f798138de207208f9e, user.id=716f5254dfab4205ab85982ab7a232cd) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:47.166104 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41134856-75ff-4586-8392-a8e9eb490162 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:47.168181 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41134856-75ff-4586-8392-a8e9eb490162 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:47.179382 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 152/299] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:54:47 2021] GET /identity/v3/role_assignments?user.id=716f5254dfab4205ab85982ab7a232cd&scope.project.id=66d1377d6a7d40f798138de207208f9e&role.id=c817e9fe7d034dd4ac25b1f45fd209c7 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:47.322280 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc581d-a323-403e-8203-521a11473cb6 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:47.322655 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc581d-a323-403e-8203-521a11473cb6 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:47.322844 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc581d-a323-403e-8203-521a11473cb6 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:47.324718 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 148/300] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:47.331051 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57588edf-1be6-44e2-97a8-c5619b6f7a02 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:47.331597 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57588edf-1be6-44e2-97a8-c5619b6f7a02 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:47.332741 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57588edf-1be6-44e2-97a8-c5619b6f7a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:47.336593 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d997f2-a115-4977-adc9-fe69b3dcf4a3 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:47.337096 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d997f2-a115-4977-adc9-fe69b3dcf4a3 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:47.337516 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d997f2-a115-4977-adc9-fe69b3dcf4a3 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:47.340145 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 149/301] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:47.346682 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb13f0-d622-4757-ab1a-058a56d0db21 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:47.346973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb13f0-d622-4757-ab1a-058a56d0db21 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:47.347822 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb13f0-d622-4757-ab1a-058a56d0db21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:47.359488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-57588edf-1be6-44e2-97a8-c5619b6f7a02 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:47.360934 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-57588edf-1be6-44e2-97a8-c5619b6f7a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:47.368575 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-13bb13f0-d622-4757-ab1a-058a56d0db21 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:47.369810 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-13bb13f0-d622-4757-ab1a-058a56d0db21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:47.369967 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 153/302] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:47.381492 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 150/303] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:47.396350 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57588edf-1be6-44e2-97a8-c5619b6f7a02 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:47.405387 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57588edf-1be6-44e2-97a8-c5619b6f7a02 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:47.409832 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4451853-756c-4fbd-b7d3-b930bbac4ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:47.411068 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4451853-756c-4fbd-b7d3-b930bbac4ece admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:47.411444 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4451853-756c-4fbd-b7d3-b930bbac4ece admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:47.411724 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4451853-756c-4fbd-b7d3-b930bbac4ece admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:47.411825 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb13f0-d622-4757-ab1a-058a56d0db21 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:47.420903 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb13f0-d622-4757-ab1a-058a56d0db21 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:47.427392 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20492f95-13c4-4978-be46-cc3bc33cfc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:47.428530 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20492f95-13c4-4978-be46-cc3bc33cfc10 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:47.428700 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4451853-756c-4fbd-b7d3-b930bbac4ece admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:47.428796 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20492f95-13c4-4978-be46-cc3bc33cfc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:47.429081 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20492f95-13c4-4978-be46-cc3bc33cfc10 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:47.430315 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20492f95-13c4-4978-be46-cc3bc33cfc10 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:47.432045 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20492f95-13c4-4978-be46-cc3bc33cfc10 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:47.434096 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 151/304] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:54:47 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:47.440407 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20492f95-13c4-4978-be46-cc3bc33cfc10 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:47.441551 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-a4451853-756c-4fbd-b7d3-b930bbac4ece admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 03:54:47.443496 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 154/305] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:47 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:47.449768 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4451853-756c-4fbd-b7d3-b930bbac4ece admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:47.452528 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20492f95-13c4-4978-be46-cc3bc33cfc10 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:47.457774 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63526dc8-eef5-466f-ab98-c32b50a1a55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:47.458443 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63526dc8-eef5-466f-ab98-c32b50a1a55b admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:47.459185 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63526dc8-eef5-466f-ab98-c32b50a1a55b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:47.459185 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63526dc8-eef5-466f-ab98-c32b50a1a55b admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:47.459822 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63526dc8-eef5-466f-ab98-c32b50a1a55b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:47.461733 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63526dc8-eef5-466f-ab98-c32b50a1a55b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:47.462848 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4451853-756c-4fbd-b7d3-b930bbac4ece admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:47.467186 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86599c-828d-4e1c-ac4c-ec1d49dfbb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:47.467983 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86599c-828d-4e1c-ac4c-ec1d49dfbb80 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:47.468362 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86599c-828d-4e1c-ac4c-ec1d49dfbb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:47.468737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86599c-828d-4e1c-ac4c-ec1d49dfbb80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:47.469595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86599c-828d-4e1c-ac4c-ec1d49dfbb80 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:47.470001 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86599c-828d-4e1c-ac4c-ec1d49dfbb80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:47.471687 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86599c-828d-4e1c-ac4c-ec1d49dfbb80 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:47.484751 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 155/306] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:47 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:47.486148 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4f153-7017-4b4d-912f-5046517d4bf8 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:47.489008 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4f153-7017-4b4d-912f-5046517d4bf8 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:47.489008 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4f153-7017-4b4d-912f-5046517d4bf8 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:47.489551 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 156/307] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:47.491834 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4f153-7017-4b4d-912f-5046517d4bf8 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:47.505685 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4f153-7017-4b4d-912f-5046517d4bf8 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:47.509939 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28464ec5-fdfb-4daa-aebd-0b030837ac02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:47.510796 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28464ec5-fdfb-4daa-aebd-0b030837ac02 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:47.511152 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28464ec5-fdfb-4daa-aebd-0b030837ac02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:47.511489 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28464ec5-fdfb-4daa-aebd-0b030837ac02 admin admin] PATH_INFO: `/v3/users/081cfb0787d248fd8a26dc66e0eec8ab` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:47.525058 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28464ec5-fdfb-4daa-aebd-0b030837ac02 admin admin] RBAC: Authorizing `identity:get_user(user_id=081cfb0787d248fd8a26dc66e0eec8ab)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:47.527270 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28464ec5-fdfb-4daa-aebd-0b030837ac02 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:47.528882 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 157/308] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:47 2021] GET /identity/v3/users/081cfb0787d248fd8a26dc66e0eec8ab => generated 293 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:47.530015 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ac5fb-0e8e-43e5-a043-1837dd4ae5cf None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:47.530341 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ac5fb-0e8e-43e5-a043-1837dd4ae5cf None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:47.530640 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ac5fb-0e8e-43e5-a043-1837dd4ae5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:47.547460 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-501ac5fb-0e8e-43e5-a043-1837dd4ae5cf None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:47.548626 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-501ac5fb-0e8e-43e5-a043-1837dd4ae5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:47.556583 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 158/309] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:47.557332 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ac5fb-0e8e-43e5-a043-1837dd4ae5cf None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:47.565768 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ac5fb-0e8e-43e5-a043-1837dd4ae5cf None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:47.571255 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72563c7f-eb1d-414e-8476-df35c17092ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:47.571869 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72563c7f-eb1d-414e-8476-df35c17092ba admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:47.572148 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72563c7f-eb1d-414e-8476-df35c17092ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:47.572475 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72563c7f-eb1d-414e-8476-df35c17092ba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:47.573248 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72563c7f-eb1d-414e-8476-df35c17092ba admin admin] RBAC: Adding query filter params (role.id=c817e9fe7d034dd4ac25b1f45fd209c7, user.id=081cfb0787d248fd8a26dc66e0eec8ab, scope.system=all) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:47.573574 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72563c7f-eb1d-414e-8476-df35c17092ba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:47.574782 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 152/310] 10.222.0.54 () {60 vars in 1153 bytes} [Tue Nov 23 03:54:47 2021] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 03:54:47.576229 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72563c7f-eb1d-414e-8476-df35c17092ba admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:47.581802 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63526dc8-eef5-466f-ab98-c32b50a1a55b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:47.585320 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 159/311] 10.222.0.54 () {56 vars in 1329 bytes} [Tue Nov 23 03:54:47 2021] GET /identity/v3/role_assignments?user.id=081cfb0787d248fd8a26dc66e0eec8ab&scope.system=all&role.id=c817e9fe7d034dd4ac25b1f45fd209c7 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:47.597416 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63526dc8-eef5-466f-ab98-c32b50a1a55b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:47.603538 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ebe6b-8368-42af-a06c-af03465bcee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:47.604795 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ebe6b-8368-42af-a06c-af03465bcee2 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:47.605302 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ebe6b-8368-42af-a06c-af03465bcee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:47.605847 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ebe6b-8368-42af-a06c-af03465bcee2 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:47.619347 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ebe6b-8368-42af-a06c-af03465bcee2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:47.626978 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-8e7ebe6b-8368-42af-a06c-af03465bcee2 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 23 03:54:47.629711 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 153/312] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:47 2021] GET /identity/v3/roles/reader => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:54:47.636237 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72563c7f-eb1d-414e-8476-df35c17092ba admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:47.646798 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72563c7f-eb1d-414e-8476-df35c17092ba admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:47.651445 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18f3b6-8b23-493e-ab4e-c7829e112fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:47.652141 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18f3b6-8b23-493e-ab4e-c7829e112fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:47.652430 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18f3b6-8b23-493e-ab4e-c7829e112fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:47.652704 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18f3b6-8b23-493e-ab4e-c7829e112fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:47.653612 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18f3b6-8b23-493e-ab4e-c7829e112fa3 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:47.653930 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18f3b6-8b23-493e-ab4e-c7829e112fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:47.655678 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18f3b6-8b23-493e-ab4e-c7829e112fa3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:47.667287 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 160/313] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:47 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:47.673683 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ebe6b-8368-42af-a06c-af03465bcee2 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:47.685394 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ebe6b-8368-42af-a06c-af03465bcee2 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:47.689877 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8164858-611b-4b8f-a5df-b20166d9b38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:47.690769 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8164858-611b-4b8f-a5df-b20166d9b38c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:47.691765 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8164858-611b-4b8f-a5df-b20166d9b38c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:47.692266 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8164858-611b-4b8f-a5df-b20166d9b38c admin admin] PATH_INFO: `/v3/users/cb598fcba83c4f85933984e7d57a5568` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:47.694091 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8164858-611b-4b8f-a5df-b20166d9b38c admin admin] RBAC: Authorizing `identity:get_user(user_id=cb598fcba83c4f85933984e7d57a5568)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:47.696312 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8164858-611b-4b8f-a5df-b20166d9b38c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:47.698291 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 154/314] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:47 2021] GET /identity/v3/users/cb598fcba83c4f85933984e7d57a5568 => generated 297 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:47.704525 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18f3b6-8b23-493e-ab4e-c7829e112fa3 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:47.714992 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18f3b6-8b23-493e-ab4e-c7829e112fa3 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:47.719578 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308be1f-685f-462c-ae71-28050544e28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:47.720471 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308be1f-685f-462c-ae71-28050544e28f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:47.720758 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308be1f-685f-462c-ae71-28050544e28f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:47.721035 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308be1f-685f-462c-ae71-28050544e28f admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:47.722344 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308be1f-685f-462c-ae71-28050544e28f admin admin] RBAC: Authorizing `identity:get_project(project_id=66d1377d6a7d40f798138de207208f9e)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:47.724535 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308be1f-685f-462c-ae71-28050544e28f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:47.726579 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 161/315] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:47 2021] GET /identity/v3/projects/66d1377d6a7d40f798138de207208f9e => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:47.733099 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8164858-611b-4b8f-a5df-b20166d9b38c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:47.744716 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8164858-611b-4b8f-a5df-b20166d9b38c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:47.749331 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b50921-6f49-4dd7-91de-6c79a8c110f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:47.750251 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b50921-6f49-4dd7-91de-6c79a8c110f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:47.750533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b50921-6f49-4dd7-91de-6c79a8c110f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:47.750804 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b50921-6f49-4dd7-91de-6c79a8c110f6 admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e/users/cb598fcba83c4f85933984e7d57a5568/roles/328414d877bc4b1abec0f915479039cd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:47.752989 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b50921-6f49-4dd7-91de-6c79a8c110f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d1377d6a7d40f798138de207208f9e, user_id=cb598fcba83c4f85933984e7d57a5568, role_id=328414d877bc4b1abec0f915479039cd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:47.756601 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b50921-6f49-4dd7-91de-6c79a8c110f6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:47.838072 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 155/316] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:54:47 2021] PUT /identity/v3/projects/66d1377d6a7d40f798138de207208f9e/users/cb598fcba83c4f85933984e7d57a5568/roles/328414d877bc4b1abec0f915479039cd => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:54:49.900601 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6fc26-69a1-4f94-bb0b-2cec50500a21 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:49.901140 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6fc26-69a1-4f94-bb0b-2cec50500a21 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:49.901140 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6fc26-69a1-4f94-bb0b-2cec50500a21 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:49.903233 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 162/317] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:49.908775 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10971202-d7c2-4d35-aa40-02adc6031186 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:49.909184 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10971202-d7c2-4d35-aa40-02adc6031186 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:49.909346 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10971202-d7c2-4d35-aa40-02adc6031186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:49.929065 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-10971202-d7c2-4d35-aa40-02adc6031186 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:49.930357 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-10971202-d7c2-4d35-aa40-02adc6031186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:49.991007 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 156/318] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:50.014478 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6fc26-69a1-4f94-bb0b-2cec50500a21 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:50.027023 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6fc26-69a1-4f94-bb0b-2cec50500a21 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:50.031414 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe604b0a-bcb1-40cf-94e9-19127692cf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:50.032220 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe604b0a-bcb1-40cf-94e9-19127692cf15 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:50.032504 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe604b0a-bcb1-40cf-94e9-19127692cf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:50.032781 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe604b0a-bcb1-40cf-94e9-19127692cf15 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:50.045388 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe604b0a-bcb1-40cf-94e9-19127692cf15 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:50.053133 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-fe604b0a-bcb1-40cf-94e9-19127692cf15 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 03:54:50.056099 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14b0a4-d3f1-4fb3-9303-4623a2508a2c None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:50.056375 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14b0a4-d3f1-4fb3-9303-4623a2508a2c None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:50.056656 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14b0a4-d3f1-4fb3-9303-4623a2508a2c None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:50.058703 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 157/319] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:50.058826 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 163/320] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:50 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:50.062483 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14b0a4-d3f1-4fb3-9303-4623a2508a2c None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:50.065684 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f916b7-8d1e-45ce-8eb5-d5bc721b10f7 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:50.066044 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f916b7-8d1e-45ce-8eb5-d5bc721b10f7 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:50.066336 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f916b7-8d1e-45ce-8eb5-d5bc721b10f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:50.078364 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14b0a4-d3f1-4fb3-9303-4623a2508a2c None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:50.084813 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e2db7-1c67-4e7e-8861-d6c36c1d5131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:50.085707 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e2db7-1c67-4e7e-8861-d6c36c1d5131 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:50.086157 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e2db7-1c67-4e7e-8861-d6c36c1d5131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:50.091308 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e2db7-1c67-4e7e-8861-d6c36c1d5131 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:50.091308 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e2db7-1c67-4e7e-8861-d6c36c1d5131 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:50.091308 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e2db7-1c67-4e7e-8861-d6c36c1d5131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:50.091519 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-77f916b7-8d1e-45ce-8eb5-d5bc721b10f7 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:50.091519 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-77f916b7-8d1e-45ce-8eb5-d5bc721b10f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:50.091656 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e2db7-1c67-4e7e-8861-d6c36c1d5131 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:50.098202 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 164/321] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:50.099912 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 158/322] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:50 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:50.109411 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f916b7-8d1e-45ce-8eb5-d5bc721b10f7 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:50.120093 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6b51a-1134-4a65-901c-e319cb35b65a None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:50.120253 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f916b7-8d1e-45ce-8eb5-d5bc721b10f7 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:50.120745 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6b51a-1134-4a65-901c-e319cb35b65a None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:50.121261 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6b51a-1134-4a65-901c-e319cb35b65a None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:50.123488 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 159/323] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:50.124363 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6b51a-1134-4a65-901c-e319cb35b65a None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:50.129723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb54fd8-5985-44c1-acf4-4ed44eb30ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:50.130595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb54fd8-5985-44c1-acf4-4ed44eb30ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:50.130876 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb54fd8-5985-44c1-acf4-4ed44eb30ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:50.131147 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb54fd8-5985-44c1-acf4-4ed44eb30ad9 admin admin] PATH_INFO: `/v3/users/081cfb0787d248fd8a26dc66e0eec8ab` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:50.132569 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb54fd8-5985-44c1-acf4-4ed44eb30ad9 admin admin] RBAC: Authorizing `identity:get_user(user_id=081cfb0787d248fd8a26dc66e0eec8ab)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:50.134698 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb54fd8-5985-44c1-acf4-4ed44eb30ad9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:50.136501 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 165/324] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:50 2021] GET /identity/v3/users/081cfb0787d248fd8a26dc66e0eec8ab => generated 293 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:50.137721 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ef56a-fee2-4b25-8905-1b757a61bf7c None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:50.138005 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ef56a-fee2-4b25-8905-1b757a61bf7c None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:50.138278 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ef56a-fee2-4b25-8905-1b757a61bf7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:50.140138 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6b51a-1134-4a65-901c-e319cb35b65a None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:50.146460 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f11517-5c94-4155-9971-eedecdf9877f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:50.147274 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f11517-5c94-4155-9971-eedecdf9877f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:50.147566 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f11517-5c94-4155-9971-eedecdf9877f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:50.147846 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f11517-5c94-4155-9971-eedecdf9877f admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:50.155655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-129ef56a-fee2-4b25-8905-1b757a61bf7c None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:50.156816 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-129ef56a-fee2-4b25-8905-1b757a61bf7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:50.158502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f11517-5c94-4155-9971-eedecdf9877f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:50.165300 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 166/325] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:50.166709 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-d1f11517-5c94-4155-9971-eedecdf9877f admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 23 03:54:50.167951 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 160/326] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:50 2021] GET /identity/v3/roles/reader => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:50.168329 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ef56a-fee2-4b25-8905-1b757a61bf7c None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:50.174000 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f11517-5c94-4155-9971-eedecdf9877f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:50.179446 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ef56a-fee2-4b25-8905-1b757a61bf7c None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:50.185165 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d53cc-1211-4bb0-b6bb-96014b13741b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:50.185555 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f11517-5c94-4155-9971-eedecdf9877f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:50.187233 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d53cc-1211-4bb0-b6bb-96014b13741b admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:50.187790 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d53cc-1211-4bb0-b6bb-96014b13741b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:50.188379 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d53cc-1211-4bb0-b6bb-96014b13741b admin admin] PATH_INFO: `/v3/system/users/081cfb0787d248fd8a26dc66e0eec8ab/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:50.190090 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d53cc-1211-4bb0-b6bb-96014b13741b admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=081cfb0787d248fd8a26dc66e0eec8ab, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:50.190510 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84e76c-31b9-4481-a4c6-f56bed062b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:50.191357 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING py.warnings [None req-629d53cc-1211-4bb0-b6bb-96014b13741b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_system_grant_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:54:50.191357 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: warnings.warn(msg) Nov 23 03:54:50.191357 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: Nov 23 03:54:50.192036 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84e76c-31b9-4481-a4c6-f56bed062b38 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:50.192036 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84e76c-31b9-4481-a4c6-f56bed062b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:50.192393 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d53cc-1211-4bb0-b6bb-96014b13741b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:50.192813 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84e76c-31b9-4481-a4c6-f56bed062b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:50.193938 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84e76c-31b9-4481-a4c6-f56bed062b38 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:50.194407 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84e76c-31b9-4481-a4c6-f56bed062b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:50.196207 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84e76c-31b9-4481-a4c6-f56bed062b38 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:50.205273 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 161/327] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:50 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:50.206176 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84e76c-31b9-4481-a4c6-f56bed062b38 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:50.215754 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84e76c-31b9-4481-a4c6-f56bed062b38 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:50.220730 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d508039-f092-4b47-a11b-8a4c1f46ec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:50.221579 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d508039-f092-4b47-a11b-8a4c1f46ec6e admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:50.221967 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d508039-f092-4b47-a11b-8a4c1f46ec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:50.222874 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d508039-f092-4b47-a11b-8a4c1f46ec6e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:50.224549 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d508039-f092-4b47-a11b-8a4c1f46ec6e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:50.226698 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d508039-f092-4b47-a11b-8a4c1f46ec6e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:50.228891 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 162/328] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:54:50 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:50.229711 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d508039-f092-4b47-a11b-8a4c1f46ec6e admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:50.239802 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d508039-f092-4b47-a11b-8a4c1f46ec6e admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:50.244164 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f841af7-e904-46e6-9e89-b13961e1d041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:50.244948 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841af7-e904-46e6-9e89-b13961e1d041 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:50.245225 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841af7-e904-46e6-9e89-b13961e1d041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:50.245493 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841af7-e904-46e6-9e89-b13961e1d041 admin admin] PATH_INFO: `/v3/users/7a33b7bcb09542f1a6402a6a0cb69823` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:50.258492 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f841af7-e904-46e6-9e89-b13961e1d041 admin admin] RBAC: Authorizing `identity:get_user(user_id=7a33b7bcb09542f1a6402a6a0cb69823)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:50.260702 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f841af7-e904-46e6-9e89-b13961e1d041 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:50.262265 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 163/329] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:50 2021] GET /identity/v3/users/7a33b7bcb09542f1a6402a6a0cb69823 => generated 293 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:50.263441 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a35ee4-dbdd-44cb-9638-8dc602f144e3 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:50.263720 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a35ee4-dbdd-44cb-9638-8dc602f144e3 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:50.263997 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a35ee4-dbdd-44cb-9638-8dc602f144e3 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:50.265679 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 164/330] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:50.266354 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a35ee4-dbdd-44cb-9638-8dc602f144e3 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:50.278253 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a35ee4-dbdd-44cb-9638-8dc602f144e3 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:50.282348 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71178167-e5ec-4825-b4f5-5e3cac60afda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:50.282919 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71178167-e5ec-4825-b4f5-5e3cac60afda admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:50.283196 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71178167-e5ec-4825-b4f5-5e3cac60afda admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:50.283521 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71178167-e5ec-4825-b4f5-5e3cac60afda admin admin] PATH_INFO: `/v3/groups` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:50.284189 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71178167-e5ec-4825-b4f5-5e3cac60afda admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:50.285770 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING py.warnings [None req-71178167-e5ec-4825-b4f5-5e3cac60afda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:54:50.285770 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: warnings.warn(msg) Nov 23 03:54:50.285770 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: Nov 23 03:54:50.286924 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71178167-e5ec-4825-b4f5-5e3cac60afda admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:50.288950 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 167/331] 10.222.0.54 () {58 vars in 1355 bytes} [Tue Nov 23 03:54:50 2021] PUT /identity/v3/system/users/081cfb0787d248fd8a26dc66e0eec8ab/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:54:50.290844 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d53cc-1211-4bb0-b6bb-96014b13741b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:50.301455 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d53cc-1211-4bb0-b6bb-96014b13741b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:50.306772 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c74f63-8799-44e2-aa92-8fb0cbb10157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:50.307488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c74f63-8799-44e2-aa92-8fb0cbb10157 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:50.307815 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c74f63-8799-44e2-aa92-8fb0cbb10157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:50.308076 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c74f63-8799-44e2-aa92-8fb0cbb10157 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:50.308932 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c74f63-8799-44e2-aa92-8fb0cbb10157 admin admin] RBAC: Adding query filter params (role.id=328414d877bc4b1abec0f915479039cd, user.id=7a33b7bcb09542f1a6402a6a0cb69823, scope.system=all) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:50.309381 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c74f63-8799-44e2-aa92-8fb0cbb10157 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:50.311294 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c74f63-8799-44e2-aa92-8fb0cbb10157 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:50.317285 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 168/332] 10.222.0.54 () {56 vars in 1329 bytes} [Tue Nov 23 03:54:50 2021] GET /identity/v3/role_assignments?user.id=7a33b7bcb09542f1a6402a6a0cb69823&scope.system=all&role.id=328414d877bc4b1abec0f915479039cd => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:50.318701 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21318ef0-767e-4163-8ae1-a7394d2c3f6f None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:50.318980 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21318ef0-767e-4163-8ae1-a7394d2c3f6f None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:50.319283 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21318ef0-767e-4163-8ae1-a7394d2c3f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:50.339881 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-21318ef0-767e-4163-8ae1-a7394d2c3f6f None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:50.341236 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-21318ef0-767e-4163-8ae1-a7394d2c3f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:50.350122 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 169/333] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:50.371495 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 165/334] 10.222.0.54 () {60 vars in 1155 bytes} [Tue Nov 23 03:54:50 2021] POST /identity/v3/groups => generated 229 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:54:50.378821 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21318ef0-767e-4163-8ae1-a7394d2c3f6f None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:50.386762 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21318ef0-767e-4163-8ae1-a7394d2c3f6f None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:50.392054 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6684d22-68b5-4797-aa1f-7b2ababf460b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:50.392888 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6684d22-68b5-4797-aa1f-7b2ababf460b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:50.393174 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6684d22-68b5-4797-aa1f-7b2ababf460b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:50.393453 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6684d22-68b5-4797-aa1f-7b2ababf460b admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:50.407740 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6684d22-68b5-4797-aa1f-7b2ababf460b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:50.415961 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-a6684d22-68b5-4797-aa1f-7b2ababf460b admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 23 03:54:50.417244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 170/335] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:50 2021] GET /identity/v3/roles/reader => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:50.424622 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71178167-e5ec-4825-b4f5-5e3cac60afda admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:50.437451 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71178167-e5ec-4825-b4f5-5e3cac60afda admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:50.443458 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c23b2-3ff9-45d0-b9f3-284d9b863e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:50.444565 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c23b2-3ff9-45d0-b9f3-284d9b863e72 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:50.445044 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c23b2-3ff9-45d0-b9f3-284d9b863e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:50.445504 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c23b2-3ff9-45d0-b9f3-284d9b863e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:50.446545 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c23b2-3ff9-45d0-b9f3-284d9b863e72 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:50.447138 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c23b2-3ff9-45d0-b9f3-284d9b863e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:50.449355 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c23b2-3ff9-45d0-b9f3-284d9b863e72 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:50.462121 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 166/336] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:50 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:50.469208 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6684d22-68b5-4797-aa1f-7b2ababf460b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:50.481883 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6684d22-68b5-4797-aa1f-7b2ababf460b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:50.487306 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8648ecd-d284-49a9-a461-fab21c500912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:50.489253 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8648ecd-d284-49a9-a461-fab21c500912 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:50.489723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8648ecd-d284-49a9-a461-fab21c500912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:50.490366 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8648ecd-d284-49a9-a461-fab21c500912 admin admin] PATH_INFO: `/v3/users/cb598fcba83c4f85933984e7d57a5568` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:50.492401 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8648ecd-d284-49a9-a461-fab21c500912 admin admin] RBAC: Authorizing `identity:get_user(user_id=cb598fcba83c4f85933984e7d57a5568)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:50.495202 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8648ecd-d284-49a9-a461-fab21c500912 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:50.497663 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 171/337] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:50 2021] GET /identity/v3/users/cb598fcba83c4f85933984e7d57a5568 => generated 297 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:50.504784 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c23b2-3ff9-45d0-b9f3-284d9b863e72 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:50.516939 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c23b2-3ff9-45d0-b9f3-284d9b863e72 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:50.523107 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e0c3c-e5fc-44d6-ac12-8bab7e39e9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:50.524191 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e0c3c-e5fc-44d6-ac12-8bab7e39e9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:50.524748 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e0c3c-e5fc-44d6-ac12-8bab7e39e9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:50.525205 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e0c3c-e5fc-44d6-ac12-8bab7e39e9c2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:50.536175 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e0c3c-e5fc-44d6-ac12-8bab7e39e9c2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:50.538381 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e0c3c-e5fc-44d6-ac12-8bab7e39e9c2 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:50.551917 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 167/338] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:50.558463 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8648ecd-d284-49a9-a461-fab21c500912 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:50.571360 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8648ecd-d284-49a9-a461-fab21c500912 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:50.576022 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72185fae-ce94-4f95-b492-065a592d9db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:50.576891 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72185fae-ce94-4f95-b492-065a592d9db0 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:50.577179 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72185fae-ce94-4f95-b492-065a592d9db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:50.577460 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72185fae-ce94-4f95-b492-065a592d9db0 admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:50.578721 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72185fae-ce94-4f95-b492-065a592d9db0 admin admin] RBAC: Authorizing `identity:get_project(project_id=66d1377d6a7d40f798138de207208f9e)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:50.580845 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72185fae-ce94-4f95-b492-065a592d9db0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:50.583679 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 172/339] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:50 2021] GET /identity/v3/projects/66d1377d6a7d40f798138de207208f9e => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:50.589981 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e0c3c-e5fc-44d6-ac12-8bab7e39e9c2 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:50.603664 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e0c3c-e5fc-44d6-ac12-8bab7e39e9c2 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:50.608353 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eeaf0d-1392-4a9d-b0f2-d09257807ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:50.609119 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eeaf0d-1392-4a9d-b0f2-d09257807ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:50.609411 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eeaf0d-1392-4a9d-b0f2-d09257807ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:50.609689 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eeaf0d-1392-4a9d-b0f2-d09257807ee7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:50.610607 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eeaf0d-1392-4a9d-b0f2-d09257807ee7 admin admin] RBAC: Adding query filter params (role.id=328414d877bc4b1abec0f915479039cd, scope.project.id=66d1377d6a7d40f798138de207208f9e, user.id=cb598fcba83c4f85933984e7d57a5568) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:50.610925 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eeaf0d-1392-4a9d-b0f2-d09257807ee7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:50.613638 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eeaf0d-1392-4a9d-b0f2-d09257807ee7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:50.620554 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 168/340] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:54:50 2021] GET /identity/v3/role_assignments?user.id=cb598fcba83c4f85933984e7d57a5568&scope.project.id=66d1377d6a7d40f798138de207208f9e&role.id=328414d877bc4b1abec0f915479039cd => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:52.638240 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22826b27-d817-45a6-a716-eebe7f06a52a None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:52.638778 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22826b27-d817-45a6-a716-eebe7f06a52a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:52.638778 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22826b27-d817-45a6-a716-eebe7f06a52a None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:52.640813 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 173/341] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:52.642626 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6289388-bcf2-45bf-8c3d-49d454ab08fd None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:52.642995 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6289388-bcf2-45bf-8c3d-49d454ab08fd None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:52.643192 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6289388-bcf2-45bf-8c3d-49d454ab08fd None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:52.646488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a704e5-c663-4e6b-8c8c-1d711d714865 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:52.646773 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a704e5-c663-4e6b-8c8c-1d711d714865 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:52.647047 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a704e5-c663-4e6b-8c8c-1d711d714865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:52.647468 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 169/342] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:52 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:52.651186 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019895b1-842a-4df9-996f-4b5599119aa7 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:52.651682 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019895b1-842a-4df9-996f-4b5599119aa7 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:52.652002 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019895b1-842a-4df9-996f-4b5599119aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:52.666974 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-c7a704e5-c663-4e6b-8c8c-1d711d714865 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:52.668627 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-c7a704e5-c663-4e6b-8c8c-1d711d714865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:52.670569 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-019895b1-842a-4df9-996f-4b5599119aa7 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:52.671963 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-019895b1-842a-4df9-996f-4b5599119aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:52.683189 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 174/343] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:52.687250 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 170/344] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:52.702398 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a704e5-c663-4e6b-8c8c-1d711d714865 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:52.711862 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019895b1-842a-4df9-996f-4b5599119aa7 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:52.712214 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a704e5-c663-4e6b-8c8c-1d711d714865 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:52.716632 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85b465-c164-462c-859f-97806e6cc6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:52.717419 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85b465-c164-462c-859f-97806e6cc6fd admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:52.717699 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85b465-c164-462c-859f-97806e6cc6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:52.717977 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85b465-c164-462c-859f-97806e6cc6fd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:52.721859 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019895b1-842a-4df9-996f-4b5599119aa7 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:52.727574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737c9b9-0344-4648-addc-ecf47ee8388f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:52.728623 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737c9b9-0344-4648-addc-ecf47ee8388f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:52.728904 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737c9b9-0344-4648-addc-ecf47ee8388f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:52.729006 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85b465-c164-462c-859f-97806e6cc6fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:52.729180 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737c9b9-0344-4648-addc-ecf47ee8388f admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:52.735772 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-4f85b465-c164-462c-859f-97806e6cc6fd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 03:54:52.736957 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 175/345] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:52 2021] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:54:52.739033 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5def093-07db-4e65-b004-edbdae9c846f None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:52.739351 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5def093-07db-4e65-b004-edbdae9c846f None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:52.739634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5def093-07db-4e65-b004-edbdae9c846f None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:52.740552 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737c9b9-0344-4648-addc-ecf47ee8388f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:52.741326 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 176/346] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:54:52.743007 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5def093-07db-4e65-b004-edbdae9c846f None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:52.748216 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-d737c9b9-0344-4648-addc-ecf47ee8388f admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 23 03:54:52.749404 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 171/347] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:52 2021] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:54:52.750666 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c7bf5-204e-4080-9ae7-3d096e332ee3 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:52.750953 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c7bf5-204e-4080-9ae7-3d096e332ee3 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:52.751239 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c7bf5-204e-4080-9ae7-3d096e332ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:52.756462 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5def093-07db-4e65-b004-edbdae9c846f None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:52.760637 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0deed-d2b0-463c-90bf-4c1074e50832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:52.761263 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0deed-d2b0-463c-90bf-4c1074e50832 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:52.761544 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0deed-d2b0-463c-90bf-4c1074e50832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:52.761819 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0deed-d2b0-463c-90bf-4c1074e50832 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:52.762562 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0deed-d2b0-463c-90bf-4c1074e50832 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:52.762865 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0deed-d2b0-463c-90bf-4c1074e50832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:52.764481 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0deed-d2b0-463c-90bf-4c1074e50832 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:52.768358 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-467c7bf5-204e-4080-9ae7-3d096e332ee3 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:52.770056 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-467c7bf5-204e-4080-9ae7-3d096e332ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:52.773807 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 177/348] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:52 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:52.774527 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0deed-d2b0-463c-90bf-4c1074e50832 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:52.777658 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 172/349] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:52.779656 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c7bf5-204e-4080-9ae7-3d096e332ee3 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:52.783556 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0deed-d2b0-463c-90bf-4c1074e50832 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:52.788548 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f04f74-1700-4fa6-b266-0c00a5a3e539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:52.789182 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f04f74-1700-4fa6-b266-0c00a5a3e539 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:52.789464 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f04f74-1700-4fa6-b266-0c00a5a3e539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:52.789569 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c7bf5-204e-4080-9ae7-3d096e332ee3 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:52.789738 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f04f74-1700-4fa6-b266-0c00a5a3e539 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:52.790478 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f04f74-1700-4fa6-b266-0c00a5a3e539 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:52.790777 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f04f74-1700-4fa6-b266-0c00a5a3e539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:52.792347 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f04f74-1700-4fa6-b266-0c00a5a3e539 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:52.793890 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5a086-b49d-4311-a407-5cf9e07a0c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:52.794720 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5a086-b49d-4311-a407-5cf9e07a0c7b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:52.794999 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5a086-b49d-4311-a407-5cf9e07a0c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:52.795296 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5a086-b49d-4311-a407-5cf9e07a0c7b admin admin] PATH_INFO: `/v3/users/081cfb0787d248fd8a26dc66e0eec8ab` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:52.796481 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5a086-b49d-4311-a407-5cf9e07a0c7b admin admin] RBAC: Authorizing `identity:get_user(user_id=081cfb0787d248fd8a26dc66e0eec8ab)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:52.798560 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5a086-b49d-4311-a407-5cf9e07a0c7b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:52.800345 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 173/350] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:52 2021] GET /identity/v3/users/081cfb0787d248fd8a26dc66e0eec8ab => generated 293 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:52.801559 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5a086-b49d-4311-a407-5cf9e07a0c7b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:52.803695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 178/351] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:52 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:52.803695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f04f74-1700-4fa6-b266-0c00a5a3e539 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:52.811731 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5a086-b49d-4311-a407-5cf9e07a0c7b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:52.814993 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f04f74-1700-4fa6-b266-0c00a5a3e539 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:52.816086 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6491955-7a7b-4054-a75b-02fcc02204eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:52.816878 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6491955-7a7b-4054-a75b-02fcc02204eb admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:52.817156 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6491955-7a7b-4054-a75b-02fcc02204eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:52.817681 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6491955-7a7b-4054-a75b-02fcc02204eb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:52.818820 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6491955-7a7b-4054-a75b-02fcc02204eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:52.819555 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870bdbe-7785-48b2-9c4d-ba21a6ce7b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:52.820172 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870bdbe-7785-48b2-9c4d-ba21a6ce7b9b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:52.820451 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870bdbe-7785-48b2-9c4d-ba21a6ce7b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:52.820574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6491955-7a7b-4054-a75b-02fcc02204eb admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:52.820722 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870bdbe-7785-48b2-9c4d-ba21a6ce7b9b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:52.821539 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870bdbe-7785-48b2-9c4d-ba21a6ce7b9b admin admin] RBAC: Adding query filter params (role.id=c817e9fe7d034dd4ac25b1f45fd209c7, user.id=081cfb0787d248fd8a26dc66e0eec8ab, scope.system=all) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:52.821847 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870bdbe-7785-48b2-9c4d-ba21a6ce7b9b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:52.822121 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 174/352] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:54:52 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:52.823680 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870bdbe-7785-48b2-9c4d-ba21a6ce7b9b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:52.824029 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6491955-7a7b-4054-a75b-02fcc02204eb admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:52.833671 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6491955-7a7b-4054-a75b-02fcc02204eb admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:52.837875 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3433d24-7d1d-4c91-a4e3-e193a2c9cd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:52.838675 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3433d24-7d1d-4c91-a4e3-e193a2c9cd5e admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:52.838956 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3433d24-7d1d-4c91-a4e3-e193a2c9cd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:52.839249 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3433d24-7d1d-4c91-a4e3-e193a2c9cd5e admin admin] PATH_INFO: `/v3/users/7a33b7bcb09542f1a6402a6a0cb69823` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:52.839449 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 179/353] 10.222.0.54 () {56 vars in 1329 bytes} [Tue Nov 23 03:54:52 2021] GET /identity/v3/role_assignments?user.id=081cfb0787d248fd8a26dc66e0eec8ab&scope.system=all&role.id=c817e9fe7d034dd4ac25b1f45fd209c7 => generated 510 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:52.840200 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870bdbe-7785-48b2-9c4d-ba21a6ce7b9b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:52.841978 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3433d24-7d1d-4c91-a4e3-e193a2c9cd5e admin admin] RBAC: Authorizing `identity:get_user(user_id=7a33b7bcb09542f1a6402a6a0cb69823)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:52.844121 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3433d24-7d1d-4c91-a4e3-e193a2c9cd5e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:52.851080 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 175/354] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:52 2021] GET /identity/v3/users/7a33b7bcb09542f1a6402a6a0cb69823 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:52.851412 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870bdbe-7785-48b2-9c4d-ba21a6ce7b9b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:52.852074 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3433d24-7d1d-4c91-a4e3-e193a2c9cd5e admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:52.855095 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3eb311-3e6b-4f45-a17d-f0762d8ba969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:52.855814 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3eb311-3e6b-4f45-a17d-f0762d8ba969 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:52.856096 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3eb311-3e6b-4f45-a17d-f0762d8ba969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:52.856372 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3eb311-3e6b-4f45-a17d-f0762d8ba969 admin admin] PATH_INFO: `/v3/groups` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:52.857098 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3eb311-3e6b-4f45-a17d-f0762d8ba969 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:52.858132 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING py.warnings [None req-6b3eb311-3e6b-4f45-a17d-f0762d8ba969 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:54:52.858132 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: warnings.warn(msg) Nov 23 03:54:52.858132 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: Nov 23 03:54:52.859447 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3eb311-3e6b-4f45-a17d-f0762d8ba969 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:52.862172 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3433d24-7d1d-4c91-a4e3-e193a2c9cd5e admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:52.867742 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a47a1a-b7e4-4b8d-a674-874479fe876c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:52.868615 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a47a1a-b7e4-4b8d-a674-874479fe876c admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:52.868895 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a47a1a-b7e4-4b8d-a674-874479fe876c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:52.869170 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a47a1a-b7e4-4b8d-a674-874479fe876c admin admin] PATH_INFO: `/v3/system/users/7a33b7bcb09542f1a6402a6a0cb69823/roles/328414d877bc4b1abec0f915479039cd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:52.870834 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a47a1a-b7e4-4b8d-a674-874479fe876c admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7a33b7bcb09542f1a6402a6a0cb69823, role_id=328414d877bc4b1abec0f915479039cd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:52.871925 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING py.warnings [None req-11a47a1a-b7e4-4b8d-a674-874479fe876c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_system_grant_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:54:52.871925 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: warnings.warn(msg) Nov 23 03:54:52.871925 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: Nov 23 03:54:52.872807 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a47a1a-b7e4-4b8d-a674-874479fe876c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:52.986273 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 180/355] 10.222.0.54 () {60 vars in 1155 bytes} [Tue Nov 23 03:54:52 2021] POST /identity/v3/groups => generated 226 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:54:52.986699 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 176/356] 10.222.0.54 () {58 vars in 1355 bytes} [Tue Nov 23 03:54:52 2021] PUT /identity/v3/system/users/7a33b7bcb09542f1a6402a6a0cb69823/roles/328414d877bc4b1abec0f915479039cd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 03:54:55.461060 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39474e5-2a1d-4b8f-93ca-0ddd66a70570 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:55.461568 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39474e5-2a1d-4b8f-93ca-0ddd66a70570 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:55.461643 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39474e5-2a1d-4b8f-93ca-0ddd66a70570 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:55.463727 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 181/357] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:55.479271 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e1a48-0f53-4127-a791-967d5ea637a9 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:55.479774 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e1a48-0f53-4127-a791-967d5ea637a9 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:55.479852 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e1a48-0f53-4127-a791-967d5ea637a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:55.504564 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-057e1a48-0f53-4127-a791-967d5ea637a9 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:55.505745 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-057e1a48-0f53-4127-a791-967d5ea637a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:55.513403 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 177/358] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:55.522039 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e3c6e-45dd-4e2e-8585-6eebf780b80c None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:55.522314 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e3c6e-45dd-4e2e-8585-6eebf780b80c None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:55.522592 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e3c6e-45dd-4e2e-8585-6eebf780b80c None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:55.524383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 182/359] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:55.530441 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e84f39-ee40-43e5-9ff2-252e492d825f None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:55.530732 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e84f39-ee40-43e5-9ff2-252e492d825f None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:55.531013 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e84f39-ee40-43e5-9ff2-252e492d825f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:55.549118 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e3c6e-45dd-4e2e-8585-6eebf780b80c None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:55.561075 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-36e84f39-ee40-43e5-9ff2-252e492d825f None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:55.562252 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-36e84f39-ee40-43e5-9ff2-252e492d825f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:55.573825 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e3c6e-45dd-4e2e-8585-6eebf780b80c None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:55.577365 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 178/360] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:54:55.583683 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516c9fc-549f-419a-93b5-62170a404e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:55.584796 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516c9fc-549f-419a-93b5-62170a404e8d admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:55.585303 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516c9fc-549f-419a-93b5-62170a404e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:55.585776 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516c9fc-549f-419a-93b5-62170a404e8d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:55.608510 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516c9fc-549f-419a-93b5-62170a404e8d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:55.621405 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e84f39-ee40-43e5-9ff2-252e492d825f None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:55.621932 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-c516c9fc-549f-419a-93b5-62170a404e8d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 03:54:55.623735 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 183/361] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:55 2021] GET /identity/v3/roles/member => generated 84 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:55.630227 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516c9fc-549f-419a-93b5-62170a404e8d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:55.633288 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e84f39-ee40-43e5-9ff2-252e492d825f None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:55.640888 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516c9fc-549f-419a-93b5-62170a404e8d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:55.647892 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b8885-4069-40a7-8db9-85a4cf304a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:55.648700 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b8885-4069-40a7-8db9-85a4cf304a2d admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:55.648979 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b8885-4069-40a7-8db9-85a4cf304a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:55.649532 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b8885-4069-40a7-8db9-85a4cf304a2d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:55.650262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcd476-c8c5-4c64-9a8b-b0191b427fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:55.651148 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcd476-c8c5-4c64-9a8b-b0191b427fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:55.651667 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcd476-c8c5-4c64-9a8b-b0191b427fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:55.652133 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcd476-c8c5-4c64-9a8b-b0191b427fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:55.653088 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcd476-c8c5-4c64-9a8b-b0191b427fc6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:55.653589 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcd476-c8c5-4c64-9a8b-b0191b427fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:55.655409 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcd476-c8c5-4c64-9a8b-b0191b427fc6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:55.677980 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b8885-4069-40a7-8db9-85a4cf304a2d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:55.685119 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 184/362] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:55.686404 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcd476-c8c5-4c64-9a8b-b0191b427fc6 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:55.689236 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-e85b8885-4069-40a7-8db9-85a4cf304a2d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 23 03:54:55.691384 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 179/363] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:55 2021] GET /identity/v3/roles/reader => generated 84 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:54:55.700312 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b8885-4069-40a7-8db9-85a4cf304a2d admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:55.702224 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcd476-c8c5-4c64-9a8b-b0191b427fc6 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:55.712644 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43b00d-a5a1-46b0-a0df-14c95546b6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:55.713746 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43b00d-a5a1-46b0-a0df-14c95546b6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:55.714253 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43b00d-a5a1-46b0-a0df-14c95546b6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:55.714727 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43b00d-a5a1-46b0-a0df-14c95546b6a0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:55.717873 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b8885-4069-40a7-8db9-85a4cf304a2d admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:55.726400 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43b00d-a5a1-46b0-a0df-14c95546b6a0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:55.728464 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43b00d-a5a1-46b0-a0df-14c95546b6a0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:55.743905 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28803d-3db1-4373-bb00-a906ab0f37f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:55.744581 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28803d-3db1-4373-bb00-a906ab0f37f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:55.744860 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28803d-3db1-4373-bb00-a906ab0f37f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:55.745132 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28803d-3db1-4373-bb00-a906ab0f37f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:55.745904 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28803d-3db1-4373-bb00-a906ab0f37f3 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:55.746207 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28803d-3db1-4373-bb00-a906ab0f37f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:55.746530 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 185/364] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:55 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:55.749212 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28803d-3db1-4373-bb00-a906ab0f37f3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:55.752453 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43b00d-a5a1-46b0-a0df-14c95546b6a0 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:55.761431 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43b00d-a5a1-46b0-a0df-14c95546b6a0 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:55.762165 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 180/365] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:55 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:55.769556 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28803d-3db1-4373-bb00-a906ab0f37f3 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:55.776878 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237dd69-f14c-4382-8ce7-ac608c5c61b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:55.777859 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237dd69-f14c-4382-8ce7-ac608c5c61b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:55.778265 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237dd69-f14c-4382-8ce7-ac608c5c61b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:55.778641 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237dd69-f14c-4382-8ce7-ac608c5c61b8 admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:55.783256 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237dd69-f14c-4382-8ce7-ac608c5c61b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=04deb99f5f1a4beba726c6ac86a84723)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:55.783256 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237dd69-f14c-4382-8ce7-ac608c5c61b8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:55.785341 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 186/366] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:55 2021] GET /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:55.788864 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28803d-3db1-4373-bb00-a906ab0f37f3 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:55.791157 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237dd69-f14c-4382-8ce7-ac608c5c61b8 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:55.799365 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a2cab-38cd-4432-b83b-66c20509f3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:55.800804 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a2cab-38cd-4432-b83b-66c20509f3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:55.801139 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a2cab-38cd-4432-b83b-66c20509f3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:55.801479 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a2cab-38cd-4432-b83b-66c20509f3f7 admin admin] PATH_INFO: `/v3/users/7a33b7bcb09542f1a6402a6a0cb69823` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:55.802036 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237dd69-f14c-4382-8ce7-ac608c5c61b8 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:55.802861 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a2cab-38cd-4432-b83b-66c20509f3f7 admin admin] RBAC: Authorizing `identity:get_user(user_id=7a33b7bcb09542f1a6402a6a0cb69823)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:55.805021 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a2cab-38cd-4432-b83b-66c20509f3f7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:55.807019 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 181/367] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:54:55 2021] GET /identity/v3/users/7a33b7bcb09542f1a6402a6a0cb69823 => generated 293 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:55.813221 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a2cab-38cd-4432-b83b-66c20509f3f7 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:55.821538 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb8dc5-e1e4-4f65-a6c1-2fe56cdab482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:55.822401 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb8dc5-e1e4-4f65-a6c1-2fe56cdab482 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:55.822684 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb8dc5-e1e4-4f65-a6c1-2fe56cdab482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:55.822961 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb8dc5-e1e4-4f65-a6c1-2fe56cdab482 admin admin] PATH_INFO: `/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:55.825146 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a2cab-38cd-4432-b83b-66c20509f3f7 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:55.829543 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4010cbd-5236-4808-b156-567a8faea81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:55.830180 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4010cbd-5236-4808-b156-567a8faea81b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:55.830462 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4010cbd-5236-4808-b156-567a8faea81b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:55.830737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4010cbd-5236-4808-b156-567a8faea81b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:55.832181 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4010cbd-5236-4808-b156-567a8faea81b admin admin] RBAC: Adding query filter params (role.id=328414d877bc4b1abec0f915479039cd, user.id=7a33b7bcb09542f1a6402a6a0cb69823, scope.system=all) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:55.832509 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4010cbd-5236-4808-b156-567a8faea81b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:55.834394 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4010cbd-5236-4808-b156-567a8faea81b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:55.839928 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb8dc5-e1e4-4f65-a6c1-2fe56cdab482 admin admin] RBAC: Authorizing `identity:get_group(group_id=cc1b96aa42ae46b2b1a2320b3a38c43d)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:55.840961 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING py.warnings [None req-57bb8dc5-e1e4-4f65-a6c1-2fe56cdab482 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:54:55.840961 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: warnings.warn(msg) Nov 23 03:54:55.840961 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: Nov 23 03:54:55.842145 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb8dc5-e1e4-4f65-a6c1-2fe56cdab482 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:55.843884 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 187/368] 10.222.0.54 () {56 vars in 1201 bytes} [Tue Nov 23 03:54:55 2021] GET /identity/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d => generated 226 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:55.850389 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb8dc5-e1e4-4f65-a6c1-2fe56cdab482 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:55.853045 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 182/369] 10.222.0.54 () {56 vars in 1329 bytes} [Tue Nov 23 03:54:55 2021] GET /identity/v3/role_assignments?user.id=7a33b7bcb09542f1a6402a6a0cb69823&scope.system=all&role.id=328414d877bc4b1abec0f915479039cd => generated 510 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:55.875263 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb8dc5-e1e4-4f65-a6c1-2fe56cdab482 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:55.895129 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39947b2-56a9-4e7c-a676-e5053eb78f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:55.895811 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39947b2-56a9-4e7c-a676-e5053eb78f8e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:55.896098 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39947b2-56a9-4e7c-a676-e5053eb78f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:55.896379 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39947b2-56a9-4e7c-a676-e5053eb78f8e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:55.897250 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39947b2-56a9-4e7c-a676-e5053eb78f8e admin admin] RBAC: Adding query filter params (group.id=cc1b96aa42ae46b2b1a2320b3a38c43d, role.id=c817e9fe7d034dd4ac25b1f45fd209c7, scope.project.id=04deb99f5f1a4beba726c6ac86a84723) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:55.897565 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39947b2-56a9-4e7c-a676-e5053eb78f8e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:55.899469 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39947b2-56a9-4e7c-a676-e5053eb78f8e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:55.910685 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 188/370] 10.222.0.54 () {56 vars in 1397 bytes} [Tue Nov 23 03:54:55 2021] GET /identity/v3/role_assignments?group.id=cc1b96aa42ae46b2b1a2320b3a38c43d&scope.project.id=04deb99f5f1a4beba726c6ac86a84723&role.id=c817e9fe7d034dd4ac25b1f45fd209c7 => generated 260 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:56.099088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32860cba-a75e-47ac-ae45-2803afd3b352 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:56.099624 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32860cba-a75e-47ac-ae45-2803afd3b352 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:56.099854 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32860cba-a75e-47ac-ae45-2803afd3b352 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:56.101686 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 183/371] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:56.117952 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b73c7-c8d6-444b-8f9b-418e17026fe9 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:56.118260 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b73c7-c8d6-444b-8f9b-418e17026fe9 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:56.118514 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b73c7-c8d6-444b-8f9b-418e17026fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:56.144961 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-186b73c7-c8d6-444b-8f9b-418e17026fe9 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:56.146341 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-186b73c7-c8d6-444b-8f9b-418e17026fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:56.158729 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 189/372] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:56.184266 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32860cba-a75e-47ac-ae45-2803afd3b352 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:56.199821 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32860cba-a75e-47ac-ae45-2803afd3b352 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:56.207733 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034678c-e02e-46b6-b0de-613aa56a7b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:56.208544 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034678c-e02e-46b6-b0de-613aa56a7b1f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:56.208830 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034678c-e02e-46b6-b0de-613aa56a7b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:56.209108 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034678c-e02e-46b6-b0de-613aa56a7b1f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:56.225989 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034678c-e02e-46b6-b0de-613aa56a7b1f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:56.233476 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-9034678c-e02e-46b6-b0de-613aa56a7b1f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 03:54:56.235010 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 184/373] 10.222.0.54 () {56 vars in 1135 bytes} [Tue Nov 23 03:54:56 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:56.241306 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b73c7-c8d6-444b-8f9b-418e17026fe9 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:56.250829 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b73c7-c8d6-444b-8f9b-418e17026fe9 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:56.264581 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2c432-30bf-40af-b2b1-56f5616fec6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:56.265287 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2c432-30bf-40af-b2b1-56f5616fec6f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:56.265574 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2c432-30bf-40af-b2b1-56f5616fec6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:56.265856 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2c432-30bf-40af-b2b1-56f5616fec6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:56.266641 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2c432-30bf-40af-b2b1-56f5616fec6f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:56.266949 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2c432-30bf-40af-b2b1-56f5616fec6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:56.269069 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2c432-30bf-40af-b2b1-56f5616fec6f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:56.283567 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 190/374] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:54:56 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:56.290458 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034678c-e02e-46b6-b0de-613aa56a7b1f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:56.307344 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034678c-e02e-46b6-b0de-613aa56a7b1f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:56.316159 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2c469-cf46-4957-b94e-3931eeaa19db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:56.316864 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2c469-cf46-4957-b94e-3931eeaa19db admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:56.317209 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2c469-cf46-4957-b94e-3931eeaa19db admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:56.317803 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2c469-cf46-4957-b94e-3931eeaa19db admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:56.335164 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2c469-cf46-4957-b94e-3931eeaa19db admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:56.336989 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2c469-cf46-4957-b94e-3931eeaa19db admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:56.348508 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 185/375] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:56 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:56.354270 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2c432-30bf-40af-b2b1-56f5616fec6f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:56.365338 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2c432-30bf-40af-b2b1-56f5616fec6f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:56.375241 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09c0ea-9b6f-49fd-b351-10a26115077e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:56.376118 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09c0ea-9b6f-49fd-b351-10a26115077e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:56.376377 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09c0ea-9b6f-49fd-b351-10a26115077e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:56.376668 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09c0ea-9b6f-49fd-b351-10a26115077e admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:56.379393 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09c0ea-9b6f-49fd-b351-10a26115077e admin admin] RBAC: Authorizing `identity:get_project(project_id=04deb99f5f1a4beba726c6ac86a84723)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:56.381603 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09c0ea-9b6f-49fd-b351-10a26115077e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:56.383672 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 191/376] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:56 2021] GET /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:56.389479 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2c469-cf46-4957-b94e-3931eeaa19db admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:56.401263 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2c469-cf46-4957-b94e-3931eeaa19db admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:56.409220 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752e067-a04b-4209-b215-1006a5b6ff4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:56.410228 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752e067-a04b-4209-b215-1006a5b6ff4b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:56.410491 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752e067-a04b-4209-b215-1006a5b6ff4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:56.410774 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752e067-a04b-4209-b215-1006a5b6ff4b admin admin] PATH_INFO: `/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:56.414099 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752e067-a04b-4209-b215-1006a5b6ff4b admin admin] RBAC: Authorizing `identity:get_group(group_id=cc1b96aa42ae46b2b1a2320b3a38c43d)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:56.415131 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING py.warnings [None req-1752e067-a04b-4209-b215-1006a5b6ff4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:54:56.415131 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: warnings.warn(msg) Nov 23 03:54:56.415131 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: Nov 23 03:54:56.416510 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752e067-a04b-4209-b215-1006a5b6ff4b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:56.418482 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 186/377] 10.222.0.54 () {56 vars in 1201 bytes} [Tue Nov 23 03:54:56 2021] GET /identity/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:56.424514 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09c0ea-9b6f-49fd-b351-10a26115077e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:56.439469 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09c0ea-9b6f-49fd-b351-10a26115077e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:56.446641 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50a27f-348b-4568-b5e8-95fa73bac1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:56.447379 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50a27f-348b-4568-b5e8-95fa73bac1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:56.447685 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50a27f-348b-4568-b5e8-95fa73bac1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:56.447946 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50a27f-348b-4568-b5e8-95fa73bac1f5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:56.448853 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50a27f-348b-4568-b5e8-95fa73bac1f5 admin admin] RBAC: Adding query filter params (group.id=cc1b96aa42ae46b2b1a2320b3a38c43d, role.id=e8e5c21f4bea46318bef0c9784214ce6, scope.project.id=04deb99f5f1a4beba726c6ac86a84723) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:56.449169 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50a27f-348b-4568-b5e8-95fa73bac1f5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:56.451180 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50a27f-348b-4568-b5e8-95fa73bac1f5 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:56.463400 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 192/378] 10.222.0.54 () {56 vars in 1397 bytes} [Tue Nov 23 03:54:56 2021] GET /identity/v3/role_assignments?group.id=cc1b96aa42ae46b2b1a2320b3a38c43d&scope.project.id=04deb99f5f1a4beba726c6ac86a84723&role.id=e8e5c21f4bea46318bef0c9784214ce6 => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:56.940047 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99802e2-44b1-4e22-a897-62705c49ba0a None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:56.941164 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99802e2-44b1-4e22-a897-62705c49ba0a None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:56.941164 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99802e2-44b1-4e22-a897-62705c49ba0a None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:56.943319 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 187/379] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:56.949507 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc125c-e21d-460b-8084-db54713c2f88 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:56.950056 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc125c-e21d-460b-8084-db54713c2f88 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:56.950549 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc125c-e21d-460b-8084-db54713c2f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:56.980247 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-cddc125c-e21d-460b-8084-db54713c2f88 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:56.981787 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-cddc125c-e21d-460b-8084-db54713c2f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:56.993522 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 193/380] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:57.030167 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99802e2-44b1-4e22-a897-62705c49ba0a None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:57.048424 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99802e2-44b1-4e22-a897-62705c49ba0a None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:57.052941 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465416c-25f6-4f03-a392-8f32e52415d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:57.053730 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465416c-25f6-4f03-a392-8f32e52415d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:57.054019 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465416c-25f6-4f03-a392-8f32e52415d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:57.054295 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465416c-25f6-4f03-a392-8f32e52415d9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:57.071488 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465416c-25f6-4f03-a392-8f32e52415d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:57.078365 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-6465416c-25f6-4f03-a392-8f32e52415d9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 03:54:57.079922 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 188/381] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:57 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:57.085913 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc125c-e21d-460b-8084-db54713c2f88 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:57.100859 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc125c-e21d-460b-8084-db54713c2f88 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:57.106260 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0974e3-a205-47bb-a3af-5c4bcee673ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:57.107435 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0974e3-a205-47bb-a3af-5c4bcee673ae admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:57.107941 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0974e3-a205-47bb-a3af-5c4bcee673ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:57.108426 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0974e3-a205-47bb-a3af-5c4bcee673ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:57.109431 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0974e3-a205-47bb-a3af-5c4bcee673ae admin admin] RBAC: Adding query filter params (name=member) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:57.109972 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0974e3-a205-47bb-a3af-5c4bcee673ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:57.113281 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0974e3-a205-47bb-a3af-5c4bcee673ae admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:57.124016 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 194/382] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:57 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:57.130195 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465416c-25f6-4f03-a392-8f32e52415d9 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:57.140307 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465416c-25f6-4f03-a392-8f32e52415d9 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:57.150034 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc65f6f-76a4-4b13-9600-026eb96f4ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:57.150686 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc65f6f-76a4-4b13-9600-026eb96f4ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:57.151019 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc65f6f-76a4-4b13-9600-026eb96f4ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:57.151319 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc65f6f-76a4-4b13-9600-026eb96f4ff3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:57.164338 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc65f6f-76a4-4b13-9600-026eb96f4ff3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:57.166110 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc65f6f-76a4-4b13-9600-026eb96f4ff3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:57.179672 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 189/383] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:57 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:57.185867 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0974e3-a205-47bb-a3af-5c4bcee673ae admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:57.199976 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0974e3-a205-47bb-a3af-5c4bcee673ae admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:57.204247 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06233f7-98c2-4d7e-ae7b-1e1399bb0e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:57.205105 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06233f7-98c2-4d7e-ae7b-1e1399bb0e14 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:57.205384 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06233f7-98c2-4d7e-ae7b-1e1399bb0e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:57.205649 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06233f7-98c2-4d7e-ae7b-1e1399bb0e14 admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:57.207090 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06233f7-98c2-4d7e-ae7b-1e1399bb0e14 admin admin] RBAC: Authorizing `identity:get_project(project_id=66d1377d6a7d40f798138de207208f9e)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:57.209156 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06233f7-98c2-4d7e-ae7b-1e1399bb0e14 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:57.210970 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 195/384] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:57 2021] GET /identity/v3/projects/66d1377d6a7d40f798138de207208f9e => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:57.217019 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc65f6f-76a4-4b13-9600-026eb96f4ff3 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:57.226300 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc65f6f-76a4-4b13-9600-026eb96f4ff3 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:57.238678 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322ef75-2a7d-4a28-a657-f56e7bb39334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:57.239547 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322ef75-2a7d-4a28-a657-f56e7bb39334 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:57.239826 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322ef75-2a7d-4a28-a657-f56e7bb39334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:57.240098 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322ef75-2a7d-4a28-a657-f56e7bb39334 admin admin] PATH_INFO: `/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:57.241289 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322ef75-2a7d-4a28-a657-f56e7bb39334 admin admin] RBAC: Authorizing `identity:get_group(group_id=cc1b96aa42ae46b2b1a2320b3a38c43d)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:57.243169 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322ef75-2a7d-4a28-a657-f56e7bb39334 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:57.245069 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 190/385] 10.222.0.54 () {56 vars in 1201 bytes} [Tue Nov 23 03:54:57 2021] GET /identity/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:57.250898 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06233f7-98c2-4d7e-ae7b-1e1399bb0e14 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:57.264326 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06233f7-98c2-4d7e-ae7b-1e1399bb0e14 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:57.269229 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36201d2c-85ab-4503-8efe-245d55a7eab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:57.269878 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36201d2c-85ab-4503-8efe-245d55a7eab1 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:57.270165 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36201d2c-85ab-4503-8efe-245d55a7eab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:57.270442 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36201d2c-85ab-4503-8efe-245d55a7eab1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:57.271302 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36201d2c-85ab-4503-8efe-245d55a7eab1 admin admin] RBAC: Adding query filter params (group.id=cc1b96aa42ae46b2b1a2320b3a38c43d, role.id=c817e9fe7d034dd4ac25b1f45fd209c7, scope.project.id=66d1377d6a7d40f798138de207208f9e) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:57.271618 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36201d2c-85ab-4503-8efe-245d55a7eab1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:57.273546 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36201d2c-85ab-4503-8efe-245d55a7eab1 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:57.283746 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 196/386] 10.222.0.54 () {56 vars in 1397 bytes} [Tue Nov 23 03:54:57 2021] GET /identity/v3/role_assignments?group.id=cc1b96aa42ae46b2b1a2320b3a38c43d&scope.project.id=66d1377d6a7d40f798138de207208f9e&role.id=c817e9fe7d034dd4ac25b1f45fd209c7 => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:57.340055 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49ff17-1fab-4e79-b746-e4465a543bec None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:57.340385 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49ff17-1fab-4e79-b746-e4465a543bec None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:57.340603 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49ff17-1fab-4e79-b746-e4465a543bec None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:57.342428 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 191/387] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:57.357359 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfb4b4-2e31-46c1-9698-f5b1b88ee34c None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:57.357707 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfb4b4-2e31-46c1-9698-f5b1b88ee34c None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:57.357919 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfb4b4-2e31-46c1-9698-f5b1b88ee34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:57.383670 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-b0cfb4b4-2e31-46c1-9698-f5b1b88ee34c None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:57.384869 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-b0cfb4b4-2e31-46c1-9698-f5b1b88ee34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:57.392920 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 197/388] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:57.418152 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49ff17-1fab-4e79-b746-e4465a543bec None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:57.431504 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49ff17-1fab-4e79-b746-e4465a543bec None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:57.435904 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd265e-d0e1-4b71-96a7-5187ffcd4752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:57.436726 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd265e-d0e1-4b71-96a7-5187ffcd4752 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:57.437002 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd265e-d0e1-4b71-96a7-5187ffcd4752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:57.437271 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd265e-d0e1-4b71-96a7-5187ffcd4752 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:57.450353 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd265e-d0e1-4b71-96a7-5187ffcd4752 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:57.458428 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-32dd265e-d0e1-4b71-96a7-5187ffcd4752 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 03:54:57.460028 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 192/389] 10.222.0.54 () {56 vars in 1135 bytes} [Tue Nov 23 03:54:57 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:57.466296 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfb4b4-2e31-46c1-9698-f5b1b88ee34c None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:57.476105 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfb4b4-2e31-46c1-9698-f5b1b88ee34c None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:57.481063 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c881796-d55a-41aa-b0d5-85d2498d045d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:57.481750 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c881796-d55a-41aa-b0d5-85d2498d045d admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:57.482067 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c881796-d55a-41aa-b0d5-85d2498d045d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:57.482306 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c881796-d55a-41aa-b0d5-85d2498d045d admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:57.483088 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c881796-d55a-41aa-b0d5-85d2498d045d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:57.483420 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c881796-d55a-41aa-b0d5-85d2498d045d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:57.485033 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c881796-d55a-41aa-b0d5-85d2498d045d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:57.496017 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 198/390] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:54:57 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:57.502059 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd265e-d0e1-4b71-96a7-5187ffcd4752 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:57.512480 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd265e-d0e1-4b71-96a7-5187ffcd4752 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:57.517004 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749f18a-8c1b-4a6e-bff3-b17e6b945ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:57.517632 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749f18a-8c1b-4a6e-bff3-b17e6b945ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:57.517916 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749f18a-8c1b-4a6e-bff3-b17e6b945ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:57.518193 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749f18a-8c1b-4a6e-bff3-b17e6b945ed0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:57.528308 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749f18a-8c1b-4a6e-bff3-b17e6b945ed0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:57.530071 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749f18a-8c1b-4a6e-bff3-b17e6b945ed0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:57.540119 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 193/391] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:57 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:57.546166 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c881796-d55a-41aa-b0d5-85d2498d045d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:57.558593 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c881796-d55a-41aa-b0d5-85d2498d045d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:57.562954 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dead34-8b92-4fe3-9a3b-4b9bd486d3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:57.563832 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dead34-8b92-4fe3-9a3b-4b9bd486d3bb admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:57.564112 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dead34-8b92-4fe3-9a3b-4b9bd486d3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:57.564385 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dead34-8b92-4fe3-9a3b-4b9bd486d3bb admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:57.565672 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dead34-8b92-4fe3-9a3b-4b9bd486d3bb admin admin] RBAC: Authorizing `identity:get_project(project_id=66d1377d6a7d40f798138de207208f9e)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:57.568140 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dead34-8b92-4fe3-9a3b-4b9bd486d3bb admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:57.570051 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 199/392] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:57 2021] GET /identity/v3/projects/66d1377d6a7d40f798138de207208f9e => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:57.575850 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749f18a-8c1b-4a6e-bff3-b17e6b945ed0 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:57.586769 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749f18a-8c1b-4a6e-bff3-b17e6b945ed0 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:57.591310 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c35d5-fbff-4a70-8e0e-19e2b456ef30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:57.592256 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c35d5-fbff-4a70-8e0e-19e2b456ef30 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:57.592529 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c35d5-fbff-4a70-8e0e-19e2b456ef30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:57.592797 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c35d5-fbff-4a70-8e0e-19e2b456ef30 admin admin] PATH_INFO: `/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:57.595140 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c35d5-fbff-4a70-8e0e-19e2b456ef30 admin admin] RBAC: Authorizing `identity:get_group(group_id=cc1b96aa42ae46b2b1a2320b3a38c43d)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:57.597454 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c35d5-fbff-4a70-8e0e-19e2b456ef30 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:57.599146 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 194/393] 10.222.0.54 () {56 vars in 1201 bytes} [Tue Nov 23 03:54:57 2021] GET /identity/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:57.605388 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dead34-8b92-4fe3-9a3b-4b9bd486d3bb admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:57.617031 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dead34-8b92-4fe3-9a3b-4b9bd486d3bb admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:57.622166 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0729f4-c1f0-4986-a906-eac371eb6c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:57.623101 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0729f4-c1f0-4986-a906-eac371eb6c3c admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:57.623627 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0729f4-c1f0-4986-a906-eac371eb6c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:57.624088 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0729f4-c1f0-4986-a906-eac371eb6c3c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:57.625082 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0729f4-c1f0-4986-a906-eac371eb6c3c admin admin] RBAC: Adding query filter params (group.id=cc1b96aa42ae46b2b1a2320b3a38c43d, role.id=e8e5c21f4bea46318bef0c9784214ce6, scope.project.id=66d1377d6a7d40f798138de207208f9e) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:57.625661 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0729f4-c1f0-4986-a906-eac371eb6c3c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:57.627812 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0729f4-c1f0-4986-a906-eac371eb6c3c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:57.635420 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 200/394] 10.222.0.54 () {56 vars in 1397 bytes} [Tue Nov 23 03:54:57 2021] GET /identity/v3/role_assignments?group.id=cc1b96aa42ae46b2b1a2320b3a38c43d&scope.project.id=66d1377d6a7d40f798138de207208f9e&role.id=e8e5c21f4bea46318bef0c9784214ce6 => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:58.006978 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a8bc2-f20c-4d25-bd27-0de5d0e42717 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:58.007538 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a8bc2-f20c-4d25-bd27-0de5d0e42717 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:58.007538 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a8bc2-f20c-4d25-bd27-0de5d0e42717 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:58.009551 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 195/395] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:58.015589 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a8f54-a1f2-4ec3-af2c-0272c500e46a None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:58.015876 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a8f54-a1f2-4ec3-af2c-0272c500e46a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:58.016147 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a8f54-a1f2-4ec3-af2c-0272c500e46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:58.039153 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-743a8f54-a1f2-4ec3-af2c-0272c500e46a None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:58.040359 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-743a8f54-a1f2-4ec3-af2c-0272c500e46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:58.054160 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 201/396] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:58.080115 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a8bc2-f20c-4d25-bd27-0de5d0e42717 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:58.095822 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a8bc2-f20c-4d25-bd27-0de5d0e42717 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:58.105267 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1c013-0d52-4591-9a49-7a7fb4120e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:58.106056 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1c013-0d52-4591-9a49-7a7fb4120e1f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:58.106338 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1c013-0d52-4591-9a49-7a7fb4120e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:58.106613 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1c013-0d52-4591-9a49-7a7fb4120e1f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:58.124397 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1c013-0d52-4591-9a49-7a7fb4120e1f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:58.131601 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-ffa1c013-0d52-4591-9a49-7a7fb4120e1f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:54:58.132802 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 196/397] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:54:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:58.139083 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a8f54-a1f2-4ec3-af2c-0272c500e46a None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:58.148510 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a8f54-a1f2-4ec3-af2c-0272c500e46a None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:58.155747 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1339c6c-ad63-47cd-abac-b5d2a65bcc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:58.156416 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1339c6c-ad63-47cd-abac-b5d2a65bcc10 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:58.156697 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1339c6c-ad63-47cd-abac-b5d2a65bcc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:58.156973 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1339c6c-ad63-47cd-abac-b5d2a65bcc10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:58.157730 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1339c6c-ad63-47cd-abac-b5d2a65bcc10 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:58.158034 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1339c6c-ad63-47cd-abac-b5d2a65bcc10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:58.159861 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1339c6c-ad63-47cd-abac-b5d2a65bcc10 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:58.175378 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 202/398] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:58.181463 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1c013-0d52-4591-9a49-7a7fb4120e1f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:58.191318 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1c013-0d52-4591-9a49-7a7fb4120e1f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:58.201621 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac04642-07f2-4734-8bd3-565b805f0ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:58.202262 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac04642-07f2-4734-8bd3-565b805f0ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:58.202546 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac04642-07f2-4734-8bd3-565b805f0ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:58.202816 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac04642-07f2-4734-8bd3-565b805f0ff9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:58.212498 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac04642-07f2-4734-8bd3-565b805f0ff9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:58.214249 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac04642-07f2-4734-8bd3-565b805f0ff9 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:58.228148 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 197/399] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:54:58 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:54:58.234167 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1339c6c-ad63-47cd-abac-b5d2a65bcc10 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:58.248197 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1339c6c-ad63-47cd-abac-b5d2a65bcc10 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:58.253083 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad18a1-8df1-4bc1-acc1-0e155cf6e277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:58.254136 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad18a1-8df1-4bc1-acc1-0e155cf6e277 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:58.254419 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad18a1-8df1-4bc1-acc1-0e155cf6e277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:58.254695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad18a1-8df1-4bc1-acc1-0e155cf6e277 admin admin] PATH_INFO: `/v3/projects/a46903e1a0df4e5bbff165f0dc8442a9` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:58.255909 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad18a1-8df1-4bc1-acc1-0e155cf6e277 admin admin] RBAC: Authorizing `identity:get_project(project_id=a46903e1a0df4e5bbff165f0dc8442a9)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:58.257750 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad18a1-8df1-4bc1-acc1-0e155cf6e277 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:58.259396 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 203/400] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:58 2021] GET /identity/v3/projects/a46903e1a0df4e5bbff165f0dc8442a9 => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:58.265242 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac04642-07f2-4734-8bd3-565b805f0ff9 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:58.274942 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac04642-07f2-4734-8bd3-565b805f0ff9 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:58.282840 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36465c41-d621-462a-bcfd-69375c9ab43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:58.283707 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36465c41-d621-462a-bcfd-69375c9ab43b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:58.283990 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36465c41-d621-462a-bcfd-69375c9ab43b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:58.284358 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36465c41-d621-462a-bcfd-69375c9ab43b admin admin] PATH_INFO: `/v3/groups/a81f286949c54bcda41c28b6f0720680` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:58.295969 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36465c41-d621-462a-bcfd-69375c9ab43b admin admin] RBAC: Authorizing `identity:get_group(group_id=a81f286949c54bcda41c28b6f0720680)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:58.297897 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36465c41-d621-462a-bcfd-69375c9ab43b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:58.300348 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 198/401] 10.222.0.54 () {56 vars in 1201 bytes} [Tue Nov 23 03:54:58 2021] GET /identity/v3/groups/a81f286949c54bcda41c28b6f0720680 => generated 229 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:58.306700 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad18a1-8df1-4bc1-acc1-0e155cf6e277 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:58.316890 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad18a1-8df1-4bc1-acc1-0e155cf6e277 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:58.323414 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55808c41-69c1-4dd9-b1d5-40be61222a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:58.324062 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55808c41-69c1-4dd9-b1d5-40be61222a8c admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:58.324344 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55808c41-69c1-4dd9-b1d5-40be61222a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:58.324622 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55808c41-69c1-4dd9-b1d5-40be61222a8c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:58.325460 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55808c41-69c1-4dd9-b1d5-40be61222a8c admin admin] RBAC: Adding query filter params (group.id=a81f286949c54bcda41c28b6f0720680, role.id=3db7012b41944542a50049819500eadd, scope.project.id=a46903e1a0df4e5bbff165f0dc8442a9) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:58.325768 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55808c41-69c1-4dd9-b1d5-40be61222a8c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:58.327620 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55808c41-69c1-4dd9-b1d5-40be61222a8c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:58.339573 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 204/402] 10.222.0.54 () {56 vars in 1397 bytes} [Tue Nov 23 03:54:58 2021] GET /identity/v3/role_assignments?group.id=a81f286949c54bcda41c28b6f0720680&scope.project.id=a46903e1a0df4e5bbff165f0dc8442a9&role.id=3db7012b41944542a50049819500eadd => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:59.010053 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e4325-12f1-43e3-be69-6e015647d884 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:59.010738 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e4325-12f1-43e3-be69-6e015647d884 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:59.010738 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e4325-12f1-43e3-be69-6e015647d884 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:59.012660 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 199/403] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:54:59.018412 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee3491-1757-4ab6-b6a9-0d57f28ccbb0 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:59.018962 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee3491-1757-4ab6-b6a9-0d57f28ccbb0 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:59.019124 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee3491-1757-4ab6-b6a9-0d57f28ccbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:59.043915 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-c8ee3491-1757-4ab6-b6a9-0d57f28ccbb0 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:59.045121 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-c8ee3491-1757-4ab6-b6a9-0d57f28ccbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:59.058147 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 205/404] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:54:59.093688 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e4325-12f1-43e3-be69-6e015647d884 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:59.111858 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e4325-12f1-43e3-be69-6e015647d884 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:59.116692 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b4286-bb37-449f-8a55-eb7d0b799ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:59.117475 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b4286-bb37-449f-8a55-eb7d0b799ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:59.117756 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b4286-bb37-449f-8a55-eb7d0b799ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:59.118029 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b4286-bb37-449f-8a55-eb7d0b799ed8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:59.133365 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b4286-bb37-449f-8a55-eb7d0b799ed8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:54:59.140241 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-730b4286-bb37-449f-8a55-eb7d0b799ed8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 03:54:59.141656 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 200/405] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:54:59 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:54:59.147873 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee3491-1757-4ab6-b6a9-0d57f28ccbb0 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:59.156882 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee3491-1757-4ab6-b6a9-0d57f28ccbb0 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:59.164710 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd8016-00e0-4f66-8c0a-141b9916a174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:59.165393 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd8016-00e0-4f66-8c0a-141b9916a174 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:59.165674 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd8016-00e0-4f66-8c0a-141b9916a174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:59.165949 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd8016-00e0-4f66-8c0a-141b9916a174 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:59.166714 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd8016-00e0-4f66-8c0a-141b9916a174 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:54:59.167015 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd8016-00e0-4f66-8c0a-141b9916a174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:59.168642 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd8016-00e0-4f66-8c0a-141b9916a174 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:59.183478 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 206/406] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:54:59 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:59.189139 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b4286-bb37-449f-8a55-eb7d0b799ed8 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:59.200012 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b4286-bb37-449f-8a55-eb7d0b799ed8 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:59.206935 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195abf1e-c8bf-40f0-849c-145a6a0f7ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:59.207818 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195abf1e-c8bf-40f0-849c-145a6a0f7ded admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:59.208092 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195abf1e-c8bf-40f0-849c-145a6a0f7ded admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:59.208367 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195abf1e-c8bf-40f0-849c-145a6a0f7ded admin admin] PATH_INFO: `/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:59.209600 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195abf1e-c8bf-40f0-849c-145a6a0f7ded admin admin] RBAC: Authorizing `identity:get_group(group_id=cc1b96aa42ae46b2b1a2320b3a38c43d)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:59.211486 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195abf1e-c8bf-40f0-849c-145a6a0f7ded admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:59.213248 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 201/407] 10.222.0.54 () {56 vars in 1201 bytes} [Tue Nov 23 03:54:59 2021] GET /identity/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:54:59.219110 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd8016-00e0-4f66-8c0a-141b9916a174 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:59.232202 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd8016-00e0-4f66-8c0a-141b9916a174 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:59.240727 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afa397-1292-4811-94b3-8dafaf4035b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:59.241597 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afa397-1292-4811-94b3-8dafaf4035b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:59.241873 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afa397-1292-4811-94b3-8dafaf4035b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:59.242142 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afa397-1292-4811-94b3-8dafaf4035b0 admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:59.243384 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afa397-1292-4811-94b3-8dafaf4035b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=04deb99f5f1a4beba726c6ac86a84723)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:59.245420 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afa397-1292-4811-94b3-8dafaf4035b0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:59.247101 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 207/408] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:54:59 2021] GET /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:54:59.253378 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195abf1e-c8bf-40f0-849c-145a6a0f7ded admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:54:59.263452 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195abf1e-c8bf-40f0-849c-145a6a0f7ded admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:54:59.271306 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c89e9-6e18-4f94-b50d-e2340473720d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:54:59.272185 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c89e9-6e18-4f94-b50d-e2340473720d admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:59.272467 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c89e9-6e18-4f94-b50d-e2340473720d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:59.272742 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c89e9-6e18-4f94-b50d-e2340473720d admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723/groups/cc1b96aa42ae46b2b1a2320b3a38c43d/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:59.280967 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c89e9-6e18-4f94-b50d-e2340473720d admin admin] RBAC: Authorizing `identity:create_grant(project_id=04deb99f5f1a4beba726c6ac86a84723, group_id=cc1b96aa42ae46b2b1a2320b3a38c43d, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:54:59.280967 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c89e9-6e18-4f94-b50d-e2340473720d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:54:59.364110 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 202/409] 10.222.0.54 () {58 vars in 1463 bytes} [Tue Nov 23 03:54:59 2021] PUT /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723/groups/cc1b96aa42ae46b2b1a2320b3a38c43d/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:54:59.870740 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2721696-0015-4d1f-9237-2737283eb913 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:59.871119 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2721696-0015-4d1f-9237-2737283eb913 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:59.871314 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2721696-0015-4d1f-9237-2737283eb913 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:59.873397 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 208/410] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:54:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:54:59.880149 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b12b3f-a51b-47b3-8569-f6df68098861 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:54:59.880434 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b12b3f-a51b-47b3-8569-f6df68098861 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:54:59.880706 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b12b3f-a51b-47b3-8569-f6df68098861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:54:59.906347 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-15b12b3f-a51b-47b3-8569-f6df68098861 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:54:59.907549 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-15b12b3f-a51b-47b3-8569-f6df68098861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:54:59.981526 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 203/411] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:54:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:55:00.021074 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2721696-0015-4d1f-9237-2737283eb913 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:00.040435 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2721696-0015-4d1f-9237-2737283eb913 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:00.048360 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d6839-a3b0-4686-bee4-1f1a6bf6d9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:00.049177 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d6839-a3b0-4686-bee4-1f1a6bf6d9fc admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:00.049464 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d6839-a3b0-4686-bee4-1f1a6bf6d9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:00.049766 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d6839-a3b0-4686-bee4-1f1a6bf6d9fc admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:00.067123 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d6839-a3b0-4686-bee4-1f1a6bf6d9fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:00.074827 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-862d6839-a3b0-4686-bee4-1f1a6bf6d9fc admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 03:55:00.081038 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 209/412] 10.222.0.54 () {56 vars in 1135 bytes} [Tue Nov 23 03:55:00 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:00.082889 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b12b3f-a51b-47b3-8569-f6df68098861 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:00.096361 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b12b3f-a51b-47b3-8569-f6df68098861 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:00.107936 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cd078-184b-40dd-a4ef-9ddd5c41cbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:00.108625 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cd078-184b-40dd-a4ef-9ddd5c41cbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:00.108908 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cd078-184b-40dd-a4ef-9ddd5c41cbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:00.109184 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cd078-184b-40dd-a4ef-9ddd5c41cbb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:00.109962 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cd078-184b-40dd-a4ef-9ddd5c41cbb8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:00.110264 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cd078-184b-40dd-a4ef-9ddd5c41cbb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:00.111889 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cd078-184b-40dd-a4ef-9ddd5c41cbb8 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:00.126621 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 204/413] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:00 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:00.133747 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d6839-a3b0-4686-bee4-1f1a6bf6d9fc admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:00.144658 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d6839-a3b0-4686-bee4-1f1a6bf6d9fc admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:00.155446 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c500207-ac74-4f18-8434-ef5c8d515958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:00.156298 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c500207-ac74-4f18-8434-ef5c8d515958 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:00.156581 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c500207-ac74-4f18-8434-ef5c8d515958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:00.156859 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c500207-ac74-4f18-8434-ef5c8d515958 admin admin] PATH_INFO: `/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:00.158349 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c500207-ac74-4f18-8434-ef5c8d515958 admin admin] RBAC: Authorizing `identity:get_group(group_id=cc1b96aa42ae46b2b1a2320b3a38c43d)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:00.161085 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c500207-ac74-4f18-8434-ef5c8d515958 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:00.163070 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 210/414] 10.222.0.54 () {56 vars in 1201 bytes} [Tue Nov 23 03:55:00 2021] GET /identity/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:00.168773 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cd078-184b-40dd-a4ef-9ddd5c41cbb8 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:00.184813 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cd078-184b-40dd-a4ef-9ddd5c41cbb8 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:00.193299 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77297b5b-be8d-4166-84a0-8ef1c5734314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:00.194183 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77297b5b-be8d-4166-84a0-8ef1c5734314 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:00.194469 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77297b5b-be8d-4166-84a0-8ef1c5734314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:00.194747 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77297b5b-be8d-4166-84a0-8ef1c5734314 admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:00.196041 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77297b5b-be8d-4166-84a0-8ef1c5734314 admin admin] RBAC: Authorizing `identity:get_project(project_id=04deb99f5f1a4beba726c6ac86a84723)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:00.198144 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77297b5b-be8d-4166-84a0-8ef1c5734314 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:00.200171 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 205/415] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:55:00 2021] GET /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:00.206807 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c500207-ac74-4f18-8434-ef5c8d515958 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:00.220655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c500207-ac74-4f18-8434-ef5c8d515958 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:00.225859 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51ad4b-47b6-4e2d-afb8-0eced9633618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:00.226747 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51ad4b-47b6-4e2d-afb8-0eced9633618 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:00.227031 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51ad4b-47b6-4e2d-afb8-0eced9633618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:00.227344 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51ad4b-47b6-4e2d-afb8-0eced9633618 admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723/groups/cc1b96aa42ae46b2b1a2320b3a38c43d/roles/e8e5c21f4bea46318bef0c9784214ce6` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:00.233087 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51ad4b-47b6-4e2d-afb8-0eced9633618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04deb99f5f1a4beba726c6ac86a84723, group_id=cc1b96aa42ae46b2b1a2320b3a38c43d, role_id=e8e5c21f4bea46318bef0c9784214ce6)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:00.235685 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51ad4b-47b6-4e2d-afb8-0eced9633618 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:00.311675 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 211/416] 10.222.0.54 () {58 vars in 1463 bytes} [Tue Nov 23 03:55:00 2021] PUT /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723/groups/cc1b96aa42ae46b2b1a2320b3a38c43d/roles/e8e5c21f4bea46318bef0c9784214ce6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:55:00.397947 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a6ae0-4cae-4e74-8ef4-f835d89b3db7 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:00.398286 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a6ae0-4cae-4e74-8ef4-f835d89b3db7 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:00.398506 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a6ae0-4cae-4e74-8ef4-f835d89b3db7 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:00.400670 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 206/417] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:00.406749 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919901cd-b9d3-4281-8abe-507198c82a34 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:00.407034 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919901cd-b9d3-4281-8abe-507198c82a34 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:00.407325 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919901cd-b9d3-4281-8abe-507198c82a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:00.431275 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-919901cd-b9d3-4281-8abe-507198c82a34 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:00.432450 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-919901cd-b9d3-4281-8abe-507198c82a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:00.493735 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36846c-ec5e-4344-9cc4-e0167eb0f899 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:00.494092 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36846c-ec5e-4344-9cc4-e0167eb0f899 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:00.494293 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36846c-ec5e-4344-9cc4-e0167eb0f899 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:00.496177 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 207/418] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:55:00.503656 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b4290-b218-4372-a0b4-2ab1d97b3988 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:00.503972 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b4290-b218-4372-a0b4-2ab1d97b3988 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:00.504222 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b4290-b218-4372-a0b4-2ab1d97b3988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:00.510918 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 212/419] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:55:00.536244 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-6b5b4290-b218-4372-a0b4-2ab1d97b3988 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:00.537459 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-6b5b4290-b218-4372-a0b4-2ab1d97b3988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:00.543281 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919901cd-b9d3-4281-8abe-507198c82a34 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:00.550906 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919901cd-b9d3-4281-8abe-507198c82a34 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:00.556689 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45c3c2-62cf-4024-9687-2b6450320ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:00.557862 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45c3c2-62cf-4024-9687-2b6450320ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:00.558368 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45c3c2-62cf-4024-9687-2b6450320ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:00.558892 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45c3c2-62cf-4024-9687-2b6450320ed2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:00.561502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 208/420] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:55:00.573131 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45c3c2-62cf-4024-9687-2b6450320ed2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:00.580752 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-3a45c3c2-62cf-4024-9687-2b6450320ed2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 03:55:00.587570 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 213/421] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:55:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:00.590482 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b4290-b218-4372-a0b4-2ab1d97b3988 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:00.601855 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b4290-b218-4372-a0b4-2ab1d97b3988 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:00.603867 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45c3c2-62cf-4024-9687-2b6450320ed2 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:00.614651 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45c3c2-62cf-4024-9687-2b6450320ed2 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:00.621468 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387d275-072d-4f57-a9d0-b37af1c1c737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:00.622966 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387d275-072d-4f57-a9d0-b37af1c1c737 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:00.624788 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387d275-072d-4f57-a9d0-b37af1c1c737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:00.625843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387d275-072d-4f57-a9d0-b37af1c1c737 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:00.626930 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387d275-072d-4f57-a9d0-b37af1c1c737 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:00.627292 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359dc64-524d-4387-bf68-e633417ca79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:00.628800 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387d275-072d-4f57-a9d0-b37af1c1c737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:00.630999 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359dc64-524d-4387-bf68-e633417ca79f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:00.631521 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359dc64-524d-4387-bf68-e633417ca79f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:00.631988 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359dc64-524d-4387-bf68-e633417ca79f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:00.633286 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387d275-072d-4f57-a9d0-b37af1c1c737 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:00.648255 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 209/422] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:55:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:00.656256 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387d275-072d-4f57-a9d0-b37af1c1c737 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:00.663098 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359dc64-524d-4387-bf68-e633417ca79f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:00.668094 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387d275-072d-4f57-a9d0-b37af1c1c737 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:00.670502 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-b359dc64-524d-4387-bf68-e633417ca79f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 03:55:00.672038 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 214/423] 10.222.0.54 () {56 vars in 1135 bytes} [Tue Nov 23 03:55:00 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:00.673458 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24764c4-a906-4305-88c5-f134124cd588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:00.674562 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24764c4-a906-4305-88c5-f134124cd588 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:00.675623 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24764c4-a906-4305-88c5-f134124cd588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:00.676093 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24764c4-a906-4305-88c5-f134124cd588 admin admin] PATH_INFO: `/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:00.677564 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24764c4-a906-4305-88c5-f134124cd588 admin admin] RBAC: Authorizing `identity:get_group(group_id=cc1b96aa42ae46b2b1a2320b3a38c43d)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:00.678879 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359dc64-524d-4387-bf68-e633417ca79f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:00.680163 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24764c4-a906-4305-88c5-f134124cd588 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:00.682974 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 210/424] 10.222.0.54 () {56 vars in 1201 bytes} [Tue Nov 23 03:55:00 2021] GET /identity/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:00.690089 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24764c4-a906-4305-88c5-f134124cd588 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:00.692417 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359dc64-524d-4387-bf68-e633417ca79f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:00.700520 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e161cb4-f4ab-470e-bdb5-fb156bf24907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:00.701187 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e161cb4-f4ab-470e-bdb5-fb156bf24907 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:00.701470 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e161cb4-f4ab-470e-bdb5-fb156bf24907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:00.701746 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e161cb4-f4ab-470e-bdb5-fb156bf24907 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:00.702512 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e161cb4-f4ab-470e-bdb5-fb156bf24907 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:00.702821 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e161cb4-f4ab-470e-bdb5-fb156bf24907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:00.703778 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24764c4-a906-4305-88c5-f134124cd588 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:00.704487 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e161cb4-f4ab-470e-bdb5-fb156bf24907 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:00.714542 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ec02a-ec67-43d4-9948-a37ce65ab16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:00.715765 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ec02a-ec67-43d4-9948-a37ce65ab16d admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:00.716242 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ec02a-ec67-43d4-9948-a37ce65ab16d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:00.716705 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ec02a-ec67-43d4-9948-a37ce65ab16d admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:00.716920 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 215/425] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:00 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:00.718284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ec02a-ec67-43d4-9948-a37ce65ab16d admin admin] RBAC: Authorizing `identity:get_project(project_id=66d1377d6a7d40f798138de207208f9e)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:00.720415 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ec02a-ec67-43d4-9948-a37ce65ab16d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:00.723249 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 211/426] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:55:00 2021] GET /identity/v3/projects/66d1377d6a7d40f798138de207208f9e => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:00.727350 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e161cb4-f4ab-470e-bdb5-fb156bf24907 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:00.730027 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ec02a-ec67-43d4-9948-a37ce65ab16d admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:00.738203 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e161cb4-f4ab-470e-bdb5-fb156bf24907 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:00.745427 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ec02a-ec67-43d4-9948-a37ce65ab16d admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:00.746777 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff7c74-28b2-4124-9274-b229926b9598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:00.747835 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff7c74-28b2-4124-9274-b229926b9598 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:00.748258 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff7c74-28b2-4124-9274-b229926b9598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:00.748652 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff7c74-28b2-4124-9274-b229926b9598 admin admin] PATH_INFO: `/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:00.750070 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff7c74-28b2-4124-9274-b229926b9598 admin admin] RBAC: Authorizing `identity:get_group(group_id=cc1b96aa42ae46b2b1a2320b3a38c43d)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:00.750888 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524db5c1-dadd-460b-87d1-8bb623ff3c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:00.751970 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524db5c1-dadd-460b-87d1-8bb623ff3c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:00.752394 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524db5c1-dadd-460b-87d1-8bb623ff3c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:00.752509 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff7c74-28b2-4124-9274-b229926b9598 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:00.753797 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524db5c1-dadd-460b-87d1-8bb623ff3c58 admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e/groups/cc1b96aa42ae46b2b1a2320b3a38c43d/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:00.755130 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 216/427] 10.222.0.54 () {56 vars in 1201 bytes} [Tue Nov 23 03:55:00 2021] GET /identity/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:00.758557 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524db5c1-dadd-460b-87d1-8bb623ff3c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d1377d6a7d40f798138de207208f9e, group_id=cc1b96aa42ae46b2b1a2320b3a38c43d, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:00.761651 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524db5c1-dadd-460b-87d1-8bb623ff3c58 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:00.761971 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff7c74-28b2-4124-9274-b229926b9598 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:00.776853 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff7c74-28b2-4124-9274-b229926b9598 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:00.782164 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdf28b-eea2-47a4-a76c-44328755f680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:00.783128 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdf28b-eea2-47a4-a76c-44328755f680 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:00.789480 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdf28b-eea2-47a4-a76c-44328755f680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:00.789480 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdf28b-eea2-47a4-a76c-44328755f680 admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:00.789480 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdf28b-eea2-47a4-a76c-44328755f680 admin admin] RBAC: Authorizing `identity:get_project(project_id=66d1377d6a7d40f798138de207208f9e)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:00.789480 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdf28b-eea2-47a4-a76c-44328755f680 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:00.791505 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 217/428] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:55:00 2021] GET /identity/v3/projects/66d1377d6a7d40f798138de207208f9e => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:00.798280 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdf28b-eea2-47a4-a76c-44328755f680 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:00.818566 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdf28b-eea2-47a4-a76c-44328755f680 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:00.827525 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cdeee-ea0c-4943-a80c-31cb5048b5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:00.828586 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cdeee-ea0c-4943-a80c-31cb5048b5fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:00.828870 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cdeee-ea0c-4943-a80c-31cb5048b5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:00.829146 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cdeee-ea0c-4943-a80c-31cb5048b5fe admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e/groups/cc1b96aa42ae46b2b1a2320b3a38c43d/roles/e8e5c21f4bea46318bef0c9784214ce6` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:00.831633 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cdeee-ea0c-4943-a80c-31cb5048b5fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d1377d6a7d40f798138de207208f9e, group_id=cc1b96aa42ae46b2b1a2320b3a38c43d, role_id=e8e5c21f4bea46318bef0c9784214ce6)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:00.834594 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cdeee-ea0c-4943-a80c-31cb5048b5fe admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:00.889039 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 212/429] 10.222.0.54 () {58 vars in 1463 bytes} [Tue Nov 23 03:55:00 2021] PUT /identity/v3/projects/66d1377d6a7d40f798138de207208f9e/groups/cc1b96aa42ae46b2b1a2320b3a38c43d/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 03:55:00.928526 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 218/430] 10.222.0.54 () {58 vars in 1463 bytes} [Tue Nov 23 03:55:00 2021] PUT /identity/v3/projects/66d1377d6a7d40f798138de207208f9e/groups/cc1b96aa42ae46b2b1a2320b3a38c43d/roles/e8e5c21f4bea46318bef0c9784214ce6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:55:01.360192 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b1a1c-1fe0-41ec-85e6-b5d3038851db None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:01.360705 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b1a1c-1fe0-41ec-85e6-b5d3038851db None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:01.360788 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b1a1c-1fe0-41ec-85e6-b5d3038851db None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:01.362767 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 213/431] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:01.369312 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492d807-53a2-4c20-8572-5f8c2ed5226d None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:01.369799 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492d807-53a2-4c20-8572-5f8c2ed5226d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:01.369874 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492d807-53a2-4c20-8572-5f8c2ed5226d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:01.389141 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-a492d807-53a2-4c20-8572-5f8c2ed5226d None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:01.390343 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-a492d807-53a2-4c20-8572-5f8c2ed5226d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:01.458612 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 219/432] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:55:01.493847 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b1a1c-1fe0-41ec-85e6-b5d3038851db None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:01.509476 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b1a1c-1fe0-41ec-85e6-b5d3038851db None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:01.517158 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45707d06-17b2-4f90-b8a8-2e943b3d58a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:01.517989 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45707d06-17b2-4f90-b8a8-2e943b3d58a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:01.518271 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45707d06-17b2-4f90-b8a8-2e943b3d58a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:01.519497 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45707d06-17b2-4f90-b8a8-2e943b3d58a9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:01.532761 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45707d06-17b2-4f90-b8a8-2e943b3d58a9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:01.540292 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-45707d06-17b2-4f90-b8a8-2e943b3d58a9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:55:01.541775 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 214/433] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:55:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:01.548076 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492d807-53a2-4c20-8572-5f8c2ed5226d None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:01.557301 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492d807-53a2-4c20-8572-5f8c2ed5226d None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:01.562711 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55356ab-7db2-4f48-bfec-cd618abb8ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:01.563403 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55356ab-7db2-4f48-bfec-cd618abb8ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:01.563723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55356ab-7db2-4f48-bfec-cd618abb8ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:01.564005 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55356ab-7db2-4f48-bfec-cd618abb8ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:01.564761 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55356ab-7db2-4f48-bfec-cd618abb8ec5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:01.565065 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55356ab-7db2-4f48-bfec-cd618abb8ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:01.567634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55356ab-7db2-4f48-bfec-cd618abb8ec5 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:01.576767 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 220/434] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:55:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:01.583140 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45707d06-17b2-4f90-b8a8-2e943b3d58a9 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:01.594815 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45707d06-17b2-4f90-b8a8-2e943b3d58a9 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:01.601507 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb3941-1b91-4ad5-9b7c-8228058dd713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:01.602386 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb3941-1b91-4ad5-9b7c-8228058dd713 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:01.602670 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb3941-1b91-4ad5-9b7c-8228058dd713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:01.602945 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb3941-1b91-4ad5-9b7c-8228058dd713 admin admin] PATH_INFO: `/v3/groups/a81f286949c54bcda41c28b6f0720680` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:01.604215 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb3941-1b91-4ad5-9b7c-8228058dd713 admin admin] RBAC: Authorizing `identity:get_group(group_id=a81f286949c54bcda41c28b6f0720680)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:01.606198 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb3941-1b91-4ad5-9b7c-8228058dd713 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:01.608122 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 215/435] 10.222.0.54 () {56 vars in 1201 bytes} [Tue Nov 23 03:55:01 2021] GET /identity/v3/groups/a81f286949c54bcda41c28b6f0720680 => generated 229 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:01.617068 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55356ab-7db2-4f48-bfec-cd618abb8ec5 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:01.633653 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55356ab-7db2-4f48-bfec-cd618abb8ec5 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:01.638390 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7c44a-cde6-40b4-a370-c3fea02eb283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:01.639451 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7c44a-cde6-40b4-a370-c3fea02eb283 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:01.639924 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7c44a-cde6-40b4-a370-c3fea02eb283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:01.640373 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7c44a-cde6-40b4-a370-c3fea02eb283 admin admin] PATH_INFO: `/v3/projects/a46903e1a0df4e5bbff165f0dc8442a9` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:01.648013 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7c44a-cde6-40b4-a370-c3fea02eb283 admin admin] RBAC: Authorizing `identity:get_project(project_id=a46903e1a0df4e5bbff165f0dc8442a9)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:01.649979 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7c44a-cde6-40b4-a370-c3fea02eb283 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:01.651859 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 221/436] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:55:01 2021] GET /identity/v3/projects/a46903e1a0df4e5bbff165f0dc8442a9 => generated 344 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:01.658021 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb3941-1b91-4ad5-9b7c-8228058dd713 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:01.672254 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb3941-1b91-4ad5-9b7c-8228058dd713 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:01.679556 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e01ab-7e20-4a1c-be56-fbc6ab444214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:01.680490 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e01ab-7e20-4a1c-be56-fbc6ab444214 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:01.680769 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e01ab-7e20-4a1c-be56-fbc6ab444214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:01.681136 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e01ab-7e20-4a1c-be56-fbc6ab444214 admin admin] PATH_INFO: `/v3/projects/a46903e1a0df4e5bbff165f0dc8442a9/groups/a81f286949c54bcda41c28b6f0720680/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:01.684213 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e01ab-7e20-4a1c-be56-fbc6ab444214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46903e1a0df4e5bbff165f0dc8442a9, group_id=a81f286949c54bcda41c28b6f0720680, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:01.686916 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e01ab-7e20-4a1c-be56-fbc6ab444214 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:01.780199 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 216/437] 10.222.0.54 () {58 vars in 1463 bytes} [Tue Nov 23 03:55:01 2021] PUT /identity/v3/projects/a46903e1a0df4e5bbff165f0dc8442a9/groups/a81f286949c54bcda41c28b6f0720680/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:55:02.511488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e385b-5550-4593-820b-bdc13d63b1cd None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:02.512482 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e385b-5550-4593-820b-bdc13d63b1cd None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:02.512996 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e385b-5550-4593-820b-bdc13d63b1cd None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:02.515415 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 222/438] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:02.521701 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18557145-36af-4a96-91b1-211caf20435b None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:02.522585 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18557145-36af-4a96-91b1-211caf20435b None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:02.523058 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18557145-36af-4a96-91b1-211caf20435b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:02.547384 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-18557145-36af-4a96-91b1-211caf20435b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:02.549000 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-18557145-36af-4a96-91b1-211caf20435b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:02.624446 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 217/439] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:55:02.684517 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e385b-5550-4593-820b-bdc13d63b1cd None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:02.700181 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e385b-5550-4593-820b-bdc13d63b1cd None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:02.704824 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113a970-9dc8-40a8-992d-fb33bf649f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:02.705839 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113a970-9dc8-40a8-992d-fb33bf649f99 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:02.706848 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113a970-9dc8-40a8-992d-fb33bf649f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:02.707342 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113a970-9dc8-40a8-992d-fb33bf649f99 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:02.728485 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113a970-9dc8-40a8-992d-fb33bf649f99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:02.735708 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-0113a970-9dc8-40a8-992d-fb33bf649f99 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 03:55:02.743509 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 223/440] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:55:02 2021] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:02.744314 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18557145-36af-4a96-91b1-211caf20435b None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:02.758021 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18557145-36af-4a96-91b1-211caf20435b None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:02.765407 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88cc45-7191-4cc1-af96-7a7558bb78a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:02.766008 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88cc45-7191-4cc1-af96-7a7558bb78a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:02.766287 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88cc45-7191-4cc1-af96-7a7558bb78a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:02.766556 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88cc45-7191-4cc1-af96-7a7558bb78a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:02.767435 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88cc45-7191-4cc1-af96-7a7558bb78a6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:02.767737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88cc45-7191-4cc1-af96-7a7558bb78a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:02.770030 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88cc45-7191-4cc1-af96-7a7558bb78a6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:02.782749 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 218/441] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:55:02 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:02.789172 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113a970-9dc8-40a8-992d-fb33bf649f99 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:02.800242 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113a970-9dc8-40a8-992d-fb33bf649f99 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:02.810853 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f0f01-197c-4b9e-ae59-ef52894c1e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:02.811788 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f0f01-197c-4b9e-ae59-ef52894c1e69 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:02.812265 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f0f01-197c-4b9e-ae59-ef52894c1e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:02.812728 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f0f01-197c-4b9e-ae59-ef52894c1e69 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:02.821743 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f0f01-197c-4b9e-ae59-ef52894c1e69 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:02.823786 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f0f01-197c-4b9e-ae59-ef52894c1e69 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:02.837660 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 224/442] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:02 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:55:02.843538 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88cc45-7191-4cc1-af96-7a7558bb78a6 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:02.853618 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88cc45-7191-4cc1-af96-7a7558bb78a6 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:02.863166 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a884c00-70e0-4e29-9df7-09c753b0b0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:02.864320 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a884c00-70e0-4e29-9df7-09c753b0b0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:02.864797 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a884c00-70e0-4e29-9df7-09c753b0b0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:02.865261 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a884c00-70e0-4e29-9df7-09c753b0b0a1 admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:02.866674 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a884c00-70e0-4e29-9df7-09c753b0b0a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=04deb99f5f1a4beba726c6ac86a84723)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:02.868929 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a884c00-70e0-4e29-9df7-09c753b0b0a1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:02.871098 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 219/443] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:55:02 2021] GET /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:02.876742 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f0f01-197c-4b9e-ae59-ef52894c1e69 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:02.887442 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f0f01-197c-4b9e-ae59-ef52894c1e69 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:02.895667 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779b885-7cb5-431b-9278-cc5b908cf2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:02.896750 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779b885-7cb5-431b-9278-cc5b908cf2eb admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:02.897249 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779b885-7cb5-431b-9278-cc5b908cf2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:02.897739 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779b885-7cb5-431b-9278-cc5b908cf2eb admin admin] PATH_INFO: `/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:02.904037 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779b885-7cb5-431b-9278-cc5b908cf2eb admin admin] RBAC: Authorizing `identity:get_group(group_id=cc1b96aa42ae46b2b1a2320b3a38c43d)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:02.905939 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779b885-7cb5-431b-9278-cc5b908cf2eb admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:02.907624 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 225/444] 10.222.0.54 () {56 vars in 1201 bytes} [Tue Nov 23 03:55:02 2021] GET /identity/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:02.914703 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a884c00-70e0-4e29-9df7-09c753b0b0a1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:02.928325 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a884c00-70e0-4e29-9df7-09c753b0b0a1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:02.939836 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bb5cd-f20f-47a4-aef1-6a27412bdfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:02.941010 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bb5cd-f20f-47a4-aef1-6a27412bdfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:02.941325 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bb5cd-f20f-47a4-aef1-6a27412bdfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:02.941651 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bb5cd-f20f-47a4-aef1-6a27412bdfd2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:02.942757 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4bb5cd-f20f-47a4-aef1-6a27412bdfd2 admin admin] RBAC: Adding query filter params (group.id=cc1b96aa42ae46b2b1a2320b3a38c43d, role.id=c817e9fe7d034dd4ac25b1f45fd209c7, scope.project.id=04deb99f5f1a4beba726c6ac86a84723) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:02.943071 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4bb5cd-f20f-47a4-aef1-6a27412bdfd2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:02.944926 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4bb5cd-f20f-47a4-aef1-6a27412bdfd2 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:02.951545 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 220/445] 10.222.0.54 () {56 vars in 1397 bytes} [Tue Nov 23 03:55:02 2021] GET /identity/v3/role_assignments?group.id=cc1b96aa42ae46b2b1a2320b3a38c43d&scope.project.id=04deb99f5f1a4beba726c6ac86a84723&role.id=c817e9fe7d034dd4ac25b1f45fd209c7 => generated 611 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:03.504626 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc05ae9-3762-4764-b5a5-219bba932b7e None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:03.504995 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc05ae9-3762-4764-b5a5-219bba932b7e None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:03.505184 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc05ae9-3762-4764-b5a5-219bba932b7e None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:03.507132 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 226/446] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:03.513792 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2f8c6-6d90-4794-a391-06070be36aae None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:03.514069 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2f8c6-6d90-4794-a391-06070be36aae None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:03.514354 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2f8c6-6d90-4794-a391-06070be36aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:03.536136 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-e4f2f8c6-6d90-4794-a391-06070be36aae None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:03.537362 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-e4f2f8c6-6d90-4794-a391-06070be36aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:03.547506 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 221/447] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:55:03.573800 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc05ae9-3762-4764-b5a5-219bba932b7e None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:03.586370 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc05ae9-3762-4764-b5a5-219bba932b7e None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:03.592275 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed16b4-a397-4cd6-8aa5-97c6468cface admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:03.593075 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed16b4-a397-4cd6-8aa5-97c6468cface admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:03.593357 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed16b4-a397-4cd6-8aa5-97c6468cface admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:03.593634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed16b4-a397-4cd6-8aa5-97c6468cface admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:03.608373 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed16b4-a397-4cd6-8aa5-97c6468cface admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:03.616505 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-0eed16b4-a397-4cd6-8aa5-97c6468cface admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 03:55:03.621256 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 227/448] 10.222.0.54 () {56 vars in 1135 bytes} [Tue Nov 23 03:55:03 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:03.624332 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2f8c6-6d90-4794-a391-06070be36aae None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:03.633990 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2f8c6-6d90-4794-a391-06070be36aae None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:03.641973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b0543-0dea-4621-8d07-43df250b29c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:03.642651 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b0543-0dea-4621-8d07-43df250b29c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:03.642933 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b0543-0dea-4621-8d07-43df250b29c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:03.643236 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b0543-0dea-4621-8d07-43df250b29c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:03.644058 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b0543-0dea-4621-8d07-43df250b29c7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:03.644465 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b0543-0dea-4621-8d07-43df250b29c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:03.646094 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b0543-0dea-4621-8d07-43df250b29c7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:03.656079 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 222/449] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:03 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:03.662568 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed16b4-a397-4cd6-8aa5-97c6468cface admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:03.676993 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed16b4-a397-4cd6-8aa5-97c6468cface admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:03.684110 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea055f1-0a9c-498d-83be-5d82563468ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:03.684788 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea055f1-0a9c-498d-83be-5d82563468ee admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:03.685128 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea055f1-0a9c-498d-83be-5d82563468ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:03.685467 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea055f1-0a9c-498d-83be-5d82563468ee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:03.699767 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea055f1-0a9c-498d-83be-5d82563468ee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:03.701557 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea055f1-0a9c-498d-83be-5d82563468ee admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:03.714652 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 228/450] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:55:03.720917 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b0543-0dea-4621-8d07-43df250b29c7 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:03.732959 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b0543-0dea-4621-8d07-43df250b29c7 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:03.747557 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a3caf-fd03-41d1-8997-e1ac9dbf64a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:03.748425 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a3caf-fd03-41d1-8997-e1ac9dbf64a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:03.748703 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a3caf-fd03-41d1-8997-e1ac9dbf64a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:03.748973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a3caf-fd03-41d1-8997-e1ac9dbf64a5 admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:03.750783 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a3caf-fd03-41d1-8997-e1ac9dbf64a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=04deb99f5f1a4beba726c6ac86a84723)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:03.753455 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a3caf-fd03-41d1-8997-e1ac9dbf64a5 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:03.756754 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 223/451] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:55:03 2021] GET /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:03.762708 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea055f1-0a9c-498d-83be-5d82563468ee admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:03.773423 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea055f1-0a9c-498d-83be-5d82563468ee admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:03.782284 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8155226-cd90-4267-95ea-cf033bad7ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:03.783196 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8155226-cd90-4267-95ea-cf033bad7ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:03.783504 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8155226-cd90-4267-95ea-cf033bad7ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:03.783827 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8155226-cd90-4267-95ea-cf033bad7ed9 admin admin] PATH_INFO: `/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:03.786341 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8155226-cd90-4267-95ea-cf033bad7ed9 admin admin] RBAC: Authorizing `identity:get_group(group_id=cc1b96aa42ae46b2b1a2320b3a38c43d)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:03.788388 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8155226-cd90-4267-95ea-cf033bad7ed9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:03.795332 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 229/452] 10.222.0.54 () {56 vars in 1201 bytes} [Tue Nov 23 03:55:03 2021] GET /identity/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:03.797295 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a3caf-fd03-41d1-8997-e1ac9dbf64a5 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:03.808681 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a3caf-fd03-41d1-8997-e1ac9dbf64a5 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:03.818907 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ceb67c-b0c1-4c3f-a89f-309523257e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:03.819862 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ceb67c-b0c1-4c3f-a89f-309523257e53 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:03.820327 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ceb67c-b0c1-4c3f-a89f-309523257e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:03.820782 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ceb67c-b0c1-4c3f-a89f-309523257e53 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:03.821805 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ceb67c-b0c1-4c3f-a89f-309523257e53 admin admin] RBAC: Adding query filter params (group.id=cc1b96aa42ae46b2b1a2320b3a38c43d, role.id=e8e5c21f4bea46318bef0c9784214ce6, scope.project.id=04deb99f5f1a4beba726c6ac86a84723) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:03.822310 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ceb67c-b0c1-4c3f-a89f-309523257e53 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:03.824431 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ceb67c-b0c1-4c3f-a89f-309523257e53 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:03.833077 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 224/453] 10.222.0.54 () {56 vars in 1397 bytes} [Tue Nov 23 03:55:03 2021] GET /identity/v3/role_assignments?group.id=cc1b96aa42ae46b2b1a2320b3a38c43d&scope.project.id=04deb99f5f1a4beba726c6ac86a84723&role.id=e8e5c21f4bea46318bef0c9784214ce6 => generated 611 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:03.876618 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234713e1-110f-424f-b33b-24f7410e0fbf None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:03.876923 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234713e1-110f-424f-b33b-24f7410e0fbf None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:03.877174 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234713e1-110f-424f-b33b-24f7410e0fbf None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:03.879944 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 230/454] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:03.886729 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da2b2d-5dc8-4771-8bcc-45da49a90d03 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:03.887355 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da2b2d-5dc8-4771-8bcc-45da49a90d03 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:03.887831 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da2b2d-5dc8-4771-8bcc-45da49a90d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:03.897232 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a7d8a-65fd-4079-af76-9ebf0f7a01d0 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:03.897566 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a7d8a-65fd-4079-af76-9ebf0f7a01d0 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:03.897784 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a7d8a-65fd-4079-af76-9ebf0f7a01d0 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:03.899930 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 231/455] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:55:03.906302 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0696b-65f6-4bcc-afd8-c1d8dfce3787 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:03.906620 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0696b-65f6-4bcc-afd8-c1d8dfce3787 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:03.906875 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0696b-65f6-4bcc-afd8-c1d8dfce3787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:03.916437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-a3da2b2d-5dc8-4771-8bcc-45da49a90d03 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:03.918034 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-a3da2b2d-5dc8-4771-8bcc-45da49a90d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:03.926586 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-d8f0696b-65f6-4bcc-afd8-c1d8dfce3787 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:03.927932 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-d8f0696b-65f6-4bcc-afd8-c1d8dfce3787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:03.934061 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 225/456] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:55:03.935829 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 232/457] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:55:03.974752 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da2b2d-5dc8-4771-8bcc-45da49a90d03 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:03.984319 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da2b2d-5dc8-4771-8bcc-45da49a90d03 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:03.990858 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0696b-65f6-4bcc-afd8-c1d8dfce3787 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:03.996644 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f2798-9c18-481a-ac4c-36f8e1a31484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:03.998963 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f2798-9c18-481a-ac4c-36f8e1a31484 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:03.999733 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f2798-9c18-481a-ac4c-36f8e1a31484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:04.002081 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0696b-65f6-4bcc-afd8-c1d8dfce3787 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:04.003609 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f2798-9c18-481a-ac4c-36f8e1a31484 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:04.013655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9958e8-1751-4561-ab7e-e3196497eaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:04.014819 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9958e8-1751-4561-ab7e-e3196497eaf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:04.015342 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9958e8-1751-4561-ab7e-e3196497eaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:04.015821 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9958e8-1751-4561-ab7e-e3196497eaf6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:04.026931 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f2798-9c18-481a-ac4c-36f8e1a31484 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:04.035179 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-f78f2798-9c18-481a-ac4c-36f8e1a31484 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 03:55:04.036650 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9958e8-1751-4561-ab7e-e3196497eaf6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:04.037280 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 226/458] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:55:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:04.044360 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-ae9958e8-1751-4561-ab7e-e3196497eaf6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 03:55:04.045674 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f2798-9c18-481a-ac4c-36f8e1a31484 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:04.045856 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 233/459] 10.222.0.54 () {56 vars in 1135 bytes} [Tue Nov 23 03:55:03 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:04.053221 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9958e8-1751-4561-ab7e-e3196497eaf6 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:04.060108 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f2798-9c18-481a-ac4c-36f8e1a31484 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:04.064391 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9958e8-1751-4561-ab7e-e3196497eaf6 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:04.065115 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dad04-5387-454d-b44a-0771e6c03ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:04.066297 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dad04-5387-454d-b44a-0771e6c03ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:04.066807 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dad04-5387-454d-b44a-0771e6c03ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:04.067593 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dad04-5387-454d-b44a-0771e6c03ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:04.068564 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dad04-5387-454d-b44a-0771e6c03ae5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:04.069088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dad04-5387-454d-b44a-0771e6c03ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:04.070863 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dad04-5387-454d-b44a-0771e6c03ae5 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:04.074270 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6d8a8-5e3c-4d6e-93a8-56aca888feea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:04.074995 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6d8a8-5e3c-4d6e-93a8-56aca888feea admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:04.075310 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6d8a8-5e3c-4d6e-93a8-56aca888feea admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:04.075592 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6d8a8-5e3c-4d6e-93a8-56aca888feea admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:04.076514 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6d8a8-5e3c-4d6e-93a8-56aca888feea admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:04.076821 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6d8a8-5e3c-4d6e-93a8-56aca888feea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:04.078976 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6d8a8-5e3c-4d6e-93a8-56aca888feea admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:04.083126 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 227/460] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:55:04 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:04.090978 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dad04-5387-454d-b44a-0771e6c03ae5 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:04.094767 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 234/461] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:04 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:04.102070 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6d8a8-5e3c-4d6e-93a8-56aca888feea admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:04.102824 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dad04-5387-454d-b44a-0771e6c03ae5 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:04.109395 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f61bec-36e1-4c3b-afe6-be800282e832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:04.110044 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f61bec-36e1-4c3b-afe6-be800282e832 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:04.110333 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f61bec-36e1-4c3b-afe6-be800282e832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:04.110596 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f61bec-36e1-4c3b-afe6-be800282e832 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:04.114172 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6d8a8-5e3c-4d6e-93a8-56aca888feea admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:04.122220 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06060e36-9c78-4837-8bbf-8969cc087ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:04.122870 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06060e36-9c78-4837-8bbf-8969cc087ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:04.123154 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06060e36-9c78-4837-8bbf-8969cc087ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:04.123548 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06060e36-9c78-4837-8bbf-8969cc087ed7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:04.124007 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f61bec-36e1-4c3b-afe6-be800282e832 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:04.125902 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f61bec-36e1-4c3b-afe6-be800282e832 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:04.133013 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06060e36-9c78-4837-8bbf-8969cc087ed7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:04.135504 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06060e36-9c78-4837-8bbf-8969cc087ed7 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:04.138015 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 228/462] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:04 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:55:04.144771 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f61bec-36e1-4c3b-afe6-be800282e832 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:04.148371 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 235/463] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:04 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:55:04.154050 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f61bec-36e1-4c3b-afe6-be800282e832 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:04.155383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06060e36-9c78-4837-8bbf-8969cc087ed7 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:04.158552 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46b161-41b8-425a-9508-27fa6e24a182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:04.159601 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46b161-41b8-425a-9508-27fa6e24a182 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:04.159884 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46b161-41b8-425a-9508-27fa6e24a182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:04.160163 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46b161-41b8-425a-9508-27fa6e24a182 admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:04.161441 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46b161-41b8-425a-9508-27fa6e24a182 admin admin] RBAC: Authorizing `identity:get_project(project_id=66d1377d6a7d40f798138de207208f9e)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:04.163643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46b161-41b8-425a-9508-27fa6e24a182 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:04.165644 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 229/464] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:55:04 2021] GET /identity/v3/projects/66d1377d6a7d40f798138de207208f9e => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:04.166993 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06060e36-9c78-4837-8bbf-8969cc087ed7 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:04.172991 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46b161-41b8-425a-9508-27fa6e24a182 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:04.174480 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9e338-a09f-463b-950f-144f6a39a62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:04.176327 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9e338-a09f-463b-950f-144f6a39a62f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:04.176789 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9e338-a09f-463b-950f-144f6a39a62f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:04.177232 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9e338-a09f-463b-950f-144f6a39a62f admin admin] PATH_INFO: `/v3/projects/66d1377d6a7d40f798138de207208f9e` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:04.178799 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9e338-a09f-463b-950f-144f6a39a62f admin admin] RBAC: Authorizing `identity:get_project(project_id=66d1377d6a7d40f798138de207208f9e)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:04.181110 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9e338-a09f-463b-950f-144f6a39a62f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:04.186235 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46b161-41b8-425a-9508-27fa6e24a182 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:04.186602 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 236/465] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:55:04 2021] GET /identity/v3/projects/66d1377d6a7d40f798138de207208f9e => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:04.190595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9e338-a09f-463b-950f-144f6a39a62f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:04.194244 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92ff24-cf0b-4506-a407-48eadeb8e869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:04.195099 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92ff24-cf0b-4506-a407-48eadeb8e869 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:04.195405 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92ff24-cf0b-4506-a407-48eadeb8e869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:04.195710 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92ff24-cf0b-4506-a407-48eadeb8e869 admin admin] PATH_INFO: `/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:04.198317 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92ff24-cf0b-4506-a407-48eadeb8e869 admin admin] RBAC: Authorizing `identity:get_group(group_id=cc1b96aa42ae46b2b1a2320b3a38c43d)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:04.201616 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9e338-a09f-463b-950f-144f6a39a62f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:04.202241 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92ff24-cf0b-4506-a407-48eadeb8e869 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:04.204320 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 230/466] 10.222.0.54 () {56 vars in 1201 bytes} [Tue Nov 23 03:55:04 2021] GET /identity/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:04.208176 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d118f-670b-4748-b9ce-73463e8ff677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:04.209268 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d118f-670b-4748-b9ce-73463e8ff677 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:04.209728 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d118f-670b-4748-b9ce-73463e8ff677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:04.210178 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d118f-670b-4748-b9ce-73463e8ff677 admin admin] PATH_INFO: `/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:04.211019 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92ff24-cf0b-4506-a407-48eadeb8e869 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:04.211778 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d118f-670b-4748-b9ce-73463e8ff677 admin admin] RBAC: Authorizing `identity:get_group(group_id=cc1b96aa42ae46b2b1a2320b3a38c43d)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:04.213906 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d118f-670b-4748-b9ce-73463e8ff677 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:04.215824 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 237/467] 10.222.0.54 () {56 vars in 1201 bytes} [Tue Nov 23 03:55:04 2021] GET /identity/v3/groups/cc1b96aa42ae46b2b1a2320b3a38c43d => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:04.220698 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92ff24-cf0b-4506-a407-48eadeb8e869 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:04.221910 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d118f-670b-4748-b9ce-73463e8ff677 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:04.225600 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0053ed4-b332-41dd-bac2-4ed4eb4d5bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:04.226238 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0053ed4-b332-41dd-bac2-4ed4eb4d5bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:04.226521 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0053ed4-b332-41dd-bac2-4ed4eb4d5bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:04.226788 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0053ed4-b332-41dd-bac2-4ed4eb4d5bd8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:04.227662 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0053ed4-b332-41dd-bac2-4ed4eb4d5bd8 admin admin] RBAC: Adding query filter params (group.id=cc1b96aa42ae46b2b1a2320b3a38c43d, role.id=c817e9fe7d034dd4ac25b1f45fd209c7, scope.project.id=66d1377d6a7d40f798138de207208f9e) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:04.227969 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0053ed4-b332-41dd-bac2-4ed4eb4d5bd8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:04.229783 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0053ed4-b332-41dd-bac2-4ed4eb4d5bd8 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:04.232106 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d118f-670b-4748-b9ce-73463e8ff677 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:04.236659 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 231/468] 10.222.0.54 () {56 vars in 1397 bytes} [Tue Nov 23 03:55:04 2021] GET /identity/v3/role_assignments?group.id=cc1b96aa42ae46b2b1a2320b3a38c43d&scope.project.id=66d1377d6a7d40f798138de207208f9e&role.id=c817e9fe7d034dd4ac25b1f45fd209c7 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:04.236785 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cb872-ae77-47ae-95fc-f78134442404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:04.243261 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cb872-ae77-47ae-95fc-f78134442404 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:04.243261 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cb872-ae77-47ae-95fc-f78134442404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:04.243261 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cb872-ae77-47ae-95fc-f78134442404 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:04.243261 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cb872-ae77-47ae-95fc-f78134442404 admin admin] RBAC: Adding query filter params (group.id=cc1b96aa42ae46b2b1a2320b3a38c43d, role.id=e8e5c21f4bea46318bef0c9784214ce6, scope.project.id=66d1377d6a7d40f798138de207208f9e) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:04.243261 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cb872-ae77-47ae-95fc-f78134442404 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:04.243681 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cb872-ae77-47ae-95fc-f78134442404 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:04.251421 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 238/469] 10.222.0.54 () {56 vars in 1397 bytes} [Tue Nov 23 03:55:04 2021] GET /identity/v3/role_assignments?group.id=cc1b96aa42ae46b2b1a2320b3a38c43d&scope.project.id=66d1377d6a7d40f798138de207208f9e&role.id=e8e5c21f4bea46318bef0c9784214ce6 => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:04.825205 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8f24a-dd17-410a-ab2f-a00944c24fd7 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:04.825698 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8f24a-dd17-410a-ab2f-a00944c24fd7 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:04.825779 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8f24a-dd17-410a-ab2f-a00944c24fd7 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:04.827820 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 232/470] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:04.834069 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ff305-81c8-4de4-8c4d-a8a1986e1ec2 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:04.834502 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ff305-81c8-4de4-8c4d-a8a1986e1ec2 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:04.834621 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ff305-81c8-4de4-8c4d-a8a1986e1ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:04.852259 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-aa0ff305-81c8-4de4-8c4d-a8a1986e1ec2 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:04.853441 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-aa0ff305-81c8-4de4-8c4d-a8a1986e1ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:04.861084 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 239/471] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:55:04.885852 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8f24a-dd17-410a-ab2f-a00944c24fd7 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:04.898031 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8f24a-dd17-410a-ab2f-a00944c24fd7 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:04.902313 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f04db6-174c-4011-8bc9-f3d6339446c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:04.903082 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f04db6-174c-4011-8bc9-f3d6339446c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:04.903398 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f04db6-174c-4011-8bc9-f3d6339446c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:04.903685 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f04db6-174c-4011-8bc9-f3d6339446c2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:04.916095 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f04db6-174c-4011-8bc9-f3d6339446c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:04.922879 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-b5f04db6-174c-4011-8bc9-f3d6339446c2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:55:04.926013 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 233/472] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:55:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:04.931393 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ff305-81c8-4de4-8c4d-a8a1986e1ec2 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:04.940971 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ff305-81c8-4de4-8c4d-a8a1986e1ec2 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:04.945889 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43368568-92a0-4b6c-a22c-520ac81bdf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:04.946553 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43368568-92a0-4b6c-a22c-520ac81bdf5f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:04.946839 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43368568-92a0-4b6c-a22c-520ac81bdf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:04.947116 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43368568-92a0-4b6c-a22c-520ac81bdf5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:04.947914 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43368568-92a0-4b6c-a22c-520ac81bdf5f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:04.948225 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43368568-92a0-4b6c-a22c-520ac81bdf5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:04.949798 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43368568-92a0-4b6c-a22c-520ac81bdf5f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:04.958749 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 240/473] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:55:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:04.964794 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f04db6-174c-4011-8bc9-f3d6339446c2 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:04.976148 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f04db6-174c-4011-8bc9-f3d6339446c2 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:04.980534 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb753b-cece-43b2-bfdd-0d76b90ab90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:04.981157 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb753b-cece-43b2-bfdd-0d76b90ab90d admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:04.981443 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb753b-cece-43b2-bfdd-0d76b90ab90d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:04.981716 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb753b-cece-43b2-bfdd-0d76b90ab90d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:04.990666 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb753b-cece-43b2-bfdd-0d76b90ab90d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:04.992551 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb753b-cece-43b2-bfdd-0d76b90ab90d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:05.002267 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 234/474] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:04 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:55:05.008541 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43368568-92a0-4b6c-a22c-520ac81bdf5f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:05.017972 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43368568-92a0-4b6c-a22c-520ac81bdf5f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:05.022763 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4e3ea-c3f0-4881-a4eb-4d0137ddb755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:05.023635 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4e3ea-c3f0-4881-a4eb-4d0137ddb755 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:05.023914 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4e3ea-c3f0-4881-a4eb-4d0137ddb755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:05.024179 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4e3ea-c3f0-4881-a4eb-4d0137ddb755 admin admin] PATH_INFO: `/v3/projects/a46903e1a0df4e5bbff165f0dc8442a9` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:05.025378 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4e3ea-c3f0-4881-a4eb-4d0137ddb755 admin admin] RBAC: Authorizing `identity:get_project(project_id=a46903e1a0df4e5bbff165f0dc8442a9)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:05.027259 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4e3ea-c3f0-4881-a4eb-4d0137ddb755 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:05.028892 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 241/475] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:55:05 2021] GET /identity/v3/projects/a46903e1a0df4e5bbff165f0dc8442a9 => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:05.034928 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb753b-cece-43b2-bfdd-0d76b90ab90d admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:05.043858 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb753b-cece-43b2-bfdd-0d76b90ab90d admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:05.051312 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f75c2d-3c3b-4b14-801c-7a4d17c235d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:05.052155 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f75c2d-3c3b-4b14-801c-7a4d17c235d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:05.052436 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f75c2d-3c3b-4b14-801c-7a4d17c235d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:05.052711 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f75c2d-3c3b-4b14-801c-7a4d17c235d1 admin admin] PATH_INFO: `/v3/groups/a81f286949c54bcda41c28b6f0720680` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:05.053905 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f75c2d-3c3b-4b14-801c-7a4d17c235d1 admin admin] RBAC: Authorizing `identity:get_group(group_id=a81f286949c54bcda41c28b6f0720680)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:05.055849 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f75c2d-3c3b-4b14-801c-7a4d17c235d1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:05.057438 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 235/476] 10.222.0.54 () {56 vars in 1201 bytes} [Tue Nov 23 03:55:05 2021] GET /identity/v3/groups/a81f286949c54bcda41c28b6f0720680 => generated 229 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:05.063758 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4e3ea-c3f0-4881-a4eb-4d0137ddb755 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:05.073843 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4e3ea-c3f0-4881-a4eb-4d0137ddb755 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:05.078224 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46fe37-b9e2-4ac8-b39c-05be22e99305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:05.078858 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46fe37-b9e2-4ac8-b39c-05be22e99305 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:05.079147 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46fe37-b9e2-4ac8-b39c-05be22e99305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:05.079465 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46fe37-b9e2-4ac8-b39c-05be22e99305 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:05.080296 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46fe37-b9e2-4ac8-b39c-05be22e99305 admin admin] RBAC: Adding query filter params (group.id=a81f286949c54bcda41c28b6f0720680, role.id=3db7012b41944542a50049819500eadd, scope.project.id=a46903e1a0df4e5bbff165f0dc8442a9) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:05.080607 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46fe37-b9e2-4ac8-b39c-05be22e99305 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:05.083147 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46fe37-b9e2-4ac8-b39c-05be22e99305 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:05.089137 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 242/477] 10.222.0.54 () {56 vars in 1397 bytes} [Tue Nov 23 03:55:05 2021] GET /identity/v3/role_assignments?group.id=a81f286949c54bcda41c28b6f0720680&scope.project.id=a46903e1a0df4e5bbff165f0dc8442a9&role.id=3db7012b41944542a50049819500eadd => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:07.906990 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d92a72-d735-44fb-b901-2b6043d186a5 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:07.907517 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d92a72-d735-44fb-b901-2b6043d186a5 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:07.907781 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d92a72-d735-44fb-b901-2b6043d186a5 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:07.909675 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 236/478] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:07.916043 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529b3df-ba95-4dba-afdf-f333dde37251 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:07.916463 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529b3df-ba95-4dba-afdf-f333dde37251 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:07.916635 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529b3df-ba95-4dba-afdf-f333dde37251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:07.944331 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-7529b3df-ba95-4dba-afdf-f333dde37251 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:07.945454 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-7529b3df-ba95-4dba-afdf-f333dde37251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:07.953595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 243/479] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:55:07.987903 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d92a72-d735-44fb-b901-2b6043d186a5 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:08.005211 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d92a72-d735-44fb-b901-2b6043d186a5 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:08.016049 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e41efc-b41d-42b4-abc8-3c1fb4e1a664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:08.016856 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e41efc-b41d-42b4-abc8-3c1fb4e1a664 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:08.017141 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e41efc-b41d-42b4-abc8-3c1fb4e1a664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:08.017410 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e41efc-b41d-42b4-abc8-3c1fb4e1a664 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:08.034995 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e41efc-b41d-42b4-abc8-3c1fb4e1a664 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:08.036848 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e41efc-b41d-42b4-abc8-3c1fb4e1a664 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:08.062338 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-81e41efc-b41d-42b4-abc8-3c1fb4e1a664 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:08.063971 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 237/480] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:08.070617 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529b3df-ba95-4dba-afdf-f333dde37251 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:08.085490 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529b3df-ba95-4dba-afdf-f333dde37251 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:08.095957 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5ac8e-3d8f-4cd5-97ec-3a439a4327f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:08.096857 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5ac8e-3d8f-4cd5-97ec-3a439a4327f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:08.097146 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5ac8e-3d8f-4cd5-97ec-3a439a4327f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:08.097425 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5ac8e-3d8f-4cd5-97ec-3a439a4327f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:08.098217 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5ac8e-3d8f-4cd5-97ec-3a439a4327f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:08.098536 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5ac8e-3d8f-4cd5-97ec-3a439a4327f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:08.099588 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING py.warnings [None req-7fb5ac8e-3d8f-4cd5-97ec-3a439a4327f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:55:08.099588 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: warnings.warn(msg) Nov 23 03:55:08.099588 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: Nov 23 03:55:08.100483 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5ac8e-3d8f-4cd5-97ec-3a439a4327f0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:08.126707 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 244/481] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:08.133285 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e41efc-b41d-42b4-abc8-3c1fb4e1a664 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:08.148338 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e41efc-b41d-42b4-abc8-3c1fb4e1a664 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:08.155242 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d1c72-f014-4e7c-bde8-108d1e90dd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:08.155899 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d1c72-f014-4e7c-bde8-108d1e90dd25 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:08.156178 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d1c72-f014-4e7c-bde8-108d1e90dd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:08.156450 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d1c72-f014-4e7c-bde8-108d1e90dd25 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:08.157171 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d1c72-f014-4e7c-bde8-108d1e90dd25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:08.159626 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d1c72-f014-4e7c-bde8-108d1e90dd25 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:08.224232 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a50d7-b0bc-4103-acd8-8920db2c1dcb None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:08.224528 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a50d7-b0bc-4103-acd8-8920db2c1dcb None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:08.224685 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a50d7-b0bc-4103-acd8-8920db2c1dcb None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:08.226732 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 245/482] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:55:08.232139 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41049d59-4006-4835-803e-dd9fe057b81e None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:08.232422 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41049d59-4006-4835-803e-dd9fe057b81e None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:08.232705 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41049d59-4006-4835-803e-dd9fe057b81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:08.251360 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-41049d59-4006-4835-803e-dd9fe057b81e None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:08.253224 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-41049d59-4006-4835-803e-dd9fe057b81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:08.261166 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 246/483] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:55:08.262430 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef455979-a275-4eb3-9d56-91a545787da5 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:08.262718 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef455979-a275-4eb3-9d56-91a545787da5 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:08.262995 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef455979-a275-4eb3-9d56-91a545787da5 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:08.264777 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 247/484] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:08.272061 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 238/485] 10.222.0.54 () {60 vars in 1153 bytes} [Tue Nov 23 03:55:08 2021] POST /identity/v3/users => generated 246 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:55:08.277211 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560c56d-859f-41a3-9cf4-1abd5a90807e None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:08.277497 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560c56d-859f-41a3-9cf4-1abd5a90807e None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:08.277777 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560c56d-859f-41a3-9cf4-1abd5a90807e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:08.301951 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d1c72-f014-4e7c-bde8-108d1e90dd25 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:08.309182 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-4560c56d-859f-41a3-9cf4-1abd5a90807e None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:08.310501 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-4560c56d-859f-41a3-9cf4-1abd5a90807e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:08.315770 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d1c72-f014-4e7c-bde8-108d1e90dd25 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:08.324647 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af065ef1-2734-4958-a4fa-e0ebfe727dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:08.325516 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af065ef1-2734-4958-a4fa-e0ebfe727dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:08.325800 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af065ef1-2734-4958-a4fa-e0ebfe727dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:08.326073 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af065ef1-2734-4958-a4fa-e0ebfe727dd6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:08.332761 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 248/486] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:55:08.342128 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af065ef1-2734-4958-a4fa-e0ebfe727dd6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:08.344143 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af065ef1-2734-4958-a4fa-e0ebfe727dd6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:08.363520 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-af065ef1-2734-4958-a4fa-e0ebfe727dd6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:08.365228 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 239/487] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:08.371992 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560c56d-859f-41a3-9cf4-1abd5a90807e None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:08.381370 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af065ef1-2734-4958-a4fa-e0ebfe727dd6 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:08.389527 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560c56d-859f-41a3-9cf4-1abd5a90807e None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:08.392967 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af065ef1-2734-4958-a4fa-e0ebfe727dd6 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:08.398476 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe2d65-9d6b-4d71-8ed0-82f3d5f212fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:08.399594 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66c408-8ea4-4d83-b567-f3ea8053160e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:08.399881 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe2d65-9d6b-4d71-8ed0-82f3d5f212fa admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:08.400330 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66c408-8ea4-4d83-b567-f3ea8053160e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:08.400582 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe2d65-9d6b-4d71-8ed0-82f3d5f212fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:08.400682 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66c408-8ea4-4d83-b567-f3ea8053160e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:08.400880 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66c408-8ea4-4d83-b567-f3ea8053160e admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:08.401333 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe2d65-9d6b-4d71-8ed0-82f3d5f212fa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:08.401742 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66c408-8ea4-4d83-b567-f3ea8053160e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:08.402052 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66c408-8ea4-4d83-b567-f3ea8053160e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:08.403808 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66c408-8ea4-4d83-b567-f3ea8053160e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:08.416016 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe2d65-9d6b-4d71-8ed0-82f3d5f212fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:08.418881 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe2d65-9d6b-4d71-8ed0-82f3d5f212fa admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:08.438457 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 249/488] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:08.444679 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-39fe2d65-9d6b-4d71-8ed0-82f3d5f212fa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:08.447843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 240/489] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:08.447991 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66c408-8ea4-4d83-b567-f3ea8053160e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:08.454068 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe2d65-9d6b-4d71-8ed0-82f3d5f212fa admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:08.465966 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe2d65-9d6b-4d71-8ed0-82f3d5f212fa admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:08.466723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66c408-8ea4-4d83-b567-f3ea8053160e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:08.471289 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8818e-9453-4db2-9f4f-8a3e08c4c5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:08.472814 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8818e-9453-4db2-9f4f-8a3e08c4c5ef admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:08.473313 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8818e-9453-4db2-9f4f-8a3e08c4c5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:08.473815 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8818e-9453-4db2-9f4f-8a3e08c4c5ef admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:08.474862 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8818e-9453-4db2-9f4f-8a3e08c4c5ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:08.475452 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8818e-9453-4db2-9f4f-8a3e08c4c5ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:08.477521 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8818e-9453-4db2-9f4f-8a3e08c4c5ef admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:08.481883 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bd5c1-2b28-4ab2-99d1-9af6e8b828a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:08.482568 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bd5c1-2b28-4ab2-99d1-9af6e8b828a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:08.482851 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bd5c1-2b28-4ab2-99d1-9af6e8b828a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:08.483128 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bd5c1-2b28-4ab2-99d1-9af6e8b828a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:08.483896 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bd5c1-2b28-4ab2-99d1-9af6e8b828a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:08.486047 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bd5c1-2b28-4ab2-99d1-9af6e8b828a4 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:08.499320 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 241/490] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:08.501693 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8818e-9453-4db2-9f4f-8a3e08c4c5ef admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:08.513682 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8818e-9453-4db2-9f4f-8a3e08c4c5ef admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:08.519441 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d521291-9710-4fe5-a2e2-1643b61435c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:08.520197 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d521291-9710-4fe5-a2e2-1643b61435c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:08.522561 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d521291-9710-4fe5-a2e2-1643b61435c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:08.522561 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d521291-9710-4fe5-a2e2-1643b61435c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:08.522561 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d521291-9710-4fe5-a2e2-1643b61435c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:08.523775 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d521291-9710-4fe5-a2e2-1643b61435c5 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:08.576185 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 250/491] 10.222.0.54 () {60 vars in 1153 bytes} [Tue Nov 23 03:55:08 2021] POST /identity/v3/users => generated 248 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 03:55:08.626023 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 242/492] 10.222.0.54 () {60 vars in 1153 bytes} [Tue Nov 23 03:55:08 2021] POST /identity/v3/users => generated 248 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:55:08.695430 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e58ee-ca87-4b61-abd0-427c40367587 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:08.695721 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e58ee-ca87-4b61-abd0-427c40367587 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:08.696132 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e58ee-ca87-4b61-abd0-427c40367587 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:08.698430 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 251/493] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:08.705038 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac96d9-0578-40aa-829b-b71a31473181 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:08.705335 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac96d9-0578-40aa-829b-b71a31473181 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:08.706118 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac96d9-0578-40aa-829b-b71a31473181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:08.736744 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-44ac96d9-0578-40aa-829b-b71a31473181 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:08.739232 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-44ac96d9-0578-40aa-829b-b71a31473181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:08.751199 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 243/494] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:55:08.789206 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e58ee-ca87-4b61-abd0-427c40367587 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:08.806363 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e58ee-ca87-4b61-abd0-427c40367587 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:08.815490 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cddff-8aea-4dc8-81c6-bcb77b3bf4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:08.816357 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cddff-8aea-4dc8-81c6-bcb77b3bf4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:08.816646 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cddff-8aea-4dc8-81c6-bcb77b3bf4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:08.817178 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cddff-8aea-4dc8-81c6-bcb77b3bf4f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:08.839714 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cddff-8aea-4dc8-81c6-bcb77b3bf4f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:08.841590 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cddff-8aea-4dc8-81c6-bcb77b3bf4f5 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:08.859713 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-b76cddff-8aea-4dc8-81c6-bcb77b3bf4f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:08.861388 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 252/495] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:08.868191 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac96d9-0578-40aa-829b-b71a31473181 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:08.883296 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac96d9-0578-40aa-829b-b71a31473181 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:08.893942 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e4233-e651-4011-89e7-870c2cad251c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:08.895175 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e4233-e651-4011-89e7-870c2cad251c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:08.895713 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e4233-e651-4011-89e7-870c2cad251c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:08.896216 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e4233-e651-4011-89e7-870c2cad251c admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:08.897213 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e4233-e651-4011-89e7-870c2cad251c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:08.897729 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e4233-e651-4011-89e7-870c2cad251c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:08.899630 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e4233-e651-4011-89e7-870c2cad251c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:08.914187 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 244/496] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:08.920238 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cddff-8aea-4dc8-81c6-bcb77b3bf4f5 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:08.931081 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cddff-8aea-4dc8-81c6-bcb77b3bf4f5 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:08.935549 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0e5df-8eac-47e4-8dd8-f08dc8edca48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:08.936207 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0e5df-8eac-47e4-8dd8-f08dc8edca48 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:08.936495 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0e5df-8eac-47e4-8dd8-f08dc8edca48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:08.936775 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0e5df-8eac-47e4-8dd8-f08dc8edca48 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:08.937517 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0e5df-8eac-47e4-8dd8-f08dc8edca48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:08.939548 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0e5df-8eac-47e4-8dd8-f08dc8edca48 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:09.061227 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0a247-487f-493d-ac82-139de8ab1303 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:09.061411 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0a247-487f-493d-ac82-139de8ab1303 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:09.061949 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0a247-487f-493d-ac82-139de8ab1303 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:09.063755 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 245/497] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:55:09.067315 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 253/498] 10.222.0.54 () {60 vars in 1153 bytes} [Tue Nov 23 03:55:08 2021] POST /identity/v3/users => generated 249 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:55:09.085222 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df017a4-e6ee-4575-9d9e-d22e0c6329d7 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:09.085567 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df017a4-e6ee-4575-9d9e-d22e0c6329d7 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:09.085774 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df017a4-e6ee-4575-9d9e-d22e0c6329d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:09.116917 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-3df017a4-e6ee-4575-9d9e-d22e0c6329d7 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:09.118135 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-3df017a4-e6ee-4575-9d9e-d22e0c6329d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:09.132972 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 246/499] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:55:09.156866 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0e5df-8eac-47e4-8dd8-f08dc8edca48 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:09.172801 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0e5df-8eac-47e4-8dd8-f08dc8edca48 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:09.177752 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93ca77-652b-409a-b058-63a9167a9871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:09.178438 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93ca77-652b-409a-b058-63a9167a9871 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:09.178728 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93ca77-652b-409a-b058-63a9167a9871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:09.179008 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93ca77-652b-409a-b058-63a9167a9871 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:09.179813 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93ca77-652b-409a-b058-63a9167a9871 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:09.181426 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93ca77-652b-409a-b058-63a9167a9871 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:09.226231 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.sql.core [None req-8e93ca77-652b-409a-b058-63a9167a9871 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 23 03:55:09.226231 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 23 03:55:09.226231 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [parameters: {'id': 'c9db9ffb203249f3bb67774fb9c90d88', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 23 03:55:09.226231 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79251) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 23 03:55:09.241278 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-8e93ca77-652b-409a-b058-63a9167a9871 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 23 03:55:09.242891 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 254/500] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 03:55:09 2021] POST /identity/v3/roles => generated 144 bytes in 86 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:09.249134 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df017a4-e6ee-4575-9d9e-d22e0c6329d7 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:09.264759 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df017a4-e6ee-4575-9d9e-d22e0c6329d7 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:09.272083 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f49cf-5b06-44b8-bab9-c487e7a4221f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:09.273242 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f49cf-5b06-44b8-bab9-c487e7a4221f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:09.273732 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f49cf-5b06-44b8-bab9-c487e7a4221f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:09.274203 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f49cf-5b06-44b8-bab9-c487e7a4221f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:09.287845 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f49cf-5b06-44b8-bab9-c487e7a4221f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:09.295344 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-fe7f49cf-5b06-44b8-bab9-c487e7a4221f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 03:55:09.296557 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 247/501] 10.222.0.54 () {56 vars in 1135 bytes} [Tue Nov 23 03:55:09 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:09.303160 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93ca77-652b-409a-b058-63a9167a9871 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:09.319256 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93ca77-652b-409a-b058-63a9167a9871 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:09.325967 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab83a1d-8fd0-4cb7-8eea-cbdae730a7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:09.326630 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab83a1d-8fd0-4cb7-8eea-cbdae730a7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:09.326954 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab83a1d-8fd0-4cb7-8eea-cbdae730a7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:09.327281 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab83a1d-8fd0-4cb7-8eea-cbdae730a7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:09.328062 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab83a1d-8fd0-4cb7-8eea-cbdae730a7d1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:09.328352 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab83a1d-8fd0-4cb7-8eea-cbdae730a7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:09.330376 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab83a1d-8fd0-4cb7-8eea-cbdae730a7d1 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:09.343735 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 255/502] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:09 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:11.405053 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c17cd-828b-432c-812d-00ea5a7576ac None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:11.405557 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c17cd-828b-432c-812d-00ea5a7576ac None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:11.405557 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c17cd-828b-432c-812d-00ea5a7576ac None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:11.407542 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 248/503] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:11.414155 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffe95a-4ce2-49ae-86f1-d1a183eec824 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:11.414566 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffe95a-4ce2-49ae-86f1-d1a183eec824 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:11.414730 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffe95a-4ce2-49ae-86f1-d1a183eec824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:11.445238 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-41ffe95a-4ce2-49ae-86f1-d1a183eec824 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:11.446424 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-41ffe95a-4ce2-49ae-86f1-d1a183eec824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:11.458166 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 256/504] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:55:11.507601 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c17cd-828b-432c-812d-00ea5a7576ac None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:11.524758 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c17cd-828b-432c-812d-00ea5a7576ac None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:11.529467 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29859c-cd8e-4c55-b86a-fbe179d374aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:11.530239 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29859c-cd8e-4c55-b86a-fbe179d374aa admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:11.530516 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29859c-cd8e-4c55-b86a-fbe179d374aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:11.530787 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29859c-cd8e-4c55-b86a-fbe179d374aa admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:11.548166 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29859c-cd8e-4c55-b86a-fbe179d374aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:11.555723 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-9c29859c-cd8e-4c55-b86a-fbe179d374aa admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 03:55:11.557961 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 249/505] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:55:11 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:11.563138 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ffe95a-4ce2-49ae-86f1-d1a183eec824 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:11.576169 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ffe95a-4ce2-49ae-86f1-d1a183eec824 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:11.587935 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45775ebc-e498-4c4d-af08-bb263ff9b8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:11.588615 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45775ebc-e498-4c4d-af08-bb263ff9b8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:11.588894 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45775ebc-e498-4c4d-af08-bb263ff9b8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:11.589166 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45775ebc-e498-4c4d-af08-bb263ff9b8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:11.589930 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45775ebc-e498-4c4d-af08-bb263ff9b8e7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:11.590283 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45775ebc-e498-4c4d-af08-bb263ff9b8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:11.592581 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45775ebc-e498-4c4d-af08-bb263ff9b8e7 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:11.606511 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 257/506] 10.222.0.54 () {56 vars in 1124 bytes} [Tue Nov 23 03:55:11 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:11.610124 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae63a5-6017-47bf-a3e3-abafa4e553f9 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:11.610414 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae63a5-6017-47bf-a3e3-abafa4e553f9 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:11.610692 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae63a5-6017-47bf-a3e3-abafa4e553f9 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:11.613024 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45775ebc-e498-4c4d-af08-bb263ff9b8e7 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:11.613154 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 250/507] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:11.625409 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b689fa-37db-4f1d-a60c-f79e5440449d None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:11.625697 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b689fa-37db-4f1d-a60c-f79e5440449d None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:11.625977 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b689fa-37db-4f1d-a60c-f79e5440449d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:11.629166 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45775ebc-e498-4c4d-af08-bb263ff9b8e7 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:11.641916 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5ae96-b531-4854-ab62-d70d63d98c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:11.642722 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5ae96-b531-4854-ab62-d70d63d98c5b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:11.643561 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5ae96-b531-4854-ab62-d70d63d98c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:11.643845 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5ae96-b531-4854-ab62-d70d63d98c5b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:11.653152 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-08b689fa-37db-4f1d-a60c-f79e5440449d None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:11.654361 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-08b689fa-37db-4f1d-a60c-f79e5440449d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:11.662995 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 251/508] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:55:11.663432 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5ae96-b531-4854-ab62-d70d63d98c5b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:11.665264 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5ae96-b531-4854-ab62-d70d63d98c5b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:11.676813 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4749a-1c54-4368-b064-0bb8f35903a7 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:11.677102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4749a-1c54-4368-b064-0bb8f35903a7 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:11.677392 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4749a-1c54-4368-b064-0bb8f35903a7 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:11.680955 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 252/509] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:11.685282 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cefc5-a964-4677-bac7-443520e86397 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:11.685541 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cefc5-a964-4677-bac7-443520e86397 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:11.685952 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cefc5-a964-4677-bac7-443520e86397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:11.693200 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-bcd5ae96-b531-4854-ab62-d70d63d98c5b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:11.699283 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 258/510] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:11.700128 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5ae96-b531-4854-ab62-d70d63d98c5b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:11.704491 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-620cefc5-a964-4677-bac7-443520e86397 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:11.706335 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-620cefc5-a964-4677-bac7-443520e86397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:11.716085 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5ae96-b531-4854-ab62-d70d63d98c5b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:11.718220 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 253/511] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:55:11.719534 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cefc5-a964-4677-bac7-443520e86397 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:11.729527 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cefc5-a964-4677-bac7-443520e86397 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:11.730075 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb18f8-943d-4df0-bd74-61b193ab82f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:11.730737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb18f8-943d-4df0-bd74-61b193ab82f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:11.731017 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb18f8-943d-4df0-bd74-61b193ab82f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:11.731311 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb18f8-943d-4df0-bd74-61b193ab82f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:11.732049 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb18f8-943d-4df0-bd74-61b193ab82f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:11.732352 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb18f8-943d-4df0-bd74-61b193ab82f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:11.733917 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb18f8-943d-4df0-bd74-61b193ab82f2 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:11.734026 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65606a-8bb3-4a0d-b066-07c2e0bfaf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:11.734699 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65606a-8bb3-4a0d-b066-07c2e0bfaf3d admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:11.734987 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65606a-8bb3-4a0d-b066-07c2e0bfaf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:11.735547 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65606a-8bb3-4a0d-b066-07c2e0bfaf3d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:11.746716 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65606a-8bb3-4a0d-b066-07c2e0bfaf3d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:11.753917 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-de65606a-8bb3-4a0d-b066-07c2e0bfaf3d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 03:55:11.755444 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 254/512] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:55:11 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:11.756234 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65606a-8bb3-4a0d-b066-07c2e0bfaf3d admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:11.762325 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 259/513] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:11.764632 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb18f8-943d-4df0-bd74-61b193ab82f2 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:11.769762 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65606a-8bb3-4a0d-b066-07c2e0bfaf3d admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:11.775109 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364bb48-7b29-4ec6-a4ae-995fd21c6eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:11.776193 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364bb48-7b29-4ec6-a4ae-995fd21c6eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:11.776655 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364bb48-7b29-4ec6-a4ae-995fd21c6eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:11.777112 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364bb48-7b29-4ec6-a4ae-995fd21c6eb2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:11.779038 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb18f8-943d-4df0-bd74-61b193ab82f2 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:11.783576 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189092ca-0591-45e2-89a3-689bcfa7fc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:11.784346 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189092ca-0591-45e2-89a3-689bcfa7fc96 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:11.784686 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189092ca-0591-45e2-89a3-689bcfa7fc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:11.785026 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189092ca-0591-45e2-89a3-689bcfa7fc96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:11.785842 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189092ca-0591-45e2-89a3-689bcfa7fc96 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:11.786214 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189092ca-0591-45e2-89a3-689bcfa7fc96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:11.787932 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189092ca-0591-45e2-89a3-689bcfa7fc96 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:11.790807 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364bb48-7b29-4ec6-a4ae-995fd21c6eb2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:11.798199 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-d364bb48-7b29-4ec6-a4ae-995fd21c6eb2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 03:55:11.800422 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 255/515] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:55:11 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:11.801510 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364bb48-7b29-4ec6-a4ae-995fd21c6eb2 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:11.802175 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 260/515] 10.222.0.54 () {56 vars in 1124 bytes} [Tue Nov 23 03:55:11 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:11.803115 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189092ca-0591-45e2-89a3-689bcfa7fc96 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:11.812107 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364bb48-7b29-4ec6-a4ae-995fd21c6eb2 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:11.817578 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90759f1-3301-4b56-b5d7-2183785fa59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:11.817801 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189092ca-0591-45e2-89a3-689bcfa7fc96 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:11.818941 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90759f1-3301-4b56-b5d7-2183785fa59f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:11.819549 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90759f1-3301-4b56-b5d7-2183785fa59f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:11.820053 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90759f1-3301-4b56-b5d7-2183785fa59f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:11.822469 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7ce40-b8c3-4f0d-96ef-296ab125bee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:11.823422 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7ce40-b8c3-4f0d-96ef-296ab125bee6 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:11.823758 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7ce40-b8c3-4f0d-96ef-296ab125bee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:11.824103 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7ce40-b8c3-4f0d-96ef-296ab125bee6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:11.829354 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90759f1-3301-4b56-b5d7-2183785fa59f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:11.832147 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90759f1-3301-4b56-b5d7-2183785fa59f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:11.843236 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7ce40-b8c3-4f0d-96ef-296ab125bee6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:11.843236 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7ce40-b8c3-4f0d-96ef-296ab125bee6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:11.847395 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-d90759f1-3301-4b56-b5d7-2183785fa59f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 03:55:11.848897 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 256/516] 10.222.0.54 () {56 vars in 1114 bytes} [Tue Nov 23 03:55:11 2021] GET /identity/v3/users/nova => generated 82 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:11.849696 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90759f1-3301-4b56-b5d7-2183785fa59f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:11.859974 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-01a7ce40-b8c3-4f0d-96ef-296ab125bee6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:11.861402 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 261/517] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:11.862384 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7ce40-b8c3-4f0d-96ef-296ab125bee6 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:11.864434 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90759f1-3301-4b56-b5d7-2183785fa59f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:11.869054 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246c4e6-2975-4341-a083-8ad2eb4f01a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:11.869725 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246c4e6-2975-4341-a083-8ad2eb4f01a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:11.870003 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246c4e6-2975-4341-a083-8ad2eb4f01a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:11.870283 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246c4e6-2975-4341-a083-8ad2eb4f01a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:11.871053 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246c4e6-2975-4341-a083-8ad2eb4f01a1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:11.871404 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246c4e6-2975-4341-a083-8ad2eb4f01a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:11.872984 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246c4e6-2975-4341-a083-8ad2eb4f01a1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:11.874119 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7ce40-b8c3-4f0d-96ef-296ab125bee6 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:11.879641 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31f787-851b-4c11-8a1f-9469eb383e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:11.880490 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31f787-851b-4c11-8a1f-9469eb383e9a admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:11.880860 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31f787-851b-4c11-8a1f-9469eb383e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:11.881244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31f787-851b-4c11-8a1f-9469eb383e9a admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:11.882281 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31f787-851b-4c11-8a1f-9469eb383e9a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:11.882681 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31f787-851b-4c11-8a1f-9469eb383e9a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:11.883507 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 257/518] 10.222.0.54 () {56 vars in 1124 bytes} [Tue Nov 23 03:55:11 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:11.884191 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING py.warnings [None req-6b31f787-851b-4c11-8a1f-9469eb383e9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:55:11.884191 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: warnings.warn(msg) Nov 23 03:55:11.884191 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: Nov 23 03:55:11.884884 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246c4e6-2975-4341-a083-8ad2eb4f01a1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:11.888220 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31f787-851b-4c11-8a1f-9469eb383e9a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:11.906615 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246c4e6-2975-4341-a083-8ad2eb4f01a1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:11.912576 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40954acf-8417-429e-8b7e-ec04d53dfe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:11.913388 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40954acf-8417-429e-8b7e-ec04d53dfe77 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:11.913709 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40954acf-8417-429e-8b7e-ec04d53dfe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:11.914153 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40954acf-8417-429e-8b7e-ec04d53dfe77 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:11.914973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40954acf-8417-429e-8b7e-ec04d53dfe77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:11.915380 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40954acf-8417-429e-8b7e-ec04d53dfe77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:11.917031 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40954acf-8417-429e-8b7e-ec04d53dfe77 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:11.932398 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 258/519] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:11.937150 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40954acf-8417-429e-8b7e-ec04d53dfe77 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:11.937627 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 262/520] 10.222.0.54 () {56 vars in 1154 bytes} [Tue Nov 23 03:55:11 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:11.938778 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31f787-851b-4c11-8a1f-9469eb383e9a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:11.944336 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40954acf-8417-429e-8b7e-ec04d53dfe77 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:11.949873 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed382d-f0c1-414f-b2e5-0320121ff5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:11.950702 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31f787-851b-4c11-8a1f-9469eb383e9a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:11.950811 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed382d-f0c1-414f-b2e5-0320121ff5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:11.951095 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed382d-f0c1-414f-b2e5-0320121ff5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:11.951476 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed382d-f0c1-414f-b2e5-0320121ff5a2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:11.956869 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc81548-bd75-405a-8a36-85940d228f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:11.957923 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc81548-bd75-405a-8a36-85940d228f67 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:11.958475 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc81548-bd75-405a-8a36-85940d228f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:11.958955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc81548-bd75-405a-8a36-85940d228f67 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:11.964203 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed382d-f0c1-414f-b2e5-0320121ff5a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:11.966151 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed382d-f0c1-414f-b2e5-0320121ff5a2 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:11.968587 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc81548-bd75-405a-8a36-85940d228f67 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:11.970890 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc81548-bd75-405a-8a36-85940d228f67 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:11.986054 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-19ed382d-f0c1-414f-b2e5-0320121ff5a2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:11.986657 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-dcc81548-bd75-405a-8a36-85940d228f67 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 23 03:55:11.988357 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 259/521] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:11.989381 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed382d-f0c1-414f-b2e5-0320121ff5a2 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:11.991343 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 263/522] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:55:11 2021] GET /identity/v3/users/cinder => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:11.998384 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc81548-bd75-405a-8a36-85940d228f67 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.006642 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc81548-bd75-405a-8a36-85940d228f67 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.008702 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed382d-f0c1-414f-b2e5-0320121ff5a2 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.011624 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce80e7c-9726-483c-8bfc-28bcc9e5d89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.012516 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce80e7c-9726-483c-8bfc-28bcc9e5d89c admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.012872 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce80e7c-9726-483c-8bfc-28bcc9e5d89c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.013339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce80e7c-9726-483c-8bfc-28bcc9e5d89c admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.014233 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce80e7c-9726-483c-8bfc-28bcc9e5d89c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:12.014613 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce80e7c-9726-483c-8bfc-28bcc9e5d89c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.014781 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238313b7-1082-4674-bc05-ef12ae0ef785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.015826 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238313b7-1082-4674-bc05-ef12ae0ef785 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.016283 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238313b7-1082-4674-bc05-ef12ae0ef785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.016514 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce80e7c-9726-483c-8bfc-28bcc9e5d89c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.016984 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238313b7-1082-4674-bc05-ef12ae0ef785 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.025930 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238313b7-1082-4674-bc05-ef12ae0ef785 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.028008 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238313b7-1082-4674-bc05-ef12ae0ef785 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.030043 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 264/523] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:12.036317 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce80e7c-9726-483c-8bfc-28bcc9e5d89c admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.043328 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 260/524] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:55:12.044458 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238313b7-1082-4674-bc05-ef12ae0ef785 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.047030 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce80e7c-9726-483c-8bfc-28bcc9e5d89c admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.052193 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7670c2-e813-44cd-bbc7-71b5f480955e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.052979 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7670c2-e813-44cd-bbc7-71b5f480955e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.053356 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7670c2-e813-44cd-bbc7-71b5f480955e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.053702 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7670c2-e813-44cd-bbc7-71b5f480955e admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.054620 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7670c2-e813-44cd-bbc7-71b5f480955e admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:12.055000 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7670c2-e813-44cd-bbc7-71b5f480955e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.056930 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7670c2-e813-44cd-bbc7-71b5f480955e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.057849 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238313b7-1082-4674-bc05-ef12ae0ef785 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.062700 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84821f1e-c86c-4761-8d00-31bf315f7918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.063776 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84821f1e-c86c-4761-8d00-31bf315f7918 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.064237 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84821f1e-c86c-4761-8d00-31bf315f7918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.064732 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84821f1e-c86c-4761-8d00-31bf315f7918 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.073555 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84821f1e-c86c-4761-8d00-31bf315f7918 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.075863 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84821f1e-c86c-4761-8d00-31bf315f7918 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.077864 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 265/525] 10.222.0.54 () {56 vars in 1158 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:12.078755 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7670c2-e813-44cd-bbc7-71b5f480955e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.092553 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7670c2-e813-44cd-bbc7-71b5f480955e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.092720 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-84821f1e-c86c-4761-8d00-31bf315f7918 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 23 03:55:12.094618 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 261/526] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/users/glance => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:12.095702 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84821f1e-c86c-4761-8d00-31bf315f7918 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.098071 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065c2d9-facf-4459-ba65-bf0330b99721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.099020 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065c2d9-facf-4459-ba65-bf0330b99721 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.099529 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065c2d9-facf-4459-ba65-bf0330b99721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.099877 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065c2d9-facf-4459-ba65-bf0330b99721 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.107862 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84821f1e-c86c-4761-8d00-31bf315f7918 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.113230 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065c2d9-facf-4459-ba65-bf0330b99721 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.113914 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bc1af-84bf-4485-bcdf-4b8751d1494c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.115839 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bc1af-84bf-4485-bcdf-4b8751d1494c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.115839 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bc1af-84bf-4485-bcdf-4b8751d1494c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.115839 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bc1af-84bf-4485-bcdf-4b8751d1494c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.116144 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065c2d9-facf-4459-ba65-bf0330b99721 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.124193 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bc1af-84bf-4485-bcdf-4b8751d1494c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.126172 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bc1af-84bf-4485-bcdf-4b8751d1494c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.136145 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 262/527] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:55:12.137125 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bc1af-84bf-4485-bcdf-4b8751d1494c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.138783 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-2065c2d9-facf-4459-ba65-bf0330b99721 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:12.140128 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 266/528] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:12.142278 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065c2d9-facf-4459-ba65-bf0330b99721 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.151812 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bc1af-84bf-4485-bcdf-4b8751d1494c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.153654 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065c2d9-facf-4459-ba65-bf0330b99721 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.156806 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1bb9d-42a0-4182-b2a2-a93d16b653bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.157633 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1bb9d-42a0-4182-b2a2-a93d16b653bb admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.158152 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1bb9d-42a0-4182-b2a2-a93d16b653bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.159079 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1bb9d-42a0-4182-b2a2-a93d16b653bb admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.160083 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1bb9d-42a0-4182-b2a2-a93d16b653bb admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:12.160391 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d868e-7c92-43ac-9526-ad29602a1ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.160594 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1bb9d-42a0-4182-b2a2-a93d16b653bb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.161733 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING py.warnings [None req-f8f1bb9d-42a0-4182-b2a2-a93d16b653bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:55:12.161733 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: warnings.warn(msg) Nov 23 03:55:12.161733 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: Nov 23 03:55:12.162088 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d868e-7c92-43ac-9526-ad29602a1ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.162530 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d868e-7c92-43ac-9526-ad29602a1ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.162980 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d868e-7c92-43ac-9526-ad29602a1ef1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.163480 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1bb9d-42a0-4182-b2a2-a93d16b653bb admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.177452 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d868e-7c92-43ac-9526-ad29602a1ef1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.179700 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d868e-7c92-43ac-9526-ad29602a1ef1 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.200503 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-b45d868e-7c92-43ac-9526-ad29602a1ef1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:12.203090 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 267/529] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:12.204113 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d868e-7c92-43ac-9526-ad29602a1ef1 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.206479 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 263/530] 10.222.0.54 () {56 vars in 1158 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:12.208961 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1bb9d-42a0-4182-b2a2-a93d16b653bb admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.215958 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d868e-7c92-43ac-9526-ad29602a1ef1 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.219499 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1bb9d-42a0-4182-b2a2-a93d16b653bb admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.221472 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19298c2b-6ba0-434e-ae88-45ba8a8bd218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.222262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19298c2b-6ba0-434e-ae88-45ba8a8bd218 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.222629 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19298c2b-6ba0-434e-ae88-45ba8a8bd218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.223047 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19298c2b-6ba0-434e-ae88-45ba8a8bd218 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.223924 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19298c2b-6ba0-434e-ae88-45ba8a8bd218 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:12.224324 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19298c2b-6ba0-434e-ae88-45ba8a8bd218 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.225432 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691f4ce-8895-466b-a476-c961b68d170f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.226188 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691f4ce-8895-466b-a476-c961b68d170f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.226293 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19298c2b-6ba0-434e-ae88-45ba8a8bd218 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.226602 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691f4ce-8895-466b-a476-c961b68d170f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.226951 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691f4ce-8895-466b-a476-c961b68d170f admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.227827 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691f4ce-8895-466b-a476-c961b68d170f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:12.228210 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691f4ce-8895-466b-a476-c961b68d170f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.230133 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691f4ce-8895-466b-a476-c961b68d170f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.243827 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 268/531] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:12.244692 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19298c2b-6ba0-434e-ae88-45ba8a8bd218 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.248472 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 264/532] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:12.250251 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691f4ce-8895-466b-a476-c961b68d170f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.260602 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691f4ce-8895-466b-a476-c961b68d170f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.260930 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19298c2b-6ba0-434e-ae88-45ba8a8bd218 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.265236 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354044f5-59bc-4f6d-be71-0621b69ac399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.265795 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770154a-6f0a-4804-b17f-6fa57d9a35ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.266025 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354044f5-59bc-4f6d-be71-0621b69ac399 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.266310 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354044f5-59bc-4f6d-be71-0621b69ac399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.266482 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770154a-6f0a-4804-b17f-6fa57d9a35ec admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.266572 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354044f5-59bc-4f6d-be71-0621b69ac399 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.266759 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770154a-6f0a-4804-b17f-6fa57d9a35ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.267038 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770154a-6f0a-4804-b17f-6fa57d9a35ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.274677 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354044f5-59bc-4f6d-be71-0621b69ac399 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.276819 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354044f5-59bc-4f6d-be71-0621b69ac399 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.281515 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770154a-6f0a-4804-b17f-6fa57d9a35ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.283784 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770154a-6f0a-4804-b17f-6fa57d9a35ec admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.290976 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-354044f5-59bc-4f6d-be71-0621b69ac399 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:12.292485 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 265/533] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:12.293405 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354044f5-59bc-4f6d-be71-0621b69ac399 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.294558 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 269/534] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:55:12.303241 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770154a-6f0a-4804-b17f-6fa57d9a35ec admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.304551 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354044f5-59bc-4f6d-be71-0621b69ac399 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.308807 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770154a-6f0a-4804-b17f-6fa57d9a35ec admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.309231 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aac41a-de48-4ac7-87c3-6b40142df94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.309996 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aac41a-de48-4ac7-87c3-6b40142df94d admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.310277 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aac41a-de48-4ac7-87c3-6b40142df94d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.310559 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aac41a-de48-4ac7-87c3-6b40142df94d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.313294 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2997c59-ba0a-457c-ae92-a834a8b8ff42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.314114 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2997c59-ba0a-457c-ae92-a834a8b8ff42 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.314405 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2997c59-ba0a-457c-ae92-a834a8b8ff42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.314682 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2997c59-ba0a-457c-ae92-a834a8b8ff42 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.316208 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2997c59-ba0a-457c-ae92-a834a8b8ff42 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:12.316532 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2997c59-ba0a-457c-ae92-a834a8b8ff42 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.317802 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING py.warnings [None req-e2997c59-ba0a-457c-ae92-a834a8b8ff42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:55:12.317802 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: warnings.warn(msg) Nov 23 03:55:12.317802 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: Nov 23 03:55:12.318921 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2997c59-ba0a-457c-ae92-a834a8b8ff42 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.320088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aac41a-de48-4ac7-87c3-6b40142df94d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.322194 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aac41a-de48-4ac7-87c3-6b40142df94d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.335469 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-09aac41a-de48-4ac7-87c3-6b40142df94d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:12.336880 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 266/535] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:12.343262 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aac41a-de48-4ac7-87c3-6b40142df94d admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.343403 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 270/536] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:12.344516 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2997c59-ba0a-457c-ae92-a834a8b8ff42 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.353867 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aac41a-de48-4ac7-87c3-6b40142df94d admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.355072 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2997c59-ba0a-457c-ae92-a834a8b8ff42 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.358578 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c140fb-4152-4ed6-844d-8741ca45f718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.359456 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c140fb-4152-4ed6-844d-8741ca45f718 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.359746 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c140fb-4152-4ed6-844d-8741ca45f718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.360066 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c140fb-4152-4ed6-844d-8741ca45f718 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.361084 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7b391-27ef-4017-a4dc-77d9d97e7e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.362515 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7b391-27ef-4017-a4dc-77d9d97e7e18 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.363227 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7b391-27ef-4017-a4dc-77d9d97e7e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.363679 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7b391-27ef-4017-a4dc-77d9d97e7e18 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.364520 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7b391-27ef-4017-a4dc-77d9d97e7e18 admin admin] RBAC: Adding query filter params (role.id=4dde72f5d769401aa566e1c65c1f40d5, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=3dd4736db18940b8961c73142381cee7) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:12.364838 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7b391-27ef-4017-a4dc-77d9d97e7e18 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.366670 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7b391-27ef-4017-a4dc-77d9d97e7e18 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.372280 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c140fb-4152-4ed6-844d-8741ca45f718 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.374158 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c140fb-4152-4ed6-844d-8741ca45f718 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.375357 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 271/537] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/role_assignments?user.id=3dd4736db18940b8961c73142381cee7&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=4dde72f5d769401aa566e1c65c1f40d5 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:12.377814 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7b391-27ef-4017-a4dc-77d9d97e7e18 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.390002 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7b391-27ef-4017-a4dc-77d9d97e7e18 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.395665 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ac43c-bd0e-4b65-b44d-0f54a5963cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.396672 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ac43c-bd0e-4b65-b44d-0f54a5963cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.397149 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ac43c-bd0e-4b65-b44d-0f54a5963cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.397384 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-15c140fb-4152-4ed6-844d-8741ca45f718 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:12.397854 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ac43c-bd0e-4b65-b44d-0f54a5963cf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.398694 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 267/538] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:12.399079 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ac43c-bd0e-4b65-b44d-0f54a5963cf4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:12.399613 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ac43c-bd0e-4b65-b44d-0f54a5963cf4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.400256 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b2fab-6d16-406b-9bb0-5f277d503216 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.400591 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b2fab-6d16-406b-9bb0-5f277d503216 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.400877 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b2fab-6d16-406b-9bb0-5f277d503216 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.402296 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ac43c-bd0e-4b65-b44d-0f54a5963cf4 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.403255 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 268/539] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:12.404920 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b2fab-6d16-406b-9bb0-5f277d503216 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.425570 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 272/540] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:12.426920 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b2fab-6d16-406b-9bb0-5f277d503216 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.427338 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfff53-97ea-4692-8a14-752be0047426 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.427528 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfff53-97ea-4692-8a14-752be0047426 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.427896 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfff53-97ea-4692-8a14-752be0047426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.432526 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610521c-adfb-4342-9c29-1546502ff2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.433482 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610521c-adfb-4342-9c29-1546502ff2ca admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.433945 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610521c-adfb-4342-9c29-1546502ff2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.434365 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610521c-adfb-4342-9c29-1546502ff2ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.435637 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610521c-adfb-4342-9c29-1546502ff2ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:12.437121 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610521c-adfb-4342-9c29-1546502ff2ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.438776 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610521c-adfb-4342-9c29-1546502ff2ca admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.450680 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-4bdfff53-97ea-4692-8a14-752be0047426 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:12.451879 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 269/541] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:12.452987 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-4bdfff53-97ea-4692-8a14-752be0047426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:12.453101 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610521c-adfb-4342-9c29-1546502ff2ca admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.463867 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610521c-adfb-4342-9c29-1546502ff2ca admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.468351 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2267e9-5cee-408f-8c4d-5f8b42baa097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.469012 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2267e9-5cee-408f-8c4d-5f8b42baa097 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.469299 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2267e9-5cee-408f-8c4d-5f8b42baa097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.469577 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2267e9-5cee-408f-8c4d-5f8b42baa097 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.470435 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2267e9-5cee-408f-8c4d-5f8b42baa097 admin admin] RBAC: Adding query filter params (role.id=4dde72f5d769401aa566e1c65c1f40d5, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=35e14131fb22470cba63cd5e8db359e2) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:12.470747 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2267e9-5cee-408f-8c4d-5f8b42baa097 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.471953 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 273/542] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:55:12.473336 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2267e9-5cee-408f-8c4d-5f8b42baa097 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.473957 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb646bb-00c5-4f98-a17f-65a68bc1e412 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.474382 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb646bb-00c5-4f98-a17f-65a68bc1e412 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.474839 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb646bb-00c5-4f98-a17f-65a68bc1e412 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.481543 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 270/543] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/role_assignments?user.id=35e14131fb22470cba63cd5e8db359e2&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=4dde72f5d769401aa566e1c65c1f40d5 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:12.481757 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 274/544] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:12 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:12.481846 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2267e9-5cee-408f-8c4d-5f8b42baa097 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.483928 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d15a6-6597-461d-be8a-038633318485 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.484421 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d15a6-6597-461d-be8a-038633318485 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.484838 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d15a6-6597-461d-be8a-038633318485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.491355 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2267e9-5cee-408f-8c4d-5f8b42baa097 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.500113 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a3be0-f5b4-4cf7-94c0-df303d81eb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.501099 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a3be0-f5b4-4cf7-94c0-df303d81eb08 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.501534 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a3be0-f5b4-4cf7-94c0-df303d81eb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.501823 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a3be0-f5b4-4cf7-94c0-df303d81eb08 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.505998 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-c76d15a6-6597-461d-be8a-038633318485 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:12.507696 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-c76d15a6-6597-461d-be8a-038633318485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:12.509925 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a3be0-f5b4-4cf7-94c0-df303d81eb08 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.512409 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a3be0-f5b4-4cf7-94c0-df303d81eb08 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.523725 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 275/545] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:55:12.525096 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d15a6-6597-461d-be8a-038633318485 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.528766 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-e47a3be0-f5b4-4cf7-94c0-df303d81eb08 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:12.530047 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 271/546] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:12.540849 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d15a6-6597-461d-be8a-038633318485 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.543679 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a3be0-f5b4-4cf7-94c0-df303d81eb08 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.546472 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca278b3b-2630-45ed-b544-8d06e7df6e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.547657 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca278b3b-2630-45ed-b544-8d06e7df6e09 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.548084 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca278b3b-2630-45ed-b544-8d06e7df6e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.548533 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca278b3b-2630-45ed-b544-8d06e7df6e09 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.567024 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a3be0-f5b4-4cf7-94c0-df303d81eb08 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.568147 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca278b3b-2630-45ed-b544-8d06e7df6e09 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.570178 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca278b3b-2630-45ed-b544-8d06e7df6e09 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.572736 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90beb5-4f68-4f8c-aaeb-2b40b1f7925a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.573929 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90beb5-4f68-4f8c-aaeb-2b40b1f7925a admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.574299 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90beb5-4f68-4f8c-aaeb-2b40b1f7925a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.574651 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90beb5-4f68-4f8c-aaeb-2b40b1f7925a admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.575604 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90beb5-4f68-4f8c-aaeb-2b40b1f7925a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:12.575993 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90beb5-4f68-4f8c-aaeb-2b40b1f7925a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.577102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING py.warnings [None req-8d90beb5-4f68-4f8c-aaeb-2b40b1f7925a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:55:12.577102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: warnings.warn(msg) Nov 23 03:55:12.577102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: Nov 23 03:55:12.578458 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90beb5-4f68-4f8c-aaeb-2b40b1f7925a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.591596 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-ca278b3b-2630-45ed-b544-8d06e7df6e09 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:12.593141 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 276/547] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:12.594114 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca278b3b-2630-45ed-b544-8d06e7df6e09 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.607254 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 272/548] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:12.613441 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90beb5-4f68-4f8c-aaeb-2b40b1f7925a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.617117 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca278b3b-2630-45ed-b544-8d06e7df6e09 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.621757 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686af8e-c45c-47c4-bbad-37b0d224c171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.622655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686af8e-c45c-47c4-bbad-37b0d224c171 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.623001 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686af8e-c45c-47c4-bbad-37b0d224c171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.623119 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90beb5-4f68-4f8c-aaeb-2b40b1f7925a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.623435 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686af8e-c45c-47c4-bbad-37b0d224c171 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.629490 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9463cf-361a-4d0e-aecc-002275e90c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.630263 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9463cf-361a-4d0e-aecc-002275e90c4b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.630625 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9463cf-361a-4d0e-aecc-002275e90c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.630818 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9463cf-361a-4d0e-aecc-002275e90c4b admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.631652 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9463cf-361a-4d0e-aecc-002275e90c4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:12.631958 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9463cf-361a-4d0e-aecc-002275e90c4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.634434 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9463cf-361a-4d0e-aecc-002275e90c4b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.637550 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c686af8e-c45c-47c4-bbad-37b0d224c171 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:12.645651 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-c686af8e-c45c-47c4-bbad-37b0d224c171 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 03:55:12.647353 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 277/549] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:12.648230 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686af8e-c45c-47c4-bbad-37b0d224c171 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.649527 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 273/550] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:12.660813 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9463cf-361a-4d0e-aecc-002275e90c4b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.666251 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686af8e-c45c-47c4-bbad-37b0d224c171 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.668611 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796b179-b09f-4d83-92bf-89a27c5a0ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.669343 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796b179-b09f-4d83-92bf-89a27c5a0ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.669692 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796b179-b09f-4d83-92bf-89a27c5a0ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.670031 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796b179-b09f-4d83-92bf-89a27c5a0ce6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.670951 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796b179-b09f-4d83-92bf-89a27c5a0ce6 admin admin] RBAC: Adding query filter params (role.id=4dde72f5d769401aa566e1c65c1f40d5, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=e1f52add52aa4586aee0b801ceffd764) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:12.671303 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796b179-b09f-4d83-92bf-89a27c5a0ce6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.673194 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796b179-b09f-4d83-92bf-89a27c5a0ce6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.675530 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9463cf-361a-4d0e-aecc-002275e90c4b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.680695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 278/551] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/role_assignments?user.id=e1f52add52aa4586aee0b801ceffd764&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=4dde72f5d769401aa566e1c65c1f40d5 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:12.680843 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796b179-b09f-4d83-92bf-89a27c5a0ce6 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.681826 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e787268-afb3-4e52-8b51-4cb38f5ea99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.682597 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e787268-afb3-4e52-8b51-4cb38f5ea99f admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.683060 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e787268-afb3-4e52-8b51-4cb38f5ea99f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.691251 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e787268-afb3-4e52-8b51-4cb38f5ea99f admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.691251 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e787268-afb3-4e52-8b51-4cb38f5ea99f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.691251 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e787268-afb3-4e52-8b51-4cb38f5ea99f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.705659 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796b179-b09f-4d83-92bf-89a27c5a0ce6 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.710573 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3875373-9296-4add-b92c-7a4d0d4ea01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.711280 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3875373-9296-4add-b92c-7a4d0d4ea01e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.711591 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3875373-9296-4add-b92c-7a4d0d4ea01e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.711864 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3875373-9296-4add-b92c-7a4d0d4ea01e admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.712637 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3875373-9296-4add-b92c-7a4d0d4ea01e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:12.712942 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3875373-9296-4add-b92c-7a4d0d4ea01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.714586 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3875373-9296-4add-b92c-7a4d0d4ea01e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.724905 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 279/552] 10.222.0.54 () {56 vars in 1124 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:12.731377 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3875373-9296-4add-b92c-7a4d0d4ea01e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.742789 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3875373-9296-4add-b92c-7a4d0d4ea01e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.754565 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b80178-c140-4ae9-97bc-537990fc1241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.754565 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b80178-c140-4ae9-97bc-537990fc1241 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.754565 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b80178-c140-4ae9-97bc-537990fc1241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.754565 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b80178-c140-4ae9-97bc-537990fc1241 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.764495 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b80178-c140-4ae9-97bc-537990fc1241 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.766778 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b80178-c140-4ae9-97bc-537990fc1241 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.786246 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-51b80178-c140-4ae9-97bc-537990fc1241 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:12.788202 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 280/553] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:12.794512 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b80178-c140-4ae9-97bc-537990fc1241 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.805229 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b80178-c140-4ae9-97bc-537990fc1241 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.810388 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f394ee-c16b-44ef-8953-6058f4f4e882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.811477 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f394ee-c16b-44ef-8953-6058f4f4e882 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.812067 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f394ee-c16b-44ef-8953-6058f4f4e882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.812484 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f394ee-c16b-44ef-8953-6058f4f4e882 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.813472 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f394ee-c16b-44ef-8953-6058f4f4e882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:12.813946 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f394ee-c16b-44ef-8953-6058f4f4e882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.816611 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f394ee-c16b-44ef-8953-6058f4f4e882 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.835287 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 274/554] 10.222.0.54 () {60 vars in 1153 bytes} [Tue Nov 23 03:55:12 2021] POST /identity/v3/users => generated 247 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:55:12.842552 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 281/555] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:12.857657 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e787268-afb3-4e52-8b51-4cb38f5ea99f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.876928 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e787268-afb3-4e52-8b51-4cb38f5ea99f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.892144 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31290aab-be20-4e23-a20b-5754edb93c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.894034 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31290aab-be20-4e23-a20b-5754edb93c8e admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.894421 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31290aab-be20-4e23-a20b-5754edb93c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.894796 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31290aab-be20-4e23-a20b-5754edb93c8e admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.904188 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31290aab-be20-4e23-a20b-5754edb93c8e admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.906468 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31290aab-be20-4e23-a20b-5754edb93c8e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.923542 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-31290aab-be20-4e23-a20b-5754edb93c8e admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 23 03:55:12.925769 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 275/556] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/users/neutron => generated 85 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:12.931704 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f394ee-c16b-44ef-8953-6058f4f4e882 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:12.946443 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f394ee-c16b-44ef-8953-6058f4f4e882 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:12.956965 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef743b23-01c2-4836-8d0d-f92f55a5aee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:12.958074 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef743b23-01c2-4836-8d0d-f92f55a5aee6 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:12.958608 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef743b23-01c2-4836-8d0d-f92f55a5aee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:12.959084 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef743b23-01c2-4836-8d0d-f92f55a5aee6 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:12.960258 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef743b23-01c2-4836-8d0d-f92f55a5aee6 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:12.960776 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef743b23-01c2-4836-8d0d-f92f55a5aee6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:12.963028 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef743b23-01c2-4836-8d0d-f92f55a5aee6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:12.983858 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 282/557] 10.222.0.54 () {56 vars in 1160 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:12.992125 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31290aab-be20-4e23-a20b-5754edb93c8e admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:13.004252 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31290aab-be20-4e23-a20b-5754edb93c8e admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:13.009312 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadec8b-ae39-4a1f-9d89-b1cce8ee378b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:13.010254 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadec8b-ae39-4a1f-9d89-b1cce8ee378b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:13.010783 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadec8b-ae39-4a1f-9d89-b1cce8ee378b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:13.011271 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadec8b-ae39-4a1f-9d89-b1cce8ee378b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:13.022970 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadec8b-ae39-4a1f-9d89-b1cce8ee378b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:13.025080 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadec8b-ae39-4a1f-9d89-b1cce8ee378b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:13.041482 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 276/558] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:55:13.048018 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef743b23-01c2-4836-8d0d-f92f55a5aee6 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:13.064184 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef743b23-01c2-4836-8d0d-f92f55a5aee6 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:13.069898 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6262e6-6b71-4c9d-90cf-ce3777500fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:13.071012 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6262e6-6b71-4c9d-90cf-ce3777500fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:13.074771 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6262e6-6b71-4c9d-90cf-ce3777500fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:13.075354 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6262e6-6b71-4c9d-90cf-ce3777500fe9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:13.088155 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6262e6-6b71-4c9d-90cf-ce3777500fe9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:13.090506 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6262e6-6b71-4c9d-90cf-ce3777500fe9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:13.109928 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-cc6262e6-6b71-4c9d-90cf-ce3777500fe9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:13.112435 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 283/559] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:13.118649 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadec8b-ae39-4a1f-9d89-b1cce8ee378b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:13.132904 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadec8b-ae39-4a1f-9d89-b1cce8ee378b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:13.137442 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ace27-409d-4172-b1eb-705a25b25d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:13.138084 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ace27-409d-4172-b1eb-705a25b25d94 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:13.138363 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ace27-409d-4172-b1eb-705a25b25d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:13.138634 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ace27-409d-4172-b1eb-705a25b25d94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:13.139454 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ace27-409d-4172-b1eb-705a25b25d94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:13.139756 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ace27-409d-4172-b1eb-705a25b25d94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:13.141314 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ace27-409d-4172-b1eb-705a25b25d94 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:13.154853 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 277/560] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:13.160838 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6262e6-6b71-4c9d-90cf-ce3777500fe9 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:13.172230 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6262e6-6b71-4c9d-90cf-ce3777500fe9 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:13.181872 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6897dd2-5ce1-4f5f-a545-fae506a1d699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:13.182605 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6897dd2-5ce1-4f5f-a545-fae506a1d699 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:13.182888 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6897dd2-5ce1-4f5f-a545-fae506a1d699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:13.183163 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6897dd2-5ce1-4f5f-a545-fae506a1d699 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:13.193179 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6897dd2-5ce1-4f5f-a545-fae506a1d699 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:13.195116 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6897dd2-5ce1-4f5f-a545-fae506a1d699 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:13.211348 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-e6897dd2-5ce1-4f5f-a545-fae506a1d699 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:13.212826 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 284/561] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:13.218912 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ace27-409d-4172-b1eb-705a25b25d94 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:13.232442 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ace27-409d-4172-b1eb-705a25b25d94 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:13.238693 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ede48-d8a9-4a39-94e4-044eb4c96d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:13.239479 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ede48-d8a9-4a39-94e4-044eb4c96d0c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:13.239943 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ede48-d8a9-4a39-94e4-044eb4c96d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:13.240309 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ede48-d8a9-4a39-94e4-044eb4c96d0c admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:13.241228 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ede48-d8a9-4a39-94e4-044eb4c96d0c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:13.241631 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ede48-d8a9-4a39-94e4-044eb4c96d0c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:13.244405 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ede48-d8a9-4a39-94e4-044eb4c96d0c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:13.259157 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 278/562] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:13.265422 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6897dd2-5ce1-4f5f-a545-fae506a1d699 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:13.276415 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6897dd2-5ce1-4f5f-a545-fae506a1d699 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:13.283132 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fd944-305f-4bfd-b5a0-ba992534c786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:13.284035 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fd944-305f-4bfd-b5a0-ba992534c786 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:13.284466 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fd944-305f-4bfd-b5a0-ba992534c786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:13.284882 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fd944-305f-4bfd-b5a0-ba992534c786 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:13.285878 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04fd944-305f-4bfd-b5a0-ba992534c786 admin admin] RBAC: Adding query filter params (role.id=4dde72f5d769401aa566e1c65c1f40d5, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=5c06e29d656f48c99caeb193975b5b91) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:13.286333 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04fd944-305f-4bfd-b5a0-ba992534c786 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:13.288325 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04fd944-305f-4bfd-b5a0-ba992534c786 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:13.298251 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 285/563] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:55:13 2021] GET /identity/v3/role_assignments?user.id=5c06e29d656f48c99caeb193975b5b91&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=4dde72f5d769401aa566e1c65c1f40d5 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:14.978997 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e0ec0-a088-4bea-a4f0-b24c021587c6 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:14.979854 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e0ec0-a088-4bea-a4f0-b24c021587c6 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:14.980270 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e0ec0-a088-4bea-a4f0-b24c021587c6 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:14.982478 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 279/564] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:14.989063 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a27ae-e9af-49a6-a992-e697323e11f5 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:14.989947 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a27ae-e9af-49a6-a992-e697323e11f5 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:14.990401 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a27ae-e9af-49a6-a992-e697323e11f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.019564 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-076a27ae-e9af-49a6-a992-e697323e11f5 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:15.021052 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-076a27ae-e9af-49a6-a992-e697323e11f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:15.033098 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 286/565] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:55:15.080980 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e0ec0-a088-4bea-a4f0-b24c021587c6 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.098078 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e0ec0-a088-4bea-a4f0-b24c021587c6 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:15.103995 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ae185-4463-46bd-8994-95b9f03b86ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:15.105097 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ae185-4463-46bd-8994-95b9f03b86ad admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.105559 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ae185-4463-46bd-8994-95b9f03b86ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.106031 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ae185-4463-46bd-8994-95b9f03b86ad admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.125657 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ae185-4463-46bd-8994-95b9f03b86ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:15.133706 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-085ae185-4463-46bd-8994-95b9f03b86ad admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 03:55:15.139307 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 280/566] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:15.142004 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a27ae-e9af-49a6-a992-e697323e11f5 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.154535 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a27ae-e9af-49a6-a992-e697323e11f5 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:15.159791 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959399f8-4d05-4220-a6f2-a18b9a66da1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:15.160647 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959399f8-4d05-4220-a6f2-a18b9a66da1c admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.161107 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959399f8-4d05-4220-a6f2-a18b9a66da1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.161550 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959399f8-4d05-4220-a6f2-a18b9a66da1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.162498 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959399f8-4d05-4220-a6f2-a18b9a66da1c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:15.162976 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959399f8-4d05-4220-a6f2-a18b9a66da1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:15.164741 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959399f8-4d05-4220-a6f2-a18b9a66da1c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:15.178994 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 287/567] 10.222.0.54 () {56 vars in 1124 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:15.185378 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ae185-4463-46bd-8994-95b9f03b86ad admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.200013 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ae185-4463-46bd-8994-95b9f03b86ad admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:15.204714 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f68886-3942-4377-b450-8812ce6bf7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:15.205743 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f68886-3942-4377-b450-8812ce6bf7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.206360 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f68886-3942-4377-b450-8812ce6bf7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.206811 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f68886-3942-4377-b450-8812ce6bf7e4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.222866 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f68886-3942-4377-b450-8812ce6bf7e4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:15.224962 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f68886-3942-4377-b450-8812ce6bf7e4 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:15.244074 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-45f68886-3942-4377-b450-8812ce6bf7e4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:15.250506 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 281/568] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:15.252049 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959399f8-4d05-4220-a6f2-a18b9a66da1c admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.262188 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959399f8-4d05-4220-a6f2-a18b9a66da1c admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:15.264329 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14d175-f193-44a5-a836-5cc49b72781f None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.264616 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14d175-f193-44a5-a836-5cc49b72781f None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.264895 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14d175-f193-44a5-a836-5cc49b72781f None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.269603 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 282/569] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:15.274675 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae377a3-d539-4b5f-a6ba-8b89b54608f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:15.275022 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6646b0-7c71-4ec7-89a2-ca6d201505b3 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.275406 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae377a3-d539-4b5f-a6ba-8b89b54608f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.275691 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae377a3-d539-4b5f-a6ba-8b89b54608f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.275969 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae377a3-d539-4b5f-a6ba-8b89b54608f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.276221 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6646b0-7c71-4ec7-89a2-ca6d201505b3 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.276709 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae377a3-d539-4b5f-a6ba-8b89b54608f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:15.276941 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6646b0-7c71-4ec7-89a2-ca6d201505b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.277037 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae377a3-d539-4b5f-a6ba-8b89b54608f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:15.278677 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae377a3-d539-4b5f-a6ba-8b89b54608f9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:15.299869 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-8a6646b0-7c71-4ec7-89a2-ca6d201505b3 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:15.302393 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 288/570] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:15.303872 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-8a6646b0-7c71-4ec7-89a2-ca6d201505b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:15.308028 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae377a3-d539-4b5f-a6ba-8b89b54608f9 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.321328 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 283/571] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:55:15.323771 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae377a3-d539-4b5f-a6ba-8b89b54608f9 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:15.335950 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b1f52-087d-45c1-8445-8acf5ed86f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:15.337136 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b1f52-087d-45c1-8445-8acf5ed86f05 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.337623 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b1f52-087d-45c1-8445-8acf5ed86f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.338170 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b1f52-087d-45c1-8445-8acf5ed86f05 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.350449 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b1f52-087d-45c1-8445-8acf5ed86f05 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:15.352970 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b1f52-087d-45c1-8445-8acf5ed86f05 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:15.369476 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-552b1f52-087d-45c1-8445-8acf5ed86f05 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 23 03:55:15.371490 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 289/572] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/users/cinder => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:15.378491 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6646b0-7c71-4ec7-89a2-ca6d201505b3 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.380234 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b1f52-087d-45c1-8445-8acf5ed86f05 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.390162 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b1f52-087d-45c1-8445-8acf5ed86f05 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:15.396320 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6646b0-7c71-4ec7-89a2-ca6d201505b3 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:15.401285 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a38023-8141-4a24-ba9d-d91ae67d72d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:15.402842 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a38023-8141-4a24-ba9d-d91ae67d72d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.403840 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a38023-8141-4a24-ba9d-d91ae67d72d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.404707 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a38023-8141-4a24-ba9d-d91ae67d72d1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.407560 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62c785-f579-4db5-9c71-e0f81fad7d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:15.409434 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62c785-f579-4db5-9c71-e0f81fad7d40 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.410394 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62c785-f579-4db5-9c71-e0f81fad7d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.411279 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62c785-f579-4db5-9c71-e0f81fad7d40 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.413862 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62c785-f579-4db5-9c71-e0f81fad7d40 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:15.414386 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62c785-f579-4db5-9c71-e0f81fad7d40 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:15.417414 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62c785-f579-4db5-9c71-e0f81fad7d40 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:15.429648 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a38023-8141-4a24-ba9d-d91ae67d72d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:15.437127 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-b4a38023-8141-4a24-ba9d-d91ae67d72d1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 03:55:15.438877 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 290/573] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:15.445815 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a38023-8141-4a24-ba9d-d91ae67d72d1 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.454749 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 284/574] 10.222.0.54 () {56 vars in 1158 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:15.461272 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62c785-f579-4db5-9c71-e0f81fad7d40 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.469154 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a38023-8141-4a24-ba9d-d91ae67d72d1 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:15.475031 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62c785-f579-4db5-9c71-e0f81fad7d40 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:15.480499 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50549265-8bd1-4bf5-b83d-c396e8478c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:15.481161 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50549265-8bd1-4bf5-b83d-c396e8478c13 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.481441 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50549265-8bd1-4bf5-b83d-c396e8478c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.481719 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50549265-8bd1-4bf5-b83d-c396e8478c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.482474 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50549265-8bd1-4bf5-b83d-c396e8478c13 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:15.482777 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50549265-8bd1-4bf5-b83d-c396e8478c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:15.484355 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50549265-8bd1-4bf5-b83d-c396e8478c13 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:15.487739 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc0f71-1db1-40c9-a31d-77743400add5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:15.488520 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc0f71-1db1-40c9-a31d-77743400add5 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.488794 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc0f71-1db1-40c9-a31d-77743400add5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.489061 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc0f71-1db1-40c9-a31d-77743400add5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.503707 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 291/575] 10.222.0.54 () {56 vars in 1124 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:15.509547 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50549265-8bd1-4bf5-b83d-c396e8478c13 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.509673 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc0f71-1db1-40c9-a31d-77743400add5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:15.511551 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc0f71-1db1-40c9-a31d-77743400add5 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:15.525854 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50549265-8bd1-4bf5-b83d-c396e8478c13 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:15.535922 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801283a8-a2f4-4ca8-aa25-0af383cabb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:15.536827 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801283a8-a2f4-4ca8-aa25-0af383cabb14 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.537108 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801283a8-a2f4-4ca8-aa25-0af383cabb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.537379 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801283a8-a2f4-4ca8-aa25-0af383cabb14 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.539751 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-32cc0f71-1db1-40c9-a31d-77743400add5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:15.541133 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 285/576] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:15.542237 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bd79f-71ee-49c2-a287-5801c09e9264 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.542456 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bd79f-71ee-49c2-a287-5801c09e9264 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.542730 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bd79f-71ee-49c2-a287-5801c09e9264 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.544637 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 286/577] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:15.548085 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bd79f-71ee-49c2-a287-5801c09e9264 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.550814 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801283a8-a2f4-4ca8-aa25-0af383cabb14 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:15.553359 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801283a8-a2f4-4ca8-aa25-0af383cabb14 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:15.563505 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bd79f-71ee-49c2-a287-5801c09e9264 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:15.569025 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e9bb5-892b-4782-b88b-5e0da6bc0990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:15.569980 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e9bb5-892b-4782-b88b-5e0da6bc0990 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.570483 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e9bb5-892b-4782-b88b-5e0da6bc0990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.570981 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e9bb5-892b-4782-b88b-5e0da6bc0990 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.571605 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-801283a8-a2f4-4ca8-aa25-0af383cabb14 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:15.572241 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e9bb5-892b-4782-b88b-5e0da6bc0990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:15.572768 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e9bb5-892b-4782-b88b-5e0da6bc0990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:15.573065 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 292/578] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:15.574260 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1503b8-fd07-4dd8-9dbc-09dcd2371a8a None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.574544 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1503b8-fd07-4dd8-9dbc-09dcd2371a8a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.574818 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1503b8-fd07-4dd8-9dbc-09dcd2371a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.575504 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e9bb5-892b-4782-b88b-5e0da6bc0990 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:15.591878 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 287/579] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:15.593173 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e9bb5-892b-4782-b88b-5e0da6bc0990 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.601986 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-ff1503b8-fd07-4dd8-9dbc-09dcd2371a8a None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:15.603473 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e9bb5-892b-4782-b88b-5e0da6bc0990 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:15.603598 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-ff1503b8-fd07-4dd8-9dbc-09dcd2371a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:15.608475 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71817eb5-e332-448a-a655-39924b21ab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:15.609230 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71817eb5-e332-448a-a655-39924b21ab36 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.609513 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71817eb5-e332-448a-a655-39924b21ab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.609834 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71817eb5-e332-448a-a655-39924b21ab36 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.610572 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71817eb5-e332-448a-a655-39924b21ab36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:15.610872 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71817eb5-e332-448a-a655-39924b21ab36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:15.612645 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71817eb5-e332-448a-a655-39924b21ab36 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:15.614737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 293/580] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:55:15.624065 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1503b8-fd07-4dd8-9dbc-09dcd2371a8a None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.625521 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 288/581] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:15.631809 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71817eb5-e332-448a-a655-39924b21ab36 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.636190 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1503b8-fd07-4dd8-9dbc-09dcd2371a8a None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:15.641184 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71817eb5-e332-448a-a655-39924b21ab36 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:15.646081 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9f3d0-201f-4697-a16e-d53ecc7841e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:15.646860 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9f3d0-201f-4697-a16e-d53ecc7841e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.647163 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9f3d0-201f-4697-a16e-d53ecc7841e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.647469 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9f3d0-201f-4697-a16e-d53ecc7841e1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.655359 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9f3d0-201f-4697-a16e-d53ecc7841e1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:15.655914 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6b767-9829-4813-a6f4-e221099ab043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:15.656723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6b767-9829-4813-a6f4-e221099ab043 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.657011 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6b767-9829-4813-a6f4-e221099ab043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.657291 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6b767-9829-4813-a6f4-e221099ab043 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.657438 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9f3d0-201f-4697-a16e-d53ecc7841e1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:15.665658 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6b767-9829-4813-a6f4-e221099ab043 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:15.667943 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6b767-9829-4813-a6f4-e221099ab043 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:15.672468 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-64b9f3d0-201f-4697-a16e-d53ecc7841e1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 03:55:15.673956 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 289/582] 10.222.0.54 () {56 vars in 1114 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:15.674792 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9f3d0-201f-4697-a16e-d53ecc7841e1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.685950 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-0da6b767-9829-4813-a6f4-e221099ab043 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:15.687716 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 294/583] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:15.688755 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6b767-9829-4813-a6f4-e221099ab043 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.689529 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9f3d0-201f-4697-a16e-d53ecc7841e1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:15.695005 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3355025-f539-4b18-a232-44b6f89fd36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:15.695814 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3355025-f539-4b18-a232-44b6f89fd36b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.696091 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3355025-f539-4b18-a232-44b6f89fd36b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.696362 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3355025-f539-4b18-a232-44b6f89fd36b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.702061 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6b767-9829-4813-a6f4-e221099ab043 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:15.707547 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c1495-5d12-4775-8c13-ef02ead5f558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:15.707735 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3355025-f539-4b18-a232-44b6f89fd36b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:15.708772 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c1495-5d12-4775-8c13-ef02ead5f558 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.709236 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c1495-5d12-4775-8c13-ef02ead5f558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.709677 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c1495-5d12-4775-8c13-ef02ead5f558 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.710733 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c1495-5d12-4775-8c13-ef02ead5f558 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:15.711272 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c1495-5d12-4775-8c13-ef02ead5f558 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:15.713519 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c1495-5d12-4775-8c13-ef02ead5f558 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:15.715219 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-f3355025-f539-4b18-a232-44b6f89fd36b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 03:55:15.719247 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 290/584] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:15.719247 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3355025-f539-4b18-a232-44b6f89fd36b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.734041 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3355025-f539-4b18-a232-44b6f89fd36b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:15.735559 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 295/585] 10.222.0.54 () {56 vars in 1154 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:15.740875 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c1495-5d12-4775-8c13-ef02ead5f558 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.746037 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f3066-8ee6-4b84-adcd-d2948ebd95ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:15.746885 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f3066-8ee6-4b84-adcd-d2948ebd95ea admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.747326 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f3066-8ee6-4b84-adcd-d2948ebd95ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.747756 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f3066-8ee6-4b84-adcd-d2948ebd95ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.748693 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f3066-8ee6-4b84-adcd-d2948ebd95ea admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:15.749138 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f3066-8ee6-4b84-adcd-d2948ebd95ea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:15.750792 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c1495-5d12-4775-8c13-ef02ead5f558 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:15.751296 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f3066-8ee6-4b84-adcd-d2948ebd95ea admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:15.756581 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982d59e-5f31-49dc-9667-f896ed0a2958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:15.757377 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982d59e-5f31-49dc-9667-f896ed0a2958 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.757755 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982d59e-5f31-49dc-9667-f896ed0a2958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.758174 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982d59e-5f31-49dc-9667-f896ed0a2958 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.759029 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982d59e-5f31-49dc-9667-f896ed0a2958 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:15.759521 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982d59e-5f31-49dc-9667-f896ed0a2958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:15.761317 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982d59e-5f31-49dc-9667-f896ed0a2958 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:15.766567 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 291/586] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:15.767647 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f3066-8ee6-4b84-adcd-d2948ebd95ea admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.775231 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 296/587] 10.222.0.54 () {56 vars in 1124 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:15.777036 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982d59e-5f31-49dc-9667-f896ed0a2958 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.781788 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f3066-8ee6-4b84-adcd-d2948ebd95ea admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:15.786935 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0ca82-c508-4443-a9d3-337f0d9aa538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:15.787880 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982d59e-5f31-49dc-9667-f896ed0a2958 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:15.787996 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0ca82-c508-4443-a9d3-337f0d9aa538 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.788201 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0ca82-c508-4443-a9d3-337f0d9aa538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.788478 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0ca82-c508-4443-a9d3-337f0d9aa538 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.793848 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75851b51-d73e-4b09-a9d2-891752ecbfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:15.795433 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75851b51-d73e-4b09-a9d2-891752ecbfa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.795811 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75851b51-d73e-4b09-a9d2-891752ecbfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.796223 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75851b51-d73e-4b09-a9d2-891752ecbfa2 admin admin] PATH_INFO: `/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/3dd4736db18940b8961c73142381cee7/roles/4dde72f5d769401aa566e1c65c1f40d5` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.798802 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0ca82-c508-4443-a9d3-337f0d9aa538 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:15.800794 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0ca82-c508-4443-a9d3-337f0d9aa538 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:15.812605 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75851b51-d73e-4b09-a9d2-891752ecbfa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa78bb05b3e48f3a9c973567c781357, user_id=3dd4736db18940b8961c73142381cee7, role_id=4dde72f5d769401aa566e1c65c1f40d5)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:15.816316 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75851b51-d73e-4b09-a9d2-891752ecbfa2 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:15.820192 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-c0e0ca82-c508-4443-a9d3-337f0d9aa538 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:15.821549 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 292/588] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:15.822435 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0ca82-c508-4443-a9d3-337f0d9aa538 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.835440 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0ca82-c508-4443-a9d3-337f0d9aa538 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:15.839999 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639fc4e-b7a0-4bda-bfbf-f9176f9c9fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:15.846924 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639fc4e-b7a0-4bda-bfbf-f9176f9c9fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.846924 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639fc4e-b7a0-4bda-bfbf-f9176f9c9fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.846924 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639fc4e-b7a0-4bda-bfbf-f9176f9c9fc7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.852046 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639fc4e-b7a0-4bda-bfbf-f9176f9c9fc7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:15.853950 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639fc4e-b7a0-4bda-bfbf-f9176f9c9fc7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:15.871311 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-e639fc4e-b7a0-4bda-bfbf-f9176f9c9fc7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:15.877358 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 293/589] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:15.877358 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639fc4e-b7a0-4bda-bfbf-f9176f9c9fc7 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.887404 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639fc4e-b7a0-4bda-bfbf-f9176f9c9fc7 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:15.891716 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4302f-41d8-47cd-b451-30e161684f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:15.892399 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4302f-41d8-47cd-b451-30e161684f95 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:15.893059 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4302f-41d8-47cd-b451-30e161684f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:15.893545 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4302f-41d8-47cd-b451-30e161684f95 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:15.894337 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4302f-41d8-47cd-b451-30e161684f95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:15.894707 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4302f-41d8-47cd-b451-30e161684f95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:15.896343 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4302f-41d8-47cd-b451-30e161684f95 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:15.907016 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 297/590] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:55:15 2021] PUT /identity/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/3dd4736db18940b8961c73142381cee7/roles/4dde72f5d769401aa566e1c65c1f40d5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:55:15.909187 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75851b51-d73e-4b09-a9d2-891752ecbfa2 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.914324 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 294/591] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:15.918774 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4302f-41d8-47cd-b451-30e161684f95 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:15.947140 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4302f-41d8-47cd-b451-30e161684f95 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.060747 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e68374-0ff3-4c87-afa0-b6418d52c34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.062221 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e68374-0ff3-4c87-afa0-b6418d52c34f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.062913 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e68374-0ff3-4c87-afa0-b6418d52c34f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.063637 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e68374-0ff3-4c87-afa0-b6418d52c34f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.081258 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e68374-0ff3-4c87-afa0-b6418d52c34f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:16.087402 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75851b51-d73e-4b09-a9d2-891752ecbfa2 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.087873 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e68374-0ff3-4c87-afa0-b6418d52c34f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:16.099164 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ac258-6b85-4ef3-8db1-54f62a46cfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.100254 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ac258-6b85-4ef3-8db1-54f62a46cfb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.100684 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ac258-6b85-4ef3-8db1-54f62a46cfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.101101 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ac258-6b85-4ef3-8db1-54f62a46cfb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.102054 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ac258-6b85-4ef3-8db1-54f62a46cfb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:16.103540 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ac258-6b85-4ef3-8db1-54f62a46cfb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:16.110583 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ac258-6b85-4ef3-8db1-54f62a46cfb5 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:16.117941 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-23e68374-0ff3-4c87-afa0-b6418d52c34f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:16.122745 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 295/592] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:16.131274 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225bacb-de3b-4b65-9829-08920c7c17ba None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.131274 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225bacb-de3b-4b65-9829-08920c7c17ba None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.131274 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225bacb-de3b-4b65-9829-08920c7c17ba None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.132006 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 296/593] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:16.134420 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225bacb-de3b-4b65-9829-08920c7c17ba None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.136005 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 298/594] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:16.138591 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf34ea-5557-4818-b863-4124639a32a5 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.139099 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf34ea-5557-4818-b863-4124639a32a5 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.139630 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf34ea-5557-4818-b863-4124639a32a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.152615 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225bacb-de3b-4b65-9829-08920c7c17ba None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.157965 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b013f21-5e66-456c-bf83-50b26c06549c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.159185 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b013f21-5e66-456c-bf83-50b26c06549c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.159606 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b013f21-5e66-456c-bf83-50b26c06549c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.159883 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b013f21-5e66-456c-bf83-50b26c06549c admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.160751 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b013f21-5e66-456c-bf83-50b26c06549c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:16.161089 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b013f21-5e66-456c-bf83-50b26c06549c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:16.163097 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b013f21-5e66-456c-bf83-50b26c06549c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:16.164308 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-8adf34ea-5557-4818-b863-4124639a32a5 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:16.166383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-8adf34ea-5557-4818-b863-4124639a32a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:16.176649 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 299/596] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:55:16.176796 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 297/596] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:16.179253 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b013f21-5e66-456c-bf83-50b26c06549c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.183141 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf34ea-5557-4818-b863-4124639a32a5 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.189484 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b013f21-5e66-456c-bf83-50b26c06549c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.197807 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf34ea-5557-4818-b863-4124639a32a5 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.204038 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7aa97-4d09-40da-966a-e56606ee9361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.204843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7aa97-4d09-40da-966a-e56606ee9361 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.205125 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7aa97-4d09-40da-966a-e56606ee9361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.206021 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7aa97-4d09-40da-966a-e56606ee9361 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.207535 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712246e-b4d3-49ac-ada6-7168b03ded02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.208639 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712246e-b4d3-49ac-ada6-7168b03ded02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.209490 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712246e-b4d3-49ac-ada6-7168b03ded02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.209775 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712246e-b4d3-49ac-ada6-7168b03ded02 admin admin] PATH_INFO: `/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/35e14131fb22470cba63cd5e8db359e2/roles/4dde72f5d769401aa566e1c65c1f40d5` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.214337 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7aa97-4d09-40da-966a-e56606ee9361 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:16.216348 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7aa97-4d09-40da-966a-e56606ee9361 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:16.225504 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712246e-b4d3-49ac-ada6-7168b03ded02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa78bb05b3e48f3a9c973567c781357, user_id=35e14131fb22470cba63cd5e8db359e2, role_id=4dde72f5d769401aa566e1c65c1f40d5)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:16.228130 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712246e-b4d3-49ac-ada6-7168b03ded02 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:16.230780 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-a3f7aa97-4d09-40da-966a-e56606ee9361 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 23 03:55:16.232005 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 298/597] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:55:16 2021] GET /identity/v3/users/glance => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:16.233356 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71714bef-5c4d-47df-a24b-ef7500377bac None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.233641 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71714bef-5c4d-47df-a24b-ef7500377bac None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.233917 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71714bef-5c4d-47df-a24b-ef7500377bac None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.235760 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 299/598] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:16.236354 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71714bef-5c4d-47df-a24b-ef7500377bac None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.249170 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71714bef-5c4d-47df-a24b-ef7500377bac None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.253833 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34412f04-898d-47e4-ba99-a86ec9bde2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.254584 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34412f04-898d-47e4-ba99-a86ec9bde2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.254868 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34412f04-898d-47e4-ba99-a86ec9bde2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.255146 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34412f04-898d-47e4-ba99-a86ec9bde2c1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.265299 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34412f04-898d-47e4-ba99-a86ec9bde2c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:16.272816 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-34412f04-898d-47e4-ba99-a86ec9bde2c1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 03:55:16.274146 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 300/599] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:55:16 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:16.274807 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34412f04-898d-47e4-ba99-a86ec9bde2c1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.286520 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34412f04-898d-47e4-ba99-a86ec9bde2c1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.290868 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6178f9-8401-4540-b6d2-99f4ccfd2b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.291517 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6178f9-8401-4540-b6d2-99f4ccfd2b81 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.291800 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6178f9-8401-4540-b6d2-99f4ccfd2b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.293313 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6178f9-8401-4540-b6d2-99f4ccfd2b81 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.293313 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6178f9-8401-4540-b6d2-99f4ccfd2b81 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:16.293313 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6178f9-8401-4540-b6d2-99f4ccfd2b81 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:16.294988 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6178f9-8401-4540-b6d2-99f4ccfd2b81 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:16.320678 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 301/600] 10.222.0.54 () {56 vars in 1158 bytes} [Tue Nov 23 03:55:16 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:16.320678 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ec1fb-67de-4ea5-a902-31636b327797 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.320678 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ec1fb-67de-4ea5-a902-31636b327797 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.320678 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ec1fb-67de-4ea5-a902-31636b327797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.322552 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 300/601] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:55:16 2021] PUT /identity/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/35e14131fb22470cba63cd5e8db359e2/roles/4dde72f5d769401aa566e1c65c1f40d5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 03:55:16.332290 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712246e-b4d3-49ac-ada6-7168b03ded02 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.335829 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-0d7ec1fb-67de-4ea5-a902-31636b327797 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:16.337040 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-0d7ec1fb-67de-4ea5-a902-31636b327797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:16.411356 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 302/602] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:55:16.411356 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ec1fb-67de-4ea5-a902-31636b327797 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.426577 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ec1fb-67de-4ea5-a902-31636b327797 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.437129 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef87ae-e166-4aac-b1a8-56e6a70a48cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.437921 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef87ae-e166-4aac-b1a8-56e6a70a48cc admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.438204 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef87ae-e166-4aac-b1a8-56e6a70a48cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.438479 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef87ae-e166-4aac-b1a8-56e6a70a48cc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.453863 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef87ae-e166-4aac-b1a8-56e6a70a48cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:16.454095 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712246e-b4d3-49ac-ada6-7168b03ded02 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.457309 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef87ae-e166-4aac-b1a8-56e6a70a48cc admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:16.459508 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121baa5-ec78-45ad-8627-02444d034ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.460196 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121baa5-ec78-45ad-8627-02444d034ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.460482 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121baa5-ec78-45ad-8627-02444d034ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.460763 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121baa5-ec78-45ad-8627-02444d034ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.461602 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121baa5-ec78-45ad-8627-02444d034ab5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:16.461911 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121baa5-ec78-45ad-8627-02444d034ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:16.464284 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121baa5-ec78-45ad-8627-02444d034ab5 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:16.477352 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 301/603] 10.222.0.54 () {56 vars in 1124 bytes} [Tue Nov 23 03:55:16 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:16.478573 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121baa5-ec78-45ad-8627-02444d034ab5 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.480704 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-aeef87ae-e166-4aac-b1a8-56e6a70a48cc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:16.487470 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 303/604] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:16.487470 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef87ae-e166-4aac-b1a8-56e6a70a48cc admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.497526 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121baa5-ec78-45ad-8627-02444d034ab5 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.498633 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef87ae-e166-4aac-b1a8-56e6a70a48cc admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.503765 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a56adb-09e3-4576-ba94-437223e121f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.504431 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25becebf-d798-4a33-bf2f-c0c5506e680d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.504578 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a56adb-09e3-4576-ba94-437223e121f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.504828 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a56adb-09e3-4576-ba94-437223e121f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.505103 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a56adb-09e3-4576-ba94-437223e121f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.506021 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25becebf-d798-4a33-bf2f-c0c5506e680d admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.506442 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25becebf-d798-4a33-bf2f-c0c5506e680d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.506861 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25becebf-d798-4a33-bf2f-c0c5506e680d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.516147 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a56adb-09e3-4576-ba94-437223e121f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:16.518944 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a56adb-09e3-4576-ba94-437223e121f0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:16.523413 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25becebf-d798-4a33-bf2f-c0c5506e680d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:16.532136 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-25becebf-d798-4a33-bf2f-c0c5506e680d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 03:55:16.539320 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-95a56adb-09e3-4576-ba94-437223e121f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:16.539320 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 304/606] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:16.539963 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 302/606] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:55:16 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:16.540072 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a56adb-09e3-4576-ba94-437223e121f0 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.541334 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25becebf-d798-4a33-bf2f-c0c5506e680d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.550195 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a56adb-09e3-4576-ba94-437223e121f0 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.554862 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92866fa0-45b2-4ab0-b6a6-df4b202ccc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.555549 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92866fa0-45b2-4ab0-b6a6-df4b202ccc35 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.555831 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92866fa0-45b2-4ab0-b6a6-df4b202ccc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.556105 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92866fa0-45b2-4ab0-b6a6-df4b202ccc35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.556211 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25becebf-d798-4a33-bf2f-c0c5506e680d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.556840 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92866fa0-45b2-4ab0-b6a6-df4b202ccc35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:16.557664 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92866fa0-45b2-4ab0-b6a6-df4b202ccc35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:16.559240 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92866fa0-45b2-4ab0-b6a6-df4b202ccc35 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:16.565144 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa68e74-de0e-4034-9dd1-50f3ad4f4833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.565996 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa68e74-de0e-4034-9dd1-50f3ad4f4833 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.566437 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa68e74-de0e-4034-9dd1-50f3ad4f4833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.567115 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa68e74-de0e-4034-9dd1-50f3ad4f4833 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.569081 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa68e74-de0e-4034-9dd1-50f3ad4f4833 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:16.569394 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa68e74-de0e-4034-9dd1-50f3ad4f4833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:16.571785 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa68e74-de0e-4034-9dd1-50f3ad4f4833 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:16.573336 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 305/607] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:16.574297 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92866fa0-45b2-4ab0-b6a6-df4b202ccc35 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.584296 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92866fa0-45b2-4ab0-b6a6-df4b202ccc35 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.586976 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 303/608] 10.222.0.54 () {56 vars in 1124 bytes} [Tue Nov 23 03:55:16 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:16.588982 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa68e74-de0e-4034-9dd1-50f3ad4f4833 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.589143 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413e6ac-eedb-4e63-9a1e-36250ddce3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.589846 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413e6ac-eedb-4e63-9a1e-36250ddce3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.590261 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413e6ac-eedb-4e63-9a1e-36250ddce3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.590531 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413e6ac-eedb-4e63-9a1e-36250ddce3c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.591420 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413e6ac-eedb-4e63-9a1e-36250ddce3c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:16.591791 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413e6ac-eedb-4e63-9a1e-36250ddce3c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:16.593447 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413e6ac-eedb-4e63-9a1e-36250ddce3c5 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:16.603068 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa68e74-de0e-4034-9dd1-50f3ad4f4833 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.608950 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 306/609] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:16.609935 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413e6ac-eedb-4e63-9a1e-36250ddce3c5 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.613725 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fdb2a-f061-4a74-8c3a-9b98a6cc218a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.614519 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fdb2a-f061-4a74-8c3a-9b98a6cc218a admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.614796 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fdb2a-f061-4a74-8c3a-9b98a6cc218a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.615072 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fdb2a-f061-4a74-8c3a-9b98a6cc218a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.620909 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413e6ac-eedb-4e63-9a1e-36250ddce3c5 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.625896 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fdb2a-f061-4a74-8c3a-9b98a6cc218a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:16.626654 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5aa954-1762-481f-a904-c6a3b4895238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.627635 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aa954-1762-481f-a904-c6a3b4895238 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.627964 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aa954-1762-481f-a904-c6a3b4895238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.628240 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aa954-1762-481f-a904-c6a3b4895238 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.628617 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fdb2a-f061-4a74-8c3a-9b98a6cc218a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:16.642771 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5aa954-1762-481f-a904-c6a3b4895238 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:16.645001 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5aa954-1762-481f-a904-c6a3b4895238 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:16.647387 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-fa6fdb2a-f061-4a74-8c3a-9b98a6cc218a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:16.649120 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 304/610] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:16.649837 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fdb2a-f061-4a74-8c3a-9b98a6cc218a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.662030 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fdb2a-f061-4a74-8c3a-9b98a6cc218a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.665478 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-8e5aa954-1762-481f-a904-c6a3b4895238 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:16.667068 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 307/611] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:16.668075 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5aa954-1762-481f-a904-c6a3b4895238 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.672345 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4642e-c4dc-4fea-bb9c-89f8d36b13b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.673149 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4642e-c4dc-4fea-bb9c-89f8d36b13b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.673434 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4642e-c4dc-4fea-bb9c-89f8d36b13b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.673719 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4642e-c4dc-4fea-bb9c-89f8d36b13b3 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.684720 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5aa954-1762-481f-a904-c6a3b4895238 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.686103 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4642e-c4dc-4fea-bb9c-89f8d36b13b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:16.688336 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4642e-c4dc-4fea-bb9c-89f8d36b13b3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:16.690265 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097ebc6-8bea-41d5-8459-2d9df1501e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.691203 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097ebc6-8bea-41d5-8459-2d9df1501e54 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.692041 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097ebc6-8bea-41d5-8459-2d9df1501e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.692512 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097ebc6-8bea-41d5-8459-2d9df1501e54 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.693570 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097ebc6-8bea-41d5-8459-2d9df1501e54 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:16.694092 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097ebc6-8bea-41d5-8459-2d9df1501e54 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:16.696352 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097ebc6-8bea-41d5-8459-2d9df1501e54 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:16.703322 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-efe4642e-c4dc-4fea-bb9c-89f8d36b13b3 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 23 03:55:16.710929 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 305/612] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:55:16 2021] GET /identity/v3/users/neutron => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:16.710929 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4642e-c4dc-4fea-bb9c-89f8d36b13b3 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.712115 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 308/613] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:16.716134 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097ebc6-8bea-41d5-8459-2d9df1501e54 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.721790 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4642e-c4dc-4fea-bb9c-89f8d36b13b3 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.727021 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555aeaed-f75e-48a8-8d98-0abb3aeda4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.727530 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097ebc6-8bea-41d5-8459-2d9df1501e54 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.727743 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555aeaed-f75e-48a8-8d98-0abb3aeda4db admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.727985 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555aeaed-f75e-48a8-8d98-0abb3aeda4db admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.728263 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555aeaed-f75e-48a8-8d98-0abb3aeda4db admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.728996 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555aeaed-f75e-48a8-8d98-0abb3aeda4db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:16.729388 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555aeaed-f75e-48a8-8d98-0abb3aeda4db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:16.731084 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555aeaed-f75e-48a8-8d98-0abb3aeda4db admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:16.733870 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14da238-e9a7-4e69-8205-0295de1a3338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.734816 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14da238-e9a7-4e69-8205-0295de1a3338 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.735333 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14da238-e9a7-4e69-8205-0295de1a3338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.735897 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14da238-e9a7-4e69-8205-0295de1a3338 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.737563 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14da238-e9a7-4e69-8205-0295de1a3338 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:16.738171 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14da238-e9a7-4e69-8205-0295de1a3338 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:16.740449 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14da238-e9a7-4e69-8205-0295de1a3338 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:16.745308 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 306/614] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:16.746191 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555aeaed-f75e-48a8-8d98-0abb3aeda4db admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.757822 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555aeaed-f75e-48a8-8d98-0abb3aeda4db admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.761092 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 309/615] 10.222.0.54 () {56 vars in 1160 bytes} [Tue Nov 23 03:55:16 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:16.766152 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14da238-e9a7-4e69-8205-0295de1a3338 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.769366 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63700e1b-2914-4859-9f01-74c7d0c9bfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.770546 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63700e1b-2914-4859-9f01-74c7d0c9bfde admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.771069 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63700e1b-2914-4859-9f01-74c7d0c9bfde admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.771596 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63700e1b-2914-4859-9f01-74c7d0c9bfde admin admin] PATH_INFO: `/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/e1f52add52aa4586aee0b801ceffd764/roles/4dde72f5d769401aa566e1c65c1f40d5` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.776902 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14da238-e9a7-4e69-8205-0295de1a3338 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.781811 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324f22e-c528-4640-832f-34b7c132c147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.782596 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324f22e-c528-4640-832f-34b7c132c147 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.782883 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324f22e-c528-4640-832f-34b7c132c147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.783160 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324f22e-c528-4640-832f-34b7c132c147 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.789669 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63700e1b-2914-4859-9f01-74c7d0c9bfde admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa78bb05b3e48f3a9c973567c781357, user_id=e1f52add52aa4586aee0b801ceffd764, role_id=4dde72f5d769401aa566e1c65c1f40d5)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:16.792359 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324f22e-c528-4640-832f-34b7c132c147 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:16.792974 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63700e1b-2914-4859-9f01-74c7d0c9bfde admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:16.794354 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324f22e-c528-4640-832f-34b7c132c147 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:16.809560 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-d324f22e-c528-4640-832f-34b7c132c147 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 23 03:55:16.810889 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 310/616] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:55:16 2021] GET /identity/v3/users/swift => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:16.811696 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324f22e-c528-4640-832f-34b7c132c147 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.821447 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324f22e-c528-4640-832f-34b7c132c147 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.825895 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d8534-d930-43a3-a73d-cde9b1b87c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.826713 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d8534-d930-43a3-a73d-cde9b1b87c43 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.826896 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d8534-d930-43a3-a73d-cde9b1b87c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.827132 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d8534-d930-43a3-a73d-cde9b1b87c43 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.838147 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d8534-d930-43a3-a73d-cde9b1b87c43 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:16.840086 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d8534-d930-43a3-a73d-cde9b1b87c43 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:16.856877 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-1a5d8534-d930-43a3-a73d-cde9b1b87c43 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:16.860084 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 311/617] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:16.860084 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d8534-d930-43a3-a73d-cde9b1b87c43 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.869960 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d8534-d930-43a3-a73d-cde9b1b87c43 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:16.874305 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d03398-f9a1-4bb6-a0c2-87d8dbfc8e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:16.874935 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d03398-f9a1-4bb6-a0c2-87d8dbfc8e94 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:16.875237 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d03398-f9a1-4bb6-a0c2-87d8dbfc8e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:16.875515 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d03398-f9a1-4bb6-a0c2-87d8dbfc8e94 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:16.876354 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d03398-f9a1-4bb6-a0c2-87d8dbfc8e94 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:16.876659 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d03398-f9a1-4bb6-a0c2-87d8dbfc8e94 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:16.878637 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d03398-f9a1-4bb6-a0c2-87d8dbfc8e94 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:16.896976 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 312/618] 10.222.0.54 () {56 vars in 1156 bytes} [Tue Nov 23 03:55:16 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:16.900153 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d03398-f9a1-4bb6-a0c2-87d8dbfc8e94 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.902613 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 307/619] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:55:16 2021] PUT /identity/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/e1f52add52aa4586aee0b801ceffd764/roles/4dde72f5d769401aa566e1c65c1f40d5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:55:16.903655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63700e1b-2914-4859-9f01-74c7d0c9bfde admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:16.912382 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d03398-f9a1-4bb6-a0c2-87d8dbfc8e94 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:17.026692 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d99131-095d-45ee-b1be-ea494e4641af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:17.027400 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d99131-095d-45ee-b1be-ea494e4641af admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:17.027685 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d99131-095d-45ee-b1be-ea494e4641af admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:17.027960 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d99131-095d-45ee-b1be-ea494e4641af admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:17.028707 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d99131-095d-45ee-b1be-ea494e4641af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:17.029012 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d99131-095d-45ee-b1be-ea494e4641af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:17.030621 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d99131-095d-45ee-b1be-ea494e4641af admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:17.036292 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63700e1b-2914-4859-9f01-74c7d0c9bfde admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:17.046104 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa18ba-0f5a-4c20-a662-052aa120b726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:17.046815 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa18ba-0f5a-4c20-a662-052aa120b726 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:17.047098 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa18ba-0f5a-4c20-a662-052aa120b726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:17.047439 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa18ba-0f5a-4c20-a662-052aa120b726 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:17.059904 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 313/620] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:17.062381 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa18ba-0f5a-4c20-a662-052aa120b726 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:17.064613 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa18ba-0f5a-4c20-a662-052aa120b726 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:17.065462 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d99131-095d-45ee-b1be-ea494e4641af admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:17.081113 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d99131-095d-45ee-b1be-ea494e4641af admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:17.086142 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568b272-ac4c-4f83-8127-5815ea4f1694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:17.086644 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 308/621] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:16 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:55:17.092643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568b272-ac4c-4f83-8127-5815ea4f1694 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:17.092643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568b272-ac4c-4f83-8127-5815ea4f1694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:17.092643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568b272-ac4c-4f83-8127-5815ea4f1694 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:17.097226 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa18ba-0f5a-4c20-a662-052aa120b726 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:17.101070 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568b272-ac4c-4f83-8127-5815ea4f1694 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:17.103194 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568b272-ac4c-4f83-8127-5815ea4f1694 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:17.112809 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa18ba-0f5a-4c20-a662-052aa120b726 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:17.118338 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-c568b272-ac4c-4f83-8127-5815ea4f1694 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:17.120117 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 314/622] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:17.125477 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d3dca-c4d1-47ea-8282-79729db8751b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:17.126645 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568b272-ac4c-4f83-8127-5815ea4f1694 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:17.130209 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d3dca-c4d1-47ea-8282-79729db8751b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:17.130525 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d3dca-c4d1-47ea-8282-79729db8751b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:17.130806 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d3dca-c4d1-47ea-8282-79729db8751b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:17.146201 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568b272-ac4c-4f83-8127-5815ea4f1694 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:17.154297 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d3dca-c4d1-47ea-8282-79729db8751b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:17.155226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa31183-4489-45bc-9e73-a322408e5844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:17.156725 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa31183-4489-45bc-9e73-a322408e5844 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:17.157856 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d3dca-c4d1-47ea-8282-79729db8751b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:17.159102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa31183-4489-45bc-9e73-a322408e5844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:17.159466 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa31183-4489-45bc-9e73-a322408e5844 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:17.160237 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa31183-4489-45bc-9e73-a322408e5844 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:17.160877 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa31183-4489-45bc-9e73-a322408e5844 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:17.164941 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa31183-4489-45bc-9e73-a322408e5844 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:17.192325 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-033d3dca-c4d1-47ea-8282-79729db8751b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:17.196015 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 315/623] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:17.199356 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 309/624] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:17.202304 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa31183-4489-45bc-9e73-a322408e5844 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:17.207792 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d3dca-c4d1-47ea-8282-79729db8751b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:17.218048 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d3dca-c4d1-47ea-8282-79729db8751b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:17.219709 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa31183-4489-45bc-9e73-a322408e5844 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:17.224379 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41850f-b5ab-4de3-965b-c93a5dee5bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:17.225458 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41850f-b5ab-4de3-965b-c93a5dee5bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:17.225923 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623698b-4969-4688-9383-1eb7b27338cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:17.226073 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41850f-b5ab-4de3-965b-c93a5dee5bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:17.226494 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41850f-b5ab-4de3-965b-c93a5dee5bdd admin admin] PATH_INFO: `/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/5c06e29d656f48c99caeb193975b5b91/roles/4dde72f5d769401aa566e1c65c1f40d5` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:17.226600 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623698b-4969-4688-9383-1eb7b27338cc admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:17.226850 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623698b-4969-4688-9383-1eb7b27338cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:17.227125 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623698b-4969-4688-9383-1eb7b27338cc admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:17.227996 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623698b-4969-4688-9383-1eb7b27338cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:17.228381 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623698b-4969-4688-9383-1eb7b27338cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:17.230317 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623698b-4969-4688-9383-1eb7b27338cc admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:17.245240 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e41850f-b5ab-4de3-965b-c93a5dee5bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa78bb05b3e48f3a9c973567c781357, user_id=5c06e29d656f48c99caeb193975b5b91, role_id=4dde72f5d769401aa566e1c65c1f40d5)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:17.248177 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e41850f-b5ab-4de3-965b-c93a5dee5bdd admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:17.250680 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 316/625] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:17.254420 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623698b-4969-4688-9383-1eb7b27338cc admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:17.264802 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623698b-4969-4688-9383-1eb7b27338cc admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:17.270102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6340ac-e7da-4515-8d0d-cf5f8bd6562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:17.270946 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6340ac-e7da-4515-8d0d-cf5f8bd6562d admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:17.271251 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6340ac-e7da-4515-8d0d-cf5f8bd6562d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:17.271535 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6340ac-e7da-4515-8d0d-cf5f8bd6562d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:17.278877 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6340ac-e7da-4515-8d0d-cf5f8bd6562d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:17.280878 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6340ac-e7da-4515-8d0d-cf5f8bd6562d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:17.295018 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-eb6340ac-e7da-4515-8d0d-cf5f8bd6562d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:17.301551 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 317/626] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:17.302745 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6340ac-e7da-4515-8d0d-cf5f8bd6562d admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:17.314357 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6340ac-e7da-4515-8d0d-cf5f8bd6562d admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:17.320852 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 310/627] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:55:17 2021] PUT /identity/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/5c06e29d656f48c99caeb193975b5b91/roles/4dde72f5d769401aa566e1c65c1f40d5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:55:17.393005 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70fbf8-dc90-4232-8b13-0f247ba185a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:17.394324 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70fbf8-dc90-4232-8b13-0f247ba185a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:17.394609 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70fbf8-dc90-4232-8b13-0f247ba185a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:17.394879 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70fbf8-dc90-4232-8b13-0f247ba185a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:17.395750 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70fbf8-dc90-4232-8b13-0f247ba185a5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:17.396099 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70fbf8-dc90-4232-8b13-0f247ba185a5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:17.397976 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70fbf8-dc90-4232-8b13-0f247ba185a5 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:17.417909 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 318/628] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:17.424557 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41850f-b5ab-4de3-965b-c93a5dee5bdd admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:17.434862 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41850f-b5ab-4de3-965b-c93a5dee5bdd admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:17.444650 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344685c-64db-4726-81af-0ef2c35080b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:17.445369 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344685c-64db-4726-81af-0ef2c35080b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:17.445656 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344685c-64db-4726-81af-0ef2c35080b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:17.445929 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344685c-64db-4726-81af-0ef2c35080b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:17.446830 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344685c-64db-4726-81af-0ef2c35080b1 admin admin] RBAC: Adding query filter params (role.id=4dde72f5d769401aa566e1c65c1f40d5, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=3bd439c1f0764f4cac7eb641a485937a) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:17.447144 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344685c-64db-4726-81af-0ef2c35080b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:17.449045 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344685c-64db-4726-81af-0ef2c35080b1 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:17.456303 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 311/629] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:55:17 2021] GET /identity/v3/role_assignments?user.id=3bd439c1f0764f4cac7eb641a485937a&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=4dde72f5d769401aa566e1c65c1f40d5 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:18.537185 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e232c9-c72c-4a5e-ba89-d0cb602f4666 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:18.537706 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e232c9-c72c-4a5e-ba89-d0cb602f4666 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:18.537812 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e232c9-c72c-4a5e-ba89-d0cb602f4666 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:18.539808 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 319/630] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:18.557395 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b3611-8948-4a8f-b243-b17d2e6c1a9b None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:18.557868 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b3611-8948-4a8f-b243-b17d2e6c1a9b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:18.557966 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b3611-8948-4a8f-b243-b17d2e6c1a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:18.580738 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-e74b3611-8948-4a8f-b243-b17d2e6c1a9b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:18.581970 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e74b3611-8948-4a8f-b243-b17d2e6c1a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:18.592865 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 312/631] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:55:18.620360 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e232c9-c72c-4a5e-ba89-d0cb602f4666 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:18.634037 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e232c9-c72c-4a5e-ba89-d0cb602f4666 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:18.638933 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81c7cd-8d9c-4c84-b0bb-ef06af75a80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:18.639997 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81c7cd-8d9c-4c84-b0bb-ef06af75a80a admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:18.640477 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81c7cd-8d9c-4c84-b0bb-ef06af75a80a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:18.640938 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81c7cd-8d9c-4c84-b0bb-ef06af75a80a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:18.662073 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81c7cd-8d9c-4c84-b0bb-ef06af75a80a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:18.679235 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-3e81c7cd-8d9c-4c84-b0bb-ef06af75a80a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 03:55:18.680991 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 320/632] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:55:18 2021] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:18.687446 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b3611-8948-4a8f-b243-b17d2e6c1a9b None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:18.697365 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b3611-8948-4a8f-b243-b17d2e6c1a9b None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:18.711516 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae75813-f3bb-4722-9441-bb8c7b33e619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:18.712203 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae75813-f3bb-4722-9441-bb8c7b33e619 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:18.712486 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae75813-f3bb-4722-9441-bb8c7b33e619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:18.712763 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae75813-f3bb-4722-9441-bb8c7b33e619 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:18.713715 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae75813-f3bb-4722-9441-bb8c7b33e619 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:18.714032 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae75813-f3bb-4722-9441-bb8c7b33e619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:18.715698 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae75813-f3bb-4722-9441-bb8c7b33e619 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:18.730706 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 313/633] 10.222.0.54 () {56 vars in 1124 bytes} [Tue Nov 23 03:55:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:18.737012 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81c7cd-8d9c-4c84-b0bb-ef06af75a80a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:18.753373 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81c7cd-8d9c-4c84-b0bb-ef06af75a80a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:18.763642 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35470e-ac5e-4c8d-a2fe-0f3f78b87b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:18.764785 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35470e-ac5e-4c8d-a2fe-0f3f78b87b89 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:18.765280 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35470e-ac5e-4c8d-a2fe-0f3f78b87b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:18.765746 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35470e-ac5e-4c8d-a2fe-0f3f78b87b89 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:18.787530 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35470e-ac5e-4c8d-a2fe-0f3f78b87b89 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:18.789651 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35470e-ac5e-4c8d-a2fe-0f3f78b87b89 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:18.815417 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-6b35470e-ac5e-4c8d-a2fe-0f3f78b87b89 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:18.817224 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 321/634] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:18.823299 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae75813-f3bb-4722-9441-bb8c7b33e619 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:18.840163 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae75813-f3bb-4722-9441-bb8c7b33e619 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:18.852798 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443efe8-2827-4bcd-9520-1fb46a87d877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:18.853467 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443efe8-2827-4bcd-9520-1fb46a87d877 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:18.853753 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443efe8-2827-4bcd-9520-1fb46a87d877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:18.854033 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443efe8-2827-4bcd-9520-1fb46a87d877 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:18.854770 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443efe8-2827-4bcd-9520-1fb46a87d877 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:18.855085 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443efe8-2827-4bcd-9520-1fb46a87d877 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:18.856698 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443efe8-2827-4bcd-9520-1fb46a87d877 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:18.874977 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 314/635] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:18.881625 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35470e-ac5e-4c8d-a2fe-0f3f78b87b89 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:18.896426 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35470e-ac5e-4c8d-a2fe-0f3f78b87b89 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:18.907356 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22907b-c6fa-41c1-bc28-9340296cf725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:18.909049 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22907b-c6fa-41c1-bc28-9340296cf725 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:18.909529 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22907b-c6fa-41c1-bc28-9340296cf725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:18.909994 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22907b-c6fa-41c1-bc28-9340296cf725 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:18.914893 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16919c1-3d92-4ad0-932c-c6a56a5f9342 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:18.915117 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16919c1-3d92-4ad0-932c-c6a56a5f9342 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:18.915413 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16919c1-3d92-4ad0-932c-c6a56a5f9342 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:18.917451 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 315/636] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:18.924193 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22907b-c6fa-41c1-bc28-9340296cf725 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:18.926213 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22907b-c6fa-41c1-bc28-9340296cf725 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:18.931045 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccec523-477f-4218-adc4-c3fbfc85a50a None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:18.931354 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccec523-477f-4218-adc4-c3fbfc85a50a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:18.931634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccec523-477f-4218-adc4-c3fbfc85a50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:18.950687 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-3d22907b-c6fa-41c1-bc28-9340296cf725 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 23 03:55:18.952721 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 322/637] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:55:18 2021] GET /identity/v3/users/cinder => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:18.959239 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22907b-c6fa-41c1-bc28-9340296cf725 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:18.961080 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-eccec523-477f-4218-adc4-c3fbfc85a50a None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:18.962290 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-eccec523-477f-4218-adc4-c3fbfc85a50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:18.969684 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22907b-c6fa-41c1-bc28-9340296cf725 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:18.975079 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25198f13-29f0-420c-9573-3bf80c88db2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:18.975779 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25198f13-29f0-420c-9573-3bf80c88db2f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:18.976064 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25198f13-29f0-420c-9573-3bf80c88db2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:18.976341 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25198f13-29f0-420c-9573-3bf80c88db2f admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:18.977263 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25198f13-29f0-420c-9573-3bf80c88db2f admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:18.977576 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25198f13-29f0-420c-9573-3bf80c88db2f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:18.979522 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25198f13-29f0-420c-9573-3bf80c88db2f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:18.985103 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 316/638] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:55:18.999005 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 323/639] 10.222.0.54 () {56 vars in 1158 bytes} [Tue Nov 23 03:55:18 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:19.005097 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccec523-477f-4218-adc4-c3fbfc85a50a None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:19.016266 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25198f13-29f0-420c-9573-3bf80c88db2f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:19.017414 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccec523-477f-4218-adc4-c3fbfc85a50a None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:19.027041 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25198f13-29f0-420c-9573-3bf80c88db2f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:19.032016 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2acc6-3d4d-4e2a-9552-930b7a14c291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:19.032142 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7833ac-9844-4a8a-9f96-152d68d9b33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:19.032683 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7833ac-9844-4a8a-9f96-152d68d9b33b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.032788 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2acc6-3d4d-4e2a-9552-930b7a14c291 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.032960 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7833ac-9844-4a8a-9f96-152d68d9b33b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.033132 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2acc6-3d4d-4e2a-9552-930b7a14c291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.034019 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2acc6-3d4d-4e2a-9552-930b7a14c291 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.034198 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7833ac-9844-4a8a-9f96-152d68d9b33b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.053842 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7833ac-9844-4a8a-9f96-152d68d9b33b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:19.055526 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7833ac-9844-4a8a-9f96-152d68d9b33b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:19.056773 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2acc6-3d4d-4e2a-9552-930b7a14c291 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:19.071223 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-60b2acc6-3d4d-4e2a-9552-930b7a14c291 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 03:55:19.072444 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 324/640] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:55:19 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:19.075580 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 317/641] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:19 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:55:19.082460 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2acc6-3d4d-4e2a-9552-930b7a14c291 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:19.087743 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7833ac-9844-4a8a-9f96-152d68d9b33b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:19.101430 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7833ac-9844-4a8a-9f96-152d68d9b33b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:19.103787 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2acc6-3d4d-4e2a-9552-930b7a14c291 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:19.112416 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5fab1-eceb-44f9-9677-d44fdadc23e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:19.113362 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30d0f8-f2c5-42e8-a22f-2707a61c01bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:19.114010 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30d0f8-f2c5-42e8-a22f-2707a61c01bb admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.114449 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30d0f8-f2c5-42e8-a22f-2707a61c01bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.114708 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5fab1-eceb-44f9-9677-d44fdadc23e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.114946 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5fab1-eceb-44f9-9677-d44fdadc23e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.115235 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5fab1-eceb-44f9-9677-d44fdadc23e4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.115926 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30d0f8-f2c5-42e8-a22f-2707a61c01bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.116954 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30d0f8-f2c5-42e8-a22f-2707a61c01bb admin admin] RBAC: Adding query filter params (name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:19.117257 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30d0f8-f2c5-42e8-a22f-2707a61c01bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:19.123987 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30d0f8-f2c5-42e8-a22f-2707a61c01bb admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:19.137687 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5fab1-eceb-44f9-9677-d44fdadc23e4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:19.141535 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 325/642] 10.222.0.54 () {56 vars in 1124 bytes} [Tue Nov 23 03:55:19 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:19.141808 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5fab1-eceb-44f9-9677-d44fdadc23e4 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:19.153419 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30d0f8-f2c5-42e8-a22f-2707a61c01bb admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:19.163798 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30d0f8-f2c5-42e8-a22f-2707a61c01bb admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:19.168506 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-68f5fab1-eceb-44f9-9677-d44fdadc23e4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:19.169956 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 318/643] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:19.176517 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5fab1-eceb-44f9-9677-d44fdadc23e4 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:19.178272 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd0cb6-f8e9-4d5a-b6f4-16489e0eb3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:19.182739 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd0cb6-f8e9-4d5a-b6f4-16489e0eb3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.184367 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd0cb6-f8e9-4d5a-b6f4-16489e0eb3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.184874 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd0cb6-f8e9-4d5a-b6f4-16489e0eb3c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.193329 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5fab1-eceb-44f9-9677-d44fdadc23e4 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:19.205429 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076528eb-0fa3-4406-90bf-bafff39a41a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:19.206370 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076528eb-0fa3-4406-90bf-bafff39a41a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.206890 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076528eb-0fa3-4406-90bf-bafff39a41a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.207899 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076528eb-0fa3-4406-90bf-bafff39a41a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.208469 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd0cb6-f8e9-4d5a-b6f4-16489e0eb3c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:19.210345 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076528eb-0fa3-4406-90bf-bafff39a41a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:19.210931 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076528eb-0fa3-4406-90bf-bafff39a41a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:19.212414 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd0cb6-f8e9-4d5a-b6f4-16489e0eb3c2 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:19.214057 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076528eb-0fa3-4406-90bf-bafff39a41a3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:19.237908 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 319/644] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:19.243716 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076528eb-0fa3-4406-90bf-bafff39a41a3 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:19.246794 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-55fd0cb6-f8e9-4d5a-b6f4-16489e0eb3c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:19.248613 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 326/645] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:19.256078 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd0cb6-f8e9-4d5a-b6f4-16489e0eb3c2 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:19.263021 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076528eb-0fa3-4406-90bf-bafff39a41a3 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:19.272214 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd0cb6-f8e9-4d5a-b6f4-16489e0eb3c2 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:19.274981 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689055e1-69d3-4df8-856f-e0c99ade2b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:19.276026 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689055e1-69d3-4df8-856f-e0c99ade2b24 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.276533 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689055e1-69d3-4df8-856f-e0c99ade2b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.277013 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689055e1-69d3-4df8-856f-e0c99ade2b24 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.285242 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689055e1-69d3-4df8-856f-e0c99ade2b24 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:19.287631 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689055e1-69d3-4df8-856f-e0c99ade2b24 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:19.289225 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5799d65-0bed-4615-bbd8-e503e81b8d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:19.289940 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5799d65-0bed-4615-bbd8-e503e81b8d80 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.290228 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5799d65-0bed-4615-bbd8-e503e81b8d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.290502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5799d65-0bed-4615-bbd8-e503e81b8d80 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.291256 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5799d65-0bed-4615-bbd8-e503e81b8d80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:19.291813 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5799d65-0bed-4615-bbd8-e503e81b8d80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:19.293134 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5799d65-0bed-4615-bbd8-e503e81b8d80 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:19.304379 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-689055e1-69d3-4df8-856f-e0c99ade2b24 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:19.306104 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 320/646] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:19.317369 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689055e1-69d3-4df8-856f-e0c99ade2b24 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:19.318722 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 327/647] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:19.324322 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5799d65-0bed-4615-bbd8-e503e81b8d80 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:19.329267 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689055e1-69d3-4df8-856f-e0c99ade2b24 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:19.334772 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f90632-b232-4a41-b418-e199bca19b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:19.335746 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f90632-b232-4a41-b418-e199bca19b0a admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.336225 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f90632-b232-4a41-b418-e199bca19b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.336754 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f90632-b232-4a41-b418-e199bca19b0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.337749 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f90632-b232-4a41-b418-e199bca19b0a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:19.338298 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f90632-b232-4a41-b418-e199bca19b0a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:19.340522 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f90632-b232-4a41-b418-e199bca19b0a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:19.345547 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5799d65-0bed-4615-bbd8-e503e81b8d80 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:19.354224 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 321/648] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:19.364533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393f305-c50d-4488-85eb-6af9ad6bc1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:19.364533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393f305-c50d-4488-85eb-6af9ad6bc1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.364533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393f305-c50d-4488-85eb-6af9ad6bc1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.364533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393f305-c50d-4488-85eb-6af9ad6bc1c3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.365941 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f90632-b232-4a41-b418-e199bca19b0a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:19.376121 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f90632-b232-4a41-b418-e199bca19b0a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:19.381570 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a98ca-541c-466b-8d2b-3ca3f2bd6db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:19.382478 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a98ca-541c-466b-8d2b-3ca3f2bd6db9 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.383002 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a98ca-541c-466b-8d2b-3ca3f2bd6db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.383610 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a98ca-541c-466b-8d2b-3ca3f2bd6db9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.384358 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393f305-c50d-4488-85eb-6af9ad6bc1c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:19.384942 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a98ca-541c-466b-8d2b-3ca3f2bd6db9 admin admin] RBAC: Adding query filter params (role.id=4dde72f5d769401aa566e1c65c1f40d5, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=3dd4736db18940b8961c73142381cee7) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:19.385507 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a98ca-541c-466b-8d2b-3ca3f2bd6db9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:19.386360 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393f305-c50d-4488-85eb-6af9ad6bc1c3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:19.387898 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a98ca-541c-466b-8d2b-3ca3f2bd6db9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:19.396297 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 322/649] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:55:19 2021] GET /identity/v3/role_assignments?user.id=3dd4736db18940b8961c73142381cee7&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=4dde72f5d769401aa566e1c65c1f40d5 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:19.411584 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-0393f305-c50d-4488-85eb-6af9ad6bc1c3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 03:55:19.419646 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 328/650] 10.222.0.54 () {56 vars in 1114 bytes} [Tue Nov 23 03:55:19 2021] GET /identity/v3/users/nova => generated 82 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:19.420848 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a98ca-541c-466b-8d2b-3ca3f2bd6db9 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:19.443071 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a98ca-541c-466b-8d2b-3ca3f2bd6db9 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:19.449409 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422fc83-1588-414b-8a56-ca68ce4beeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:19.450508 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422fc83-1588-414b-8a56-ca68ce4beeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.451019 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422fc83-1588-414b-8a56-ca68ce4beeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.451599 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422fc83-1588-414b-8a56-ca68ce4beeb8 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.452696 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422fc83-1588-414b-8a56-ca68ce4beeb8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:19.453253 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422fc83-1588-414b-8a56-ca68ce4beeb8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:19.455860 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422fc83-1588-414b-8a56-ca68ce4beeb8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:19.496355 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 323/651] 10.222.0.54 () {56 vars in 1154 bytes} [Tue Nov 23 03:55:19 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:19.506095 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393f305-c50d-4488-85eb-6af9ad6bc1c3 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:19.529859 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393f305-c50d-4488-85eb-6af9ad6bc1c3 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:19.544945 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489968a-64bc-4ded-8c5c-fe61f4418f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:19.545750 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489968a-64bc-4ded-8c5c-fe61f4418f87 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.545865 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489968a-64bc-4ded-8c5c-fe61f4418f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.546141 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489968a-64bc-4ded-8c5c-fe61f4418f87 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.563135 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489968a-64bc-4ded-8c5c-fe61f4418f87 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:19.565676 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489968a-64bc-4ded-8c5c-fe61f4418f87 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:19.581857 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 329/652] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:19 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:55:19.588141 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422fc83-1588-414b-8a56-ca68ce4beeb8 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:19.602971 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422fc83-1588-414b-8a56-ca68ce4beeb8 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:19.616298 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4327c6c-69f8-472e-be0a-6f917b16e079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:19.617538 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4327c6c-69f8-472e-be0a-6f917b16e079 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.618026 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4327c6c-69f8-472e-be0a-6f917b16e079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.618518 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4327c6c-69f8-472e-be0a-6f917b16e079 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.637586 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4327c6c-69f8-472e-be0a-6f917b16e079 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:19.639921 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4327c6c-69f8-472e-be0a-6f917b16e079 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:19.659767 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-a4327c6c-69f8-472e-be0a-6f917b16e079 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:19.661795 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 324/653] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:19.671253 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489968a-64bc-4ded-8c5c-fe61f4418f87 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:19.690728 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489968a-64bc-4ded-8c5c-fe61f4418f87 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:19.700745 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d107b-78e9-4d51-a257-189e28bc0732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:19.701427 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d107b-78e9-4d51-a257-189e28bc0732 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.701713 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d107b-78e9-4d51-a257-189e28bc0732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.701991 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d107b-78e9-4d51-a257-189e28bc0732 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.702728 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d107b-78e9-4d51-a257-189e28bc0732 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:19.703036 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d107b-78e9-4d51-a257-189e28bc0732 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:19.704733 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d107b-78e9-4d51-a257-189e28bc0732 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:19.721929 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 330/654] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:19.727465 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4327c6c-69f8-472e-be0a-6f917b16e079 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:19.737887 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4327c6c-69f8-472e-be0a-6f917b16e079 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:19.742582 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f05a4-1bb6-4e8b-8c67-c3c047ab0050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:19.743565 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f05a4-1bb6-4e8b-8c67-c3c047ab0050 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.743986 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f05a4-1bb6-4e8b-8c67-c3c047ab0050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.744398 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f05a4-1bb6-4e8b-8c67-c3c047ab0050 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.751642 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f05a4-1bb6-4e8b-8c67-c3c047ab0050 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:19.753940 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f05a4-1bb6-4e8b-8c67-c3c047ab0050 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:19.768139 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-907f05a4-1bb6-4e8b-8c67-c3c047ab0050 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:19.769960 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 325/655] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:19.775881 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d107b-78e9-4d51-a257-189e28bc0732 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:19.792325 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde6237-25f6-4131-9d79-7a5d05df3177 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.792509 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d107b-78e9-4d51-a257-189e28bc0732 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:19.792826 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde6237-25f6-4131-9d79-7a5d05df3177 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.793204 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde6237-25f6-4131-9d79-7a5d05df3177 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.795395 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 326/656] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:55:19.801157 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae50add-49dd-4b81-9900-15bee93c6a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:19.801778 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4780634-06e1-4e6e-8fe3-3487654be11a None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.802182 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae50add-49dd-4b81-9900-15bee93c6a62 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.802350 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4780634-06e1-4e6e-8fe3-3487654be11a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.802652 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae50add-49dd-4b81-9900-15bee93c6a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.802912 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4780634-06e1-4e6e-8fe3-3487654be11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.803145 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae50add-49dd-4b81-9900-15bee93c6a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.804187 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae50add-49dd-4b81-9900-15bee93c6a62 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:19.804637 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae50add-49dd-4b81-9900-15bee93c6a62 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:19.806879 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae50add-49dd-4b81-9900-15bee93c6a62 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:19.823337 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 331/657] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:19.824446 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-c4780634-06e1-4e6e-8fe3-3487654be11a None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:19.825829 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-c4780634-06e1-4e6e-8fe3-3487654be11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:19.827758 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae50add-49dd-4b81-9900-15bee93c6a62 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:19.839063 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae50add-49dd-4b81-9900-15bee93c6a62 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:19.839459 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 327/658] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:55:19.847788 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b058e-8e18-4499-801b-2ff7b6a7149f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:19.848638 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b058e-8e18-4499-801b-2ff7b6a7149f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.848922 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b058e-8e18-4499-801b-2ff7b6a7149f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.849247 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b058e-8e18-4499-801b-2ff7b6a7149f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.850150 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b058e-8e18-4499-801b-2ff7b6a7149f admin admin] RBAC: Adding query filter params (role.id=4dde72f5d769401aa566e1c65c1f40d5, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=35e14131fb22470cba63cd5e8db359e2) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:19.850456 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b058e-8e18-4499-801b-2ff7b6a7149f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:19.852435 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b058e-8e18-4499-801b-2ff7b6a7149f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:19.859474 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 332/659] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:55:19 2021] GET /identity/v3/role_assignments?user.id=35e14131fb22470cba63cd5e8db359e2&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=4dde72f5d769401aa566e1c65c1f40d5 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:19.867724 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4780634-06e1-4e6e-8fe3-3487654be11a None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:19.877658 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4780634-06e1-4e6e-8fe3-3487654be11a None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:19.882796 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460e0c5-f738-4f28-bd4e-b180badb3e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:19.883717 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460e0c5-f738-4f28-bd4e-b180badb3e97 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.884046 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460e0c5-f738-4f28-bd4e-b180badb3e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.884317 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460e0c5-f738-4f28-bd4e-b180badb3e97 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.897350 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460e0c5-f738-4f28-bd4e-b180badb3e97 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:19.904801 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-f460e0c5-f738-4f28-bd4e-b180badb3e97 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 03:55:19.906247 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 328/660] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:55:19 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:19.912673 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b058e-8e18-4499-801b-2ff7b6a7149f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:19.923226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b058e-8e18-4499-801b-2ff7b6a7149f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:19.928922 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcbe81-b319-4e75-9a73-7c4dbd7153bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:19.929719 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcbe81-b319-4e75-9a73-7c4dbd7153bc admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.930002 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcbe81-b319-4e75-9a73-7c4dbd7153bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.930275 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcbe81-b319-4e75-9a73-7c4dbd7153bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.931129 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfcbe81-b319-4e75-9a73-7c4dbd7153bc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:19.931471 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfcbe81-b319-4e75-9a73-7c4dbd7153bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:19.933170 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfcbe81-b319-4e75-9a73-7c4dbd7153bc admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:19.943810 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 333/661] 10.222.0.54 () {56 vars in 1124 bytes} [Tue Nov 23 03:55:19 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:19.949955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460e0c5-f738-4f28-bd4e-b180badb3e97 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:19.961017 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460e0c5-f738-4f28-bd4e-b180badb3e97 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:19.965851 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c1608-faa2-48d4-9376-ad49b122d039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:19.966699 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c1608-faa2-48d4-9376-ad49b122d039 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:19.966988 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c1608-faa2-48d4-9376-ad49b122d039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:19.967366 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c1608-faa2-48d4-9376-ad49b122d039 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:19.979610 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c1608-faa2-48d4-9376-ad49b122d039 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:19.981506 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c1608-faa2-48d4-9376-ad49b122d039 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:19.999697 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-6b4c1608-faa2-48d4-9376-ad49b122d039 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:20.001255 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 329/662] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:20.007835 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcbe81-b319-4e75-9a73-7c4dbd7153bc admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.018685 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcbe81-b319-4e75-9a73-7c4dbd7153bc admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.023440 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4648cd-d433-4e0f-806f-0cc71209a7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.024202 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4648cd-d433-4e0f-806f-0cc71209a7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.024527 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4648cd-d433-4e0f-806f-0cc71209a7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.024802 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4648cd-d433-4e0f-806f-0cc71209a7b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.025543 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4648cd-d433-4e0f-806f-0cc71209a7b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:20.025892 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4648cd-d433-4e0f-806f-0cc71209a7b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.027575 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4648cd-d433-4e0f-806f-0cc71209a7b0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.041362 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 334/663] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:20.047696 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c1608-faa2-48d4-9376-ad49b122d039 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.058932 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c1608-faa2-48d4-9376-ad49b122d039 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.063829 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ef45b-c842-49c5-a983-c60051a698af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.064807 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ef45b-c842-49c5-a983-c60051a698af admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.065147 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ef45b-c842-49c5-a983-c60051a698af admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.065498 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ef45b-c842-49c5-a983-c60051a698af admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.075603 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ef45b-c842-49c5-a983-c60051a698af admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.077802 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ef45b-c842-49c5-a983-c60051a698af admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.093846 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-5d8ef45b-c842-49c5-a983-c60051a698af admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 23 03:55:20.095414 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 330/664] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/users/glance => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:20.101730 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4648cd-d433-4e0f-806f-0cc71209a7b0 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.112468 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4648cd-d433-4e0f-806f-0cc71209a7b0 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.117388 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592241c-4617-46d7-8346-4fd83b225ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.118089 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592241c-4617-46d7-8346-4fd83b225ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.118374 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592241c-4617-46d7-8346-4fd83b225ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.118646 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592241c-4617-46d7-8346-4fd83b225ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.119535 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592241c-4617-46d7-8346-4fd83b225ec3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:20.119838 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592241c-4617-46d7-8346-4fd83b225ec3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.121840 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592241c-4617-46d7-8346-4fd83b225ec3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.142090 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 335/665] 10.222.0.54 () {56 vars in 1158 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:20.148446 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ef45b-c842-49c5-a983-c60051a698af admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.159028 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ef45b-c842-49c5-a983-c60051a698af admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.163684 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96486310-d07b-4682-a3c1-e73a0a3322b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.164328 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96486310-d07b-4682-a3c1-e73a0a3322b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.164609 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96486310-d07b-4682-a3c1-e73a0a3322b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.164886 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96486310-d07b-4682-a3c1-e73a0a3322b7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.177968 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96486310-d07b-4682-a3c1-e73a0a3322b7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.179782 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96486310-d07b-4682-a3c1-e73a0a3322b7 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.193704 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 331/666] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:55:20.199902 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592241c-4617-46d7-8346-4fd83b225ec3 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.210484 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592241c-4617-46d7-8346-4fd83b225ec3 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.215405 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493c31b-1d8a-4b69-bfa4-bfa9fb97bafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.216250 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493c31b-1d8a-4b69-bfa4-bfa9fb97bafe admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.216529 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493c31b-1d8a-4b69-bfa4-bfa9fb97bafe admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.216800 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493c31b-1d8a-4b69-bfa4-bfa9fb97bafe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.228788 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493c31b-1d8a-4b69-bfa4-bfa9fb97bafe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.230676 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493c31b-1d8a-4b69-bfa4-bfa9fb97bafe admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.248459 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-1493c31b-1d8a-4b69-bfa4-bfa9fb97bafe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:20.251315 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 336/667] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:20.255535 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237687a2-8c47-45f4-bffe-1b9c21030cfc None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.255831 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237687a2-8c47-45f4-bffe-1b9c21030cfc None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.256111 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237687a2-8c47-45f4-bffe-1b9c21030cfc None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.258208 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 332/668] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:20 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:20.260314 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493c31b-1d8a-4b69-bfa4-bfa9fb97bafe admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.269384 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d469f-c04f-4aa7-a28f-0543bd3a6196 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.269841 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d469f-c04f-4aa7-a28f-0543bd3a6196 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.270306 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d469f-c04f-4aa7-a28f-0543bd3a6196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.271934 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493c31b-1d8a-4b69-bfa4-bfa9fb97bafe admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.278576 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbe6af-9219-437f-adfc-8d62ac0b075c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.279254 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbe6af-9219-437f-adfc-8d62ac0b075c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.279541 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbe6af-9219-437f-adfc-8d62ac0b075c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.279817 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbe6af-9219-437f-adfc-8d62ac0b075c admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.280556 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbe6af-9219-437f-adfc-8d62ac0b075c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:20.280862 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbe6af-9219-437f-adfc-8d62ac0b075c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.282451 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbe6af-9219-437f-adfc-8d62ac0b075c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.292381 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-ff8d469f-c04f-4aa7-a28f-0543bd3a6196 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:20.294179 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-ff8d469f-c04f-4aa7-a28f-0543bd3a6196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:20.297319 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 337/669] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:20.304465 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbe6af-9219-437f-adfc-8d62ac0b075c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.310795 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 333/670] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:55:20.315397 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbe6af-9219-437f-adfc-8d62ac0b075c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.320210 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1112c-c18a-4050-9dc1-e142ff13a1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.320982 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1112c-c18a-4050-9dc1-e142ff13a1ed admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.321633 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1112c-c18a-4050-9dc1-e142ff13a1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.321918 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1112c-c18a-4050-9dc1-e142ff13a1ed admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.328982 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1112c-c18a-4050-9dc1-e142ff13a1ed admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.330994 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1112c-c18a-4050-9dc1-e142ff13a1ed admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.344377 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d469f-c04f-4aa7-a28f-0543bd3a6196 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.348790 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-b4a1112c-c18a-4050-9dc1-e142ff13a1ed admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:20.350490 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 338/671] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:20.354118 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d469f-c04f-4aa7-a28f-0543bd3a6196 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.357040 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1112c-c18a-4050-9dc1-e142ff13a1ed admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.359125 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79580cc2-1a9e-48e1-8a78-3df9def946b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.359948 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79580cc2-1a9e-48e1-8a78-3df9def946b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.360237 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79580cc2-1a9e-48e1-8a78-3df9def946b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.360516 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79580cc2-1a9e-48e1-8a78-3df9def946b5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.368785 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1112c-c18a-4050-9dc1-e142ff13a1ed admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.373914 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79580cc2-1a9e-48e1-8a78-3df9def946b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:20.374489 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769d076-adce-4071-9b9b-d5d582d7ccc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.375490 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769d076-adce-4071-9b9b-d5d582d7ccc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.376021 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769d076-adce-4071-9b9b-d5d582d7ccc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.376712 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769d076-adce-4071-9b9b-d5d582d7ccc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.378613 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769d076-adce-4071-9b9b-d5d582d7ccc0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:20.379147 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769d076-adce-4071-9b9b-d5d582d7ccc0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.381402 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769d076-adce-4071-9b9b-d5d582d7ccc0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.381843 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-79580cc2-1a9e-48e1-8a78-3df9def946b5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 03:55:20.383465 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 334/672] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:20.396334 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79580cc2-1a9e-48e1-8a78-3df9def946b5 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.401145 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 339/673] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:20.409091 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769d076-adce-4071-9b9b-d5d582d7ccc0 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.410778 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79580cc2-1a9e-48e1-8a78-3df9def946b5 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.418646 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c1d50-25ad-4cf2-9591-ab623bde7a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.419358 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c1d50-25ad-4cf2-9591-ab623bde7a8a admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.419647 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c1d50-25ad-4cf2-9591-ab623bde7a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.419928 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c1d50-25ad-4cf2-9591-ab623bde7a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.420701 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c1d50-25ad-4cf2-9591-ab623bde7a8a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:20.421010 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c1d50-25ad-4cf2-9591-ab623bde7a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.421479 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769d076-adce-4071-9b9b-d5d582d7ccc0 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.422713 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c1d50-25ad-4cf2-9591-ab623bde7a8a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.427343 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213380e-3939-4dc2-9e98-acb81d2fe771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.428325 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213380e-3939-4dc2-9e98-acb81d2fe771 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.428849 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213380e-3939-4dc2-9e98-acb81d2fe771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.429806 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213380e-3939-4dc2-9e98-acb81d2fe771 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.431226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213380e-3939-4dc2-9e98-acb81d2fe771 admin admin] RBAC: Adding query filter params (role.id=4dde72f5d769401aa566e1c65c1f40d5, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=e1f52add52aa4586aee0b801ceffd764) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:20.431738 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213380e-3939-4dc2-9e98-acb81d2fe771 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.432952 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 335/674] 10.222.0.54 () {56 vars in 1124 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:20.434181 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213380e-3939-4dc2-9e98-acb81d2fe771 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.438816 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c1d50-25ad-4cf2-9591-ab623bde7a8a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.442362 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 340/675] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/role_assignments?user.id=e1f52add52aa4586aee0b801ceffd764&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=4dde72f5d769401aa566e1c65c1f40d5 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:20.456252 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c1d50-25ad-4cf2-9591-ab623bde7a8a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.464560 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb5ca8-5635-416c-84fb-9f2f73f472b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.465805 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb5ca8-5635-416c-84fb-9f2f73f472b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.466362 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb5ca8-5635-416c-84fb-9f2f73f472b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.466888 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb5ca8-5635-416c-84fb-9f2f73f472b7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.480372 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb5ca8-5635-416c-84fb-9f2f73f472b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.482627 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb5ca8-5635-416c-84fb-9f2f73f472b7 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.502771 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-11bb5ca8-5635-416c-84fb-9f2f73f472b7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:20.504832 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 336/676] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:20.510811 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213380e-3939-4dc2-9e98-acb81d2fe771 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.523736 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213380e-3939-4dc2-9e98-acb81d2fe771 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.529960 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371048e7-bcf9-47ce-9b73-1669097aafd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.531018 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371048e7-bcf9-47ce-9b73-1669097aafd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.531525 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371048e7-bcf9-47ce-9b73-1669097aafd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.532060 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371048e7-bcf9-47ce-9b73-1669097aafd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.533140 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371048e7-bcf9-47ce-9b73-1669097aafd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:20.533777 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371048e7-bcf9-47ce-9b73-1669097aafd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.535786 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371048e7-bcf9-47ce-9b73-1669097aafd4 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.551176 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 341/677] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:20.556742 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb5ca8-5635-416c-84fb-9f2f73f472b7 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.564574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4c9c5-8f24-4f0f-a5da-8ed8d06bc2a9 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.565304 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4c9c5-8f24-4f0f-a5da-8ed8d06bc2a9 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.565803 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4c9c5-8f24-4f0f-a5da-8ed8d06bc2a9 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.568865 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb5ca8-5635-416c-84fb-9f2f73f472b7 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.569004 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 342/678] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:20 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:20.574727 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f682c-640c-4d8c-bada-9cbe6c21cde6 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.575031 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410883e-c4bd-4050-80da-07a29f38fc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.575526 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f682c-640c-4d8c-bada-9cbe6c21cde6 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.575876 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410883e-c4bd-4050-80da-07a29f38fc9a admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.576166 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410883e-c4bd-4050-80da-07a29f38fc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.576410 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f682c-640c-4d8c-bada-9cbe6c21cde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.576506 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410883e-c4bd-4050-80da-07a29f38fc9a admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.590183 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410883e-c4bd-4050-80da-07a29f38fc9a admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.592230 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410883e-c4bd-4050-80da-07a29f38fc9a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.602246 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-d09f682c-640c-4d8c-bada-9cbe6c21cde6 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:20.603845 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-d09f682c-640c-4d8c-bada-9cbe6c21cde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:20.608285 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-2410883e-c4bd-4050-80da-07a29f38fc9a admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 23 03:55:20.609854 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 337/679] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/users/neutron => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:20.615574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 343/680] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 03:55:20.617467 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410883e-c4bd-4050-80da-07a29f38fc9a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.628380 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410883e-c4bd-4050-80da-07a29f38fc9a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.633586 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac3e5a-989e-4997-b179-63e21a2724e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.634692 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac3e5a-989e-4997-b179-63e21a2724e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.635176 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac3e5a-989e-4997-b179-63e21a2724e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.635723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac3e5a-989e-4997-b179-63e21a2724e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.637155 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac3e5a-989e-4997-b179-63e21a2724e9 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:20.637707 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac3e5a-989e-4997-b179-63e21a2724e9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.640942 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f682c-640c-4d8c-bada-9cbe6c21cde6 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.643094 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac3e5a-989e-4997-b179-63e21a2724e9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.653205 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f682c-640c-4d8c-bada-9cbe6c21cde6 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.658644 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec872e3-b85f-4dbe-b59e-159a7fc327c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.660510 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec872e3-b85f-4dbe-b59e-159a7fc327c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.661038 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec872e3-b85f-4dbe-b59e-159a7fc327c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.661508 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec872e3-b85f-4dbe-b59e-159a7fc327c1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.674712 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 338/681] 10.222.0.54 () {56 vars in 1160 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:20.680403 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac3e5a-989e-4997-b179-63e21a2724e9 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.685298 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec872e3-b85f-4dbe-b59e-159a7fc327c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:20.693298 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-9ec872e3-b85f-4dbe-b59e-159a7fc327c1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 03:55:20.694842 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 344/682] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:20.698104 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac3e5a-989e-4997-b179-63e21a2724e9 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.704509 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec872e3-b85f-4dbe-b59e-159a7fc327c1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.714832 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c7fc0-660b-45d3-b432-1c0b912c2d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.715533 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c7fc0-660b-45d3-b432-1c0b912c2d12 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.715811 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c7fc0-660b-45d3-b432-1c0b912c2d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.716091 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c7fc0-660b-45d3-b432-1c0b912c2d12 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.718363 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec872e3-b85f-4dbe-b59e-159a7fc327c1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.725556 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f428d0-1243-40b5-a771-121d9137d669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.726283 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f428d0-1243-40b5-a771-121d9137d669 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.726617 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f428d0-1243-40b5-a771-121d9137d669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.726903 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f428d0-1243-40b5-a771-121d9137d669 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.727747 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f428d0-1243-40b5-a771-121d9137d669 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:20.728088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f428d0-1243-40b5-a771-121d9137d669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.728896 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c7fc0-660b-45d3-b432-1c0b912c2d12 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.729804 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f428d0-1243-40b5-a771-121d9137d669 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.731028 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c7fc0-660b-45d3-b432-1c0b912c2d12 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.741027 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 345/683] 10.222.0.54 () {56 vars in 1124 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:20.744031 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 339/684] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:55:20.750445 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f428d0-1243-40b5-a771-121d9137d669 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.753549 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c7fc0-660b-45d3-b432-1c0b912c2d12 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.761825 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f428d0-1243-40b5-a771-121d9137d669 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.764315 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c7fc0-660b-45d3-b432-1c0b912c2d12 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.766498 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b7ea1-737e-485f-b168-47a7f91520c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.767270 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b7ea1-737e-485f-b168-47a7f91520c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.768061 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b7ea1-737e-485f-b168-47a7f91520c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.768351 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b7ea1-737e-485f-b168-47a7f91520c1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.771742 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e08c2-cae7-4cad-8089-6c4ce550650f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.772823 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e08c2-cae7-4cad-8089-6c4ce550650f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.773344 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e08c2-cae7-4cad-8089-6c4ce550650f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.773814 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e08c2-cae7-4cad-8089-6c4ce550650f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.779676 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b7ea1-737e-485f-b168-47a7f91520c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.781497 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b7ea1-737e-485f-b168-47a7f91520c1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.791352 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e08c2-cae7-4cad-8089-6c4ce550650f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.793845 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e08c2-cae7-4cad-8089-6c4ce550650f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.800751 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-cd4b7ea1-737e-485f-b168-47a7f91520c1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:20.802270 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 346/685] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:20.808109 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b7ea1-737e-485f-b168-47a7f91520c1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.815650 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-444e08c2-cae7-4cad-8089-6c4ce550650f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:20.817902 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 340/686] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:20.823315 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b7ea1-737e-485f-b168-47a7f91520c1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.825513 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e08c2-cae7-4cad-8089-6c4ce550650f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.827868 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a96000-b913-43a2-93df-f527dfe0d3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.828752 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a96000-b913-43a2-93df-f527dfe0d3cd admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.829227 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a96000-b913-43a2-93df-f527dfe0d3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.829676 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a96000-b913-43a2-93df-f527dfe0d3cd admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.831433 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a96000-b913-43a2-93df-f527dfe0d3cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:20.831941 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a96000-b913-43a2-93df-f527dfe0d3cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.833704 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a96000-b913-43a2-93df-f527dfe0d3cd admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.837123 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e08c2-cae7-4cad-8089-6c4ce550650f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.841878 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63012b-0b7a-486d-a32f-8866ff127c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.843103 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63012b-0b7a-486d-a32f-8866ff127c56 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.843509 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63012b-0b7a-486d-a32f-8866ff127c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.843901 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63012b-0b7a-486d-a32f-8866ff127c56 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.845187 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63012b-0b7a-486d-a32f-8866ff127c56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:20.845658 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63012b-0b7a-486d-a32f-8866ff127c56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.847686 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63012b-0b7a-486d-a32f-8866ff127c56 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.848780 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 347/687] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:20.854778 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a96000-b913-43a2-93df-f527dfe0d3cd admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.860599 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 341/688] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:20.866467 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63012b-0b7a-486d-a32f-8866ff127c56 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.870479 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a96000-b913-43a2-93df-f527dfe0d3cd admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.875195 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24b80d-2bc5-4df2-aa15-27238e7bded8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.876231 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24b80d-2bc5-4df2-aa15-27238e7bded8 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.876723 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24b80d-2bc5-4df2-aa15-27238e7bded8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.877874 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63012b-0b7a-486d-a32f-8866ff127c56 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.878205 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24b80d-2bc5-4df2-aa15-27238e7bded8 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.883370 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be3d6d-a9a3-4977-89b2-5eb275423270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.884270 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be3d6d-a9a3-4977-89b2-5eb275423270 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.884660 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be3d6d-a9a3-4977-89b2-5eb275423270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.885057 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be3d6d-a9a3-4977-89b2-5eb275423270 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.888616 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24b80d-2bc5-4df2-aa15-27238e7bded8 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.890910 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24b80d-2bc5-4df2-aa15-27238e7bded8 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.894554 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be3d6d-a9a3-4977-89b2-5eb275423270 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.896599 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be3d6d-a9a3-4977-89b2-5eb275423270 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.912315 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-3b24b80d-2bc5-4df2-aa15-27238e7bded8 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 23 03:55:20.912924 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-39be3d6d-a9a3-4977-89b2-5eb275423270 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:20.913545 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 348/689] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/users/swift => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:20.914779 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 342/690] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:20.919979 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24b80d-2bc5-4df2-aa15-27238e7bded8 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.924411 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be3d6d-a9a3-4977-89b2-5eb275423270 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.930594 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24b80d-2bc5-4df2-aa15-27238e7bded8 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.934162 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be3d6d-a9a3-4977-89b2-5eb275423270 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.935495 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e144b1-103c-46aa-b966-2fbf3dd787fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.936240 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e144b1-103c-46aa-b966-2fbf3dd787fa admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.936527 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e144b1-103c-46aa-b966-2fbf3dd787fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.936850 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e144b1-103c-46aa-b966-2fbf3dd787fa admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.937701 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e144b1-103c-46aa-b966-2fbf3dd787fa admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:20.938064 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e144b1-103c-46aa-b966-2fbf3dd787fa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.940596 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e144b1-103c-46aa-b966-2fbf3dd787fa admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.941016 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31ad71-523d-4198-b8c8-852458bf92f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.942118 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31ad71-523d-4198-b8c8-852458bf92f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.942571 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31ad71-523d-4198-b8c8-852458bf92f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.942993 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31ad71-523d-4198-b8c8-852458bf92f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.944057 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31ad71-523d-4198-b8c8-852458bf92f3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:20.944377 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31ad71-523d-4198-b8c8-852458bf92f3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.946419 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31ad71-523d-4198-b8c8-852458bf92f3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:20.966016 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 343/692] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:20.966203 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 349/692] 10.222.0.54 () {56 vars in 1156 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:20.968263 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31ad71-523d-4198-b8c8-852458bf92f3 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.972301 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e144b1-103c-46aa-b966-2fbf3dd787fa admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:20.981262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31ad71-523d-4198-b8c8-852458bf92f3 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.981764 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e144b1-103c-46aa-b966-2fbf3dd787fa admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:20.987020 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba332307-996a-4bfc-8871-3bbd46f827e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.987619 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09cc34-426c-40ac-907e-4add07bb62d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:20.987832 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba332307-996a-4bfc-8871-3bbd46f827e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.988135 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba332307-996a-4bfc-8871-3bbd46f827e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.988416 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba332307-996a-4bfc-8871-3bbd46f827e3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.989078 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09cc34-426c-40ac-907e-4add07bb62d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:20.989543 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09cc34-426c-40ac-907e-4add07bb62d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:20.990007 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09cc34-426c-40ac-907e-4add07bb62d1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:20.991051 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09cc34-426c-40ac-907e-4add07bb62d1 admin admin] RBAC: Adding query filter params (role.id=4dde72f5d769401aa566e1c65c1f40d5, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=5c06e29d656f48c99caeb193975b5b91) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:20.991571 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09cc34-426c-40ac-907e-4add07bb62d1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:20.993610 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09cc34-426c-40ac-907e-4add07bb62d1 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:21.000029 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba332307-996a-4bfc-8871-3bbd46f827e3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:21.000895 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 344/693] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/role_assignments?user.id=5c06e29d656f48c99caeb193975b5b91&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=4dde72f5d769401aa566e1c65c1f40d5 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:21.002535 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba332307-996a-4bfc-8871-3bbd46f827e3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:21.028288 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-ba332307-996a-4bfc-8871-3bbd46f827e3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:21.035365 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 350/694] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:21.037811 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09cc34-426c-40ac-907e-4add07bb62d1 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:21.048375 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09cc34-426c-40ac-907e-4add07bb62d1 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:21.054217 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbacc29-c948-4b33-81be-8ff287912f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:21.055315 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbacc29-c948-4b33-81be-8ff287912f14 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:21.055803 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbacc29-c948-4b33-81be-8ff287912f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:21.056291 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbacc29-c948-4b33-81be-8ff287912f14 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:21.057232 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbacc29-c948-4b33-81be-8ff287912f14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:21.057740 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbacc29-c948-4b33-81be-8ff287912f14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:21.059617 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbacc29-c948-4b33-81be-8ff287912f14 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:21.082296 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 345/695] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:21.084069 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba332307-996a-4bfc-8871-3bbd46f827e3 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:21.094640 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba332307-996a-4bfc-8871-3bbd46f827e3 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:21.101584 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b16d0-bf92-40a7-a417-369c98c42984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:21.102762 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b16d0-bf92-40a7-a417-369c98c42984 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:21.103281 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b16d0-bf92-40a7-a417-369c98c42984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:21.103866 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b16d0-bf92-40a7-a417-369c98c42984 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:21.113654 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b16d0-bf92-40a7-a417-369c98c42984 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:21.116030 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b16d0-bf92-40a7-a417-369c98c42984 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:21.132788 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-e23b16d0-bf92-40a7-a417-369c98c42984 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:21.139321 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 351/696] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:21.141266 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbacc29-c948-4b33-81be-8ff287912f14 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:21.152908 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbacc29-c948-4b33-81be-8ff287912f14 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:21.168161 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d30f53-3a52-409c-8363-50dea669bda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:21.169229 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d30f53-3a52-409c-8363-50dea669bda1 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:21.169717 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d30f53-3a52-409c-8363-50dea669bda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:21.170204 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d30f53-3a52-409c-8363-50dea669bda1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:21.171234 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d30f53-3a52-409c-8363-50dea669bda1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:21.171762 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d30f53-3a52-409c-8363-50dea669bda1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:21.173919 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d30f53-3a52-409c-8363-50dea669bda1 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:21.194443 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 346/697] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:21.200143 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b16d0-bf92-40a7-a417-369c98c42984 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:21.216629 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b16d0-bf92-40a7-a417-369c98c42984 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:21.225364 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f4d6f-9cb9-48ca-b947-19d5a6ea5fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:21.226613 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f4d6f-9cb9-48ca-b947-19d5a6ea5fb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:21.227099 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f4d6f-9cb9-48ca-b947-19d5a6ea5fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:21.227595 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f4d6f-9cb9-48ca-b947-19d5a6ea5fb2 admin admin] PATH_INFO: `/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/3bd439c1f0764f4cac7eb641a485937a/roles/4dde72f5d769401aa566e1c65c1f40d5` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:21.253469 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f4d6f-9cb9-48ca-b947-19d5a6ea5fb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa78bb05b3e48f3a9c973567c781357, user_id=3bd439c1f0764f4cac7eb641a485937a, role_id=4dde72f5d769401aa566e1c65c1f40d5)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:21.256319 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f4d6f-9cb9-48ca-b947-19d5a6ea5fb2 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:21.328226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 352/698] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:55:21 2021] PUT /identity/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/3bd439c1f0764f4cac7eb641a485937a/roles/4dde72f5d769401aa566e1c65c1f40d5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:55:22.286678 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e112ce-c263-42e1-abe4-774d05e8a0cb None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:22.287676 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e112ce-c263-42e1-abe4-774d05e8a0cb None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:22.288158 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e112ce-c263-42e1-abe4-774d05e8a0cb None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:22.290483 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 347/699] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:22.296661 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e5841-885b-4a56-8ccf-6231ba3bab92 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:22.297079 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e5841-885b-4a56-8ccf-6231ba3bab92 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:22.297222 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e5841-885b-4a56-8ccf-6231ba3bab92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:22.319315 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-d48e5841-885b-4a56-8ccf-6231ba3bab92 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:22.320515 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-d48e5841-885b-4a56-8ccf-6231ba3bab92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:22.394496 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 353/700] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:55:22.436135 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e112ce-c263-42e1-abe4-774d05e8a0cb None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:22.460758 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e112ce-c263-42e1-abe4-774d05e8a0cb None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:22.468720 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95731326-3b9a-4d20-8ebf-b9825b035744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:22.469711 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95731326-3b9a-4d20-8ebf-b9825b035744 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:22.470142 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95731326-3b9a-4d20-8ebf-b9825b035744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:22.470582 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95731326-3b9a-4d20-8ebf-b9825b035744 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:22.471423 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95731326-3b9a-4d20-8ebf-b9825b035744 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:22.472752 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING py.warnings [None req-95731326-3b9a-4d20-8ebf-b9825b035744 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:55:22.472752 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: warnings.warn(msg) Nov 23 03:55:22.472752 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: Nov 23 03:55:22.473968 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95731326-3b9a-4d20-8ebf-b9825b035744 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:22.492942 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-95731326-3b9a-4d20-8ebf-b9825b035744 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 23 03:55:22.494673 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 348/701] 10.222.0.54 () {56 vars in 1150 bytes} [Tue Nov 23 03:55:22 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:22.501127 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e5841-885b-4a56-8ccf-6231ba3bab92 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:22.511047 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e5841-885b-4a56-8ccf-6231ba3bab92 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:22.523437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae781e-d7d0-40db-a1a3-4e4bd1f5df94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:22.524102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae781e-d7d0-40db-a1a3-4e4bd1f5df94 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:22.524387 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae781e-d7d0-40db-a1a3-4e4bd1f5df94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:22.524666 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae781e-d7d0-40db-a1a3-4e4bd1f5df94 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:22.525402 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae781e-d7d0-40db-a1a3-4e4bd1f5df94 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:22.525707 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae781e-d7d0-40db-a1a3-4e4bd1f5df94 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:22.526708 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING py.warnings [None req-f9ae781e-d7d0-40db-a1a3-4e4bd1f5df94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:55:22.526708 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: warnings.warn(msg) Nov 23 03:55:22.526708 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: Nov 23 03:55:22.527622 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae781e-d7d0-40db-a1a3-4e4bd1f5df94 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:22.532746 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 354/702] 10.222.0.54 () {56 vars in 1145 bytes} [Tue Nov 23 03:55:22 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:22.539341 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95731326-3b9a-4d20-8ebf-b9825b035744 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:22.553569 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95731326-3b9a-4d20-8ebf-b9825b035744 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:22.567833 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032552f-a12d-4c38-a5d4-3dd6a51cbc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:22.568766 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032552f-a12d-4c38-a5d4-3dd6a51cbc28 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:22.569296 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032552f-a12d-4c38-a5d4-3dd6a51cbc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:22.569775 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032552f-a12d-4c38-a5d4-3dd6a51cbc28 admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:22.571093 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032552f-a12d-4c38-a5d4-3dd6a51cbc28 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:22.571631 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032552f-a12d-4c38-a5d4-3dd6a51cbc28 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:22.572960 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING py.warnings [None req-d032552f-a12d-4c38-a5d4-3dd6a51cbc28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:55:22.572960 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: warnings.warn(msg) Nov 23 03:55:22.572960 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: Nov 23 03:55:22.574349 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032552f-a12d-4c38-a5d4-3dd6a51cbc28 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:22.584856 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 349/703] 10.222.0.54 () {56 vars in 1145 bytes} [Tue Nov 23 03:55:22 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:23.117524 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cf825-ca4e-4fda-a43b-146d60ea428d None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:23.117854 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cf825-ca4e-4fda-a43b-146d60ea428d None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:23.118192 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cf825-ca4e-4fda-a43b-146d60ea428d None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:23.120270 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 355/704] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:23.137343 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ccc0d-73eb-46b1-b454-2ec97c7ff0e4 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:23.137633 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ccc0d-73eb-46b1-b454-2ec97c7ff0e4 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:23.137910 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ccc0d-73eb-46b1-b454-2ec97c7ff0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:23.158931 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-264ccc0d-73eb-46b1-b454-2ec97c7ff0e4 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:23.161534 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-264ccc0d-73eb-46b1-b454-2ec97c7ff0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:23.172426 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 350/705] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:55:23.208711 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cf825-ca4e-4fda-a43b-146d60ea428d None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:23.223362 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cf825-ca4e-4fda-a43b-146d60ea428d None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:23.231325 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9facc1-0392-4317-81e5-3550369df86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:23.232422 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9facc1-0392-4317-81e5-3550369df86a admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:23.232898 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9facc1-0392-4317-81e5-3550369df86a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:23.233380 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9facc1-0392-4317-81e5-3550369df86a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:23.248313 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9facc1-0392-4317-81e5-3550369df86a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:23.255915 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-5f9facc1-0392-4317-81e5-3550369df86a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:55:23.257364 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 356/706] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:55:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:23.263625 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ccc0d-73eb-46b1-b454-2ec97c7ff0e4 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:23.276188 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ccc0d-73eb-46b1-b454-2ec97c7ff0e4 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:23.287092 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4744fcb-5876-4c5d-9ee2-2f3272470409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:23.287788 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4744fcb-5876-4c5d-9ee2-2f3272470409 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:23.288074 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4744fcb-5876-4c5d-9ee2-2f3272470409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:23.288352 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4744fcb-5876-4c5d-9ee2-2f3272470409 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:23.289124 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4744fcb-5876-4c5d-9ee2-2f3272470409 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:23.289435 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4744fcb-5876-4c5d-9ee2-2f3272470409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:23.291018 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4744fcb-5876-4c5d-9ee2-2f3272470409 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:23.305756 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 351/707] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:55:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:23.311422 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9facc1-0392-4317-81e5-3550369df86a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:23.322104 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9facc1-0392-4317-81e5-3550369df86a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:23.335472 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11058254-7c94-4263-a322-6880a70ca3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:23.336257 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11058254-7c94-4263-a322-6880a70ca3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:23.336544 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11058254-7c94-4263-a322-6880a70ca3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:23.336820 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11058254-7c94-4263-a322-6880a70ca3c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:23.350415 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11058254-7c94-4263-a322-6880a70ca3c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:23.352276 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11058254-7c94-4263-a322-6880a70ca3c5 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:23.375664 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-11058254-7c94-4263-a322-6880a70ca3c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:23.378291 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 357/708] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:23.384272 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4744fcb-5876-4c5d-9ee2-2f3272470409 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:23.401640 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4744fcb-5876-4c5d-9ee2-2f3272470409 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:23.410841 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3f6a3-dfd5-4a7d-a817-670ca30f5dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:23.411541 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3f6a3-dfd5-4a7d-a817-670ca30f5dfc admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:23.411830 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3f6a3-dfd5-4a7d-a817-670ca30f5dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:23.412114 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3f6a3-dfd5-4a7d-a817-670ca30f5dfc admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:23.412856 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3f6a3-dfd5-4a7d-a817-670ca30f5dfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:23.413169 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3f6a3-dfd5-4a7d-a817-670ca30f5dfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:23.414775 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3f6a3-dfd5-4a7d-a817-670ca30f5dfc admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:23.432966 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 352/709] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:23.438581 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11058254-7c94-4263-a322-6880a70ca3c5 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:23.445055 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cf782-2ffe-4b0b-bd08-263d591e0d5b None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:23.445377 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cf782-2ffe-4b0b-bd08-263d591e0d5b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:23.445817 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cf782-2ffe-4b0b-bd08-263d591e0d5b None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:23.447656 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 353/710] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:55:23.453165 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470e21c-d4a1-442f-8d39-61d144b37ee3 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:23.453456 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470e21c-d4a1-442f-8d39-61d144b37ee3 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:23.453732 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11058254-7c94-4263-a322-6880a70ca3c5 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:23.453839 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470e21c-d4a1-442f-8d39-61d144b37ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:23.468026 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e7afe-727a-4880-9873-e66f6cd1bc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:23.468819 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e7afe-727a-4880-9873-e66f6cd1bc01 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:23.470564 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e7afe-727a-4880-9873-e66f6cd1bc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:23.471234 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e7afe-727a-4880-9873-e66f6cd1bc01 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:23.477862 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-f470e21c-d4a1-442f-8d39-61d144b37ee3 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:23.480991 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-f470e21c-d4a1-442f-8d39-61d144b37ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:23.485375 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e7afe-727a-4880-9873-e66f6cd1bc01 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:23.488179 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e7afe-727a-4880-9873-e66f6cd1bc01 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:23.500935 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 354/711] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:55:23.508404 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-a63e7afe-727a-4880-9873-e66f6cd1bc01 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 03:55:23.510068 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 358/712] 10.222.0.54 () {56 vars in 1114 bytes} [Tue Nov 23 03:55:23 2021] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:23.516154 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470e21c-d4a1-442f-8d39-61d144b37ee3 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:23.529252 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470e21c-d4a1-442f-8d39-61d144b37ee3 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:23.536063 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dada1-4083-49fd-994d-81fc17a12169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:23.536795 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dada1-4083-49fd-994d-81fc17a12169 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:23.537084 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dada1-4083-49fd-994d-81fc17a12169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:23.537359 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dada1-4083-49fd-994d-81fc17a12169 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:23.538262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dada1-4083-49fd-994d-81fc17a12169 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:23.538574 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dada1-4083-49fd-994d-81fc17a12169 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:23.540507 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dada1-4083-49fd-994d-81fc17a12169 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:23.546553 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e7afe-727a-4880-9873-e66f6cd1bc01 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:23.560549 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e7afe-727a-4880-9873-e66f6cd1bc01 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:23.561046 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 355/713] 10.222.0.54 () {56 vars in 1154 bytes} [Tue Nov 23 03:55:23 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:23.567687 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dada1-4083-49fd-994d-81fc17a12169 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:23.577932 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dada1-4083-49fd-994d-81fc17a12169 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:23.579749 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4423e02-5f27-450a-9899-dce877fb417b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:23.581306 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4423e02-5f27-450a-9899-dce877fb417b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:23.581815 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4423e02-5f27-450a-9899-dce877fb417b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:23.582290 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4423e02-5f27-450a-9899-dce877fb417b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:23.587244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41788247-f72f-4b63-8c3d-ab287ad41ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:23.587244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41788247-f72f-4b63-8c3d-ab287ad41ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:23.587244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41788247-f72f-4b63-8c3d-ab287ad41ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:23.587244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41788247-f72f-4b63-8c3d-ab287ad41ec0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:23.599002 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4423e02-5f27-450a-9899-dce877fb417b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:23.601156 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4423e02-5f27-450a-9899-dce877fb417b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:23.602884 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41788247-f72f-4b63-8c3d-ab287ad41ec0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:23.606000 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41788247-f72f-4b63-8c3d-ab287ad41ec0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:23.621862 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-b4423e02-5f27-450a-9899-dce877fb417b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:23.623682 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 359/714] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:23.625126 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 356/715] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:23 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:55:23.632519 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4423e02-5f27-450a-9899-dce877fb417b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:23.634658 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41788247-f72f-4b63-8c3d-ab287ad41ec0 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:23.644189 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41788247-f72f-4b63-8c3d-ab287ad41ec0 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:23.648738 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4423e02-5f27-450a-9899-dce877fb417b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:23.648856 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e759f8-62df-487f-8fcf-ef9e793b23d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:23.649756 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e759f8-62df-487f-8fcf-ef9e793b23d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:23.650047 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e759f8-62df-487f-8fcf-ef9e793b23d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:23.650329 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e759f8-62df-487f-8fcf-ef9e793b23d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:23.661527 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e759f8-62df-487f-8fcf-ef9e793b23d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:23.663522 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e759f8-62df-487f-8fcf-ef9e793b23d3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:23.683202 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-13e759f8-62df-487f-8fcf-ef9e793b23d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:23.683916 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5dd00-e236-4734-a4b4-000384518a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:23.684589 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5dd00-e236-4734-a4b4-000384518a6b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:23.684831 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 357/716] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:23.684932 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5dd00-e236-4734-a4b4-000384518a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:23.685136 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5dd00-e236-4734-a4b4-000384518a6b admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:23.685946 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5dd00-e236-4734-a4b4-000384518a6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:23.686255 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5dd00-e236-4734-a4b4-000384518a6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:23.687898 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5dd00-e236-4734-a4b4-000384518a6b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:23.690653 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e759f8-62df-487f-8fcf-ef9e793b23d3 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:23.700876 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e759f8-62df-487f-8fcf-ef9e793b23d3 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:23.706161 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42784bae-2963-48c6-815f-befda9caea74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:23.706814 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42784bae-2963-48c6-815f-befda9caea74 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:23.707149 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42784bae-2963-48c6-815f-befda9caea74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:23.707464 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42784bae-2963-48c6-815f-befda9caea74 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:23.708262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42784bae-2963-48c6-815f-befda9caea74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:23.708572 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42784bae-2963-48c6-815f-befda9caea74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:23.710224 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42784bae-2963-48c6-815f-befda9caea74 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:23.714397 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 360/717] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:23.721419 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5dd00-e236-4734-a4b4-000384518a6b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:23.732846 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 358/718] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:23.741180 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42784bae-2963-48c6-815f-befda9caea74 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:23.748500 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5dd00-e236-4734-a4b4-000384518a6b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:23.757257 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1c05d-ac86-4d0c-aacf-bca05477664e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:23.757924 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1c05d-ac86-4d0c-aacf-bca05477664e admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:23.758933 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42784bae-2963-48c6-815f-befda9caea74 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:23.759649 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1c05d-ac86-4d0c-aacf-bca05477664e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:23.759925 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1c05d-ac86-4d0c-aacf-bca05477664e admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:23.760650 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1c05d-ac86-4d0c-aacf-bca05477664e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:23.765614 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1c05d-ac86-4d0c-aacf-bca05477664e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:23.768499 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8fcdb-6f33-4004-b0eb-4035ebad0e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:23.769549 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8fcdb-6f33-4004-b0eb-4035ebad0e64 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:23.769834 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8fcdb-6f33-4004-b0eb-4035ebad0e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:23.770111 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8fcdb-6f33-4004-b0eb-4035ebad0e64 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:23.785109 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8fcdb-6f33-4004-b0eb-4035ebad0e64 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:23.787929 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8fcdb-6f33-4004-b0eb-4035ebad0e64 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:23.804014 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-4ea8fcdb-6f33-4004-b0eb-4035ebad0e64 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:23.805477 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 359/719] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:23.811741 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8fcdb-6f33-4004-b0eb-4035ebad0e64 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:23.822469 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8fcdb-6f33-4004-b0eb-4035ebad0e64 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:23.827312 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842f715-7102-45af-94db-17bfa2a91f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:23.828007 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842f715-7102-45af-94db-17bfa2a91f43 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:23.828301 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842f715-7102-45af-94db-17bfa2a91f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:23.828582 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842f715-7102-45af-94db-17bfa2a91f43 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:23.829483 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842f715-7102-45af-94db-17bfa2a91f43 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:23.829821 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842f715-7102-45af-94db-17bfa2a91f43 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:23.831995 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842f715-7102-45af-94db-17bfa2a91f43 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:23.845022 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 360/720] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:23.851784 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842f715-7102-45af-94db-17bfa2a91f43 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:23.861980 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842f715-7102-45af-94db-17bfa2a91f43 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:23.866669 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db19eea-7b67-4fdc-a627-18c47b799458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:23.867450 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db19eea-7b67-4fdc-a627-18c47b799458 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:23.867739 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db19eea-7b67-4fdc-a627-18c47b799458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:23.868065 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db19eea-7b67-4fdc-a627-18c47b799458 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:23.869238 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db19eea-7b67-4fdc-a627-18c47b799458 admin admin] RBAC: Adding query filter params (role.id=3db7012b41944542a50049819500eadd, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=35e14131fb22470cba63cd5e8db359e2) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:23.869598 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db19eea-7b67-4fdc-a627-18c47b799458 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:23.877523 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 361/721] 10.222.0.54 () {60 vars in 1153 bytes} [Tue Nov 23 03:55:23 2021] POST /identity/v3/users => generated 254 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:55:23.879102 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db19eea-7b67-4fdc-a627-18c47b799458 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:23.891272 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 361/722] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:55:23 2021] GET /identity/v3/role_assignments?user.id=35e14131fb22470cba63cd5e8db359e2&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=3db7012b41944542a50049819500eadd => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:24.092874 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90332d58-bc1a-4b3c-aec4-fb5c28c495fd None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:24.093289 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90332d58-bc1a-4b3c-aec4-fb5c28c495fd None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:24.093474 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90332d58-bc1a-4b3c-aec4-fb5c28c495fd None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:24.096182 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 362/723] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:24.102573 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc0e91-f5f2-49cc-ac91-0449a9011613 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:24.102892 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc0e91-f5f2-49cc-ac91-0449a9011613 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:24.103137 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc0e91-f5f2-49cc-ac91-0449a9011613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:24.128675 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-4fdc0e91-f5f2-49cc-ac91-0449a9011613 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:24.129916 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-4fdc0e91-f5f2-49cc-ac91-0449a9011613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:24.138394 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 362/724] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:55:24.172567 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90332d58-bc1a-4b3c-aec4-fb5c28c495fd None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:24.188868 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90332d58-bc1a-4b3c-aec4-fb5c28c495fd None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:24.196626 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c2242-4ace-4174-9828-a96cee15fe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:24.197429 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c2242-4ace-4174-9828-a96cee15fe6f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:24.197708 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c2242-4ace-4174-9828-a96cee15fe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:24.197987 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c2242-4ace-4174-9828-a96cee15fe6f admin admin] PATH_INFO: `/v3/services/network` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:24.198668 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c2242-4ace-4174-9828-a96cee15fe6f admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:24.199706 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING py.warnings [None req-541c2242-4ace-4174-9828-a96cee15fe6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:55:24.199706 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: warnings.warn(msg) Nov 23 03:55:24.199706 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: Nov 23 03:55:24.200575 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c2242-4ace-4174-9828-a96cee15fe6f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:24.219007 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-541c2242-4ace-4174-9828-a96cee15fe6f admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 23 03:55:24.220593 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 363/725] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:24 2021] GET /identity/v3/services/network => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:24.231281 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc0e91-f5f2-49cc-ac91-0449a9011613 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:24.243246 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc0e91-f5f2-49cc-ac91-0449a9011613 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:24.246836 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed573172-5ed5-4982-8ed3-fdc7a97e91c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:24.247547 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed573172-5ed5-4982-8ed3-fdc7a97e91c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:24.247833 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed573172-5ed5-4982-8ed3-fdc7a97e91c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:24.248112 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed573172-5ed5-4982-8ed3-fdc7a97e91c6 admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:24.248895 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed573172-5ed5-4982-8ed3-fdc7a97e91c6 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:24.249201 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed573172-5ed5-4982-8ed3-fdc7a97e91c6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:24.250843 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed573172-5ed5-4982-8ed3-fdc7a97e91c6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:24.256448 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 363/726] 10.222.0.54 () {56 vars in 1133 bytes} [Tue Nov 23 03:55:24 2021] GET /identity/v3/services?name=network => generated 124 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:24.261978 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c2242-4ace-4174-9828-a96cee15fe6f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:24.273039 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c2242-4ace-4174-9828-a96cee15fe6f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:24.277729 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d51540-8de4-45ce-9523-c04dd2fb8254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:24.278437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d51540-8de4-45ce-9523-c04dd2fb8254 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:24.278771 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d51540-8de4-45ce-9523-c04dd2fb8254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:24.279053 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d51540-8de4-45ce-9523-c04dd2fb8254 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:24.279816 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d51540-8de4-45ce-9523-c04dd2fb8254 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:24.280177 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d51540-8de4-45ce-9523-c04dd2fb8254 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:24.281820 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d51540-8de4-45ce-9523-c04dd2fb8254 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:24.289404 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 364/727] 10.222.0.54 () {56 vars in 1133 bytes} [Tue Nov 23 03:55:24 2021] GET /identity/v3/services?type=network => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:24.301318 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a908c-3e56-4d59-a60a-9993e8520038 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:24.302285 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a908c-3e56-4d59-a60a-9993e8520038 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:24.302763 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a908c-3e56-4d59-a60a-9993e8520038 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:24.306489 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 364/728] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:24.312258 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796e5f0-cc97-45f6-a9e5-ad7df32048f1 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:24.312805 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796e5f0-cc97-45f6-a9e5-ad7df32048f1 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:24.313067 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796e5f0-cc97-45f6-a9e5-ad7df32048f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:24.335468 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-d796e5f0-cc97-45f6-a9e5-ad7df32048f1 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:24.336681 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-d796e5f0-cc97-45f6-a9e5-ad7df32048f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:24.347514 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 365/729] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:55:24.373681 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a908c-3e56-4d59-a60a-9993e8520038 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:24.392002 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a908c-3e56-4d59-a60a-9993e8520038 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:24.398279 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4175e89-05d1-4a0f-9a6c-7b49b972417f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:24.399087 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4175e89-05d1-4a0f-9a6c-7b49b972417f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:24.399402 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4175e89-05d1-4a0f-9a6c-7b49b972417f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:24.399678 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4175e89-05d1-4a0f-9a6c-7b49b972417f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:24.424263 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4175e89-05d1-4a0f-9a6c-7b49b972417f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:24.431387 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-a4175e89-05d1-4a0f-9a6c-7b49b972417f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 03:55:24.432968 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 365/730] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:55:24 2021] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:24.439478 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796e5f0-cc97-45f6-a9e5-ad7df32048f1 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:24.449446 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796e5f0-cc97-45f6-a9e5-ad7df32048f1 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:24.463808 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec077e-456a-43c1-bd97-70b98d88a26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:24.464502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec077e-456a-43c1-bd97-70b98d88a26c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:24.464834 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec077e-456a-43c1-bd97-70b98d88a26c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:24.465159 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec077e-456a-43c1-bd97-70b98d88a26c admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:24.465990 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec077e-456a-43c1-bd97-70b98d88a26c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:24.466292 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec077e-456a-43c1-bd97-70b98d88a26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:24.468067 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec077e-456a-43c1-bd97-70b98d88a26c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:24.487246 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 366/731] 10.222.0.54 () {56 vars in 1124 bytes} [Tue Nov 23 03:55:24 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:24.493698 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4175e89-05d1-4a0f-9a6c-7b49b972417f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:24.512557 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4175e89-05d1-4a0f-9a6c-7b49b972417f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:24.523765 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e58d1-cc36-401f-94b4-0f0b7a88050f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:24.524573 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e58d1-cc36-401f-94b4-0f0b7a88050f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:24.524854 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e58d1-cc36-401f-94b4-0f0b7a88050f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:24.525127 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e58d1-cc36-401f-94b4-0f0b7a88050f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:24.544081 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e58d1-cc36-401f-94b4-0f0b7a88050f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:24.545916 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e58d1-cc36-401f-94b4-0f0b7a88050f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:24.564732 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-e00e58d1-cc36-401f-94b4-0f0b7a88050f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:24.571304 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 366/732] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:24.573224 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec077e-456a-43c1-bd97-70b98d88a26c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:24.587813 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec077e-456a-43c1-bd97-70b98d88a26c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:24.592603 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f583320-4d50-49c5-9271-ed78ff76e3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:24.593478 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f583320-4d50-49c5-9271-ed78ff76e3ed admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:24.594039 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f583320-4d50-49c5-9271-ed78ff76e3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:24.594542 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f583320-4d50-49c5-9271-ed78ff76e3ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:24.596169 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f583320-4d50-49c5-9271-ed78ff76e3ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:24.596679 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f583320-4d50-49c5-9271-ed78ff76e3ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:24.598452 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f583320-4d50-49c5-9271-ed78ff76e3ed admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:24.615318 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 367/733] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:24.617970 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e58d1-cc36-401f-94b4-0f0b7a88050f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:24.628563 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e58d1-cc36-401f-94b4-0f0b7a88050f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:24.633449 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7986939-527b-4477-9ff5-5465f4609dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:24.634503 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7986939-527b-4477-9ff5-5465f4609dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:24.634985 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7986939-527b-4477-9ff5-5465f4609dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:24.635511 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7986939-527b-4477-9ff5-5465f4609dc8 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:24.644702 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7986939-527b-4477-9ff5-5465f4609dc8 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:24.646989 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7986939-527b-4477-9ff5-5465f4609dc8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:24.660999 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-f7986939-527b-4477-9ff5-5465f4609dc8 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 23 03:55:24.667337 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 367/734] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:55:24 2021] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:24.669256 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f583320-4d50-49c5-9271-ed78ff76e3ed admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:24.684523 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f583320-4d50-49c5-9271-ed78ff76e3ed admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:24.690158 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d156ee5-61f9-4c8b-9b49-133e11260dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:24.691078 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d156ee5-61f9-4c8b-9b49-133e11260dfe admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:24.691879 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d156ee5-61f9-4c8b-9b49-133e11260dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:24.692404 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d156ee5-61f9-4c8b-9b49-133e11260dfe admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:24.693459 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d156ee5-61f9-4c8b-9b49-133e11260dfe admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:24.694005 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d156ee5-61f9-4c8b-9b49-133e11260dfe admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:24.696182 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d156ee5-61f9-4c8b-9b49-133e11260dfe admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:24.719364 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 368/735] 10.222.0.54 () {56 vars in 1156 bytes} [Tue Nov 23 03:55:24 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:24.721595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7986939-527b-4477-9ff5-5465f4609dc8 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:24.731930 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7986939-527b-4477-9ff5-5465f4609dc8 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:24.737171 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb261483-a55e-4bb3-a825-4174465ea499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:24.738036 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb261483-a55e-4bb3-a825-4174465ea499 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:24.738607 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb261483-a55e-4bb3-a825-4174465ea499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:24.739144 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb261483-a55e-4bb3-a825-4174465ea499 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:24.747737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb261483-a55e-4bb3-a825-4174465ea499 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:24.749723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb261483-a55e-4bb3-a825-4174465ea499 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:24.764895 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 368/736] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:24 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 03:55:24.766529 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d156ee5-61f9-4c8b-9b49-133e11260dfe admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:24.776613 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d156ee5-61f9-4c8b-9b49-133e11260dfe admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:24.781466 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7413c1-2186-47ef-8a0c-afdcd4674d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:24.782657 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7413c1-2186-47ef-8a0c-afdcd4674d4a admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:24.783846 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7413c1-2186-47ef-8a0c-afdcd4674d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:24.784425 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7413c1-2186-47ef-8a0c-afdcd4674d4a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:24.802858 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7413c1-2186-47ef-8a0c-afdcd4674d4a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:24.805003 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7413c1-2186-47ef-8a0c-afdcd4674d4a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:24.825635 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-0e7413c1-2186-47ef-8a0c-afdcd4674d4a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:24.827142 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 369/737] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:24.833950 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb261483-a55e-4bb3-a825-4174465ea499 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:24.843364 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb261483-a55e-4bb3-a825-4174465ea499 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:24.851383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23c258-db2c-4c0d-9ce8-2df8ae32876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:24.852312 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23c258-db2c-4c0d-9ce8-2df8ae32876f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:24.852793 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23c258-db2c-4c0d-9ce8-2df8ae32876f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:24.853315 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23c258-db2c-4c0d-9ce8-2df8ae32876f admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:24.854242 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23c258-db2c-4c0d-9ce8-2df8ae32876f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:24.854746 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23c258-db2c-4c0d-9ce8-2df8ae32876f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:24.856564 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23c258-db2c-4c0d-9ce8-2df8ae32876f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:24.877724 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 369/738] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:24.884205 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7413c1-2186-47ef-8a0c-afdcd4674d4a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:24.896131 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7413c1-2186-47ef-8a0c-afdcd4674d4a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:24.903903 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74a97f-2b00-4c98-95e1-deb16d472b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:24.904684 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74a97f-2b00-4c98-95e1-deb16d472b94 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:24.904971 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74a97f-2b00-4c98-95e1-deb16d472b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:24.905242 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74a97f-2b00-4c98-95e1-deb16d472b94 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:24.916416 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74a97f-2b00-4c98-95e1-deb16d472b94 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:24.918689 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74a97f-2b00-4c98-95e1-deb16d472b94 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:24.935451 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-7f74a97f-2b00-4c98-95e1-deb16d472b94 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:24.936985 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 370/739] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:24.944440 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23c258-db2c-4c0d-9ce8-2df8ae32876f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:24.954989 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23c258-db2c-4c0d-9ce8-2df8ae32876f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:24.963543 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c27abc-114d-4196-9bca-3dd521388aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:24.964540 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c27abc-114d-4196-9bca-3dd521388aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:24.965077 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c27abc-114d-4196-9bca-3dd521388aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:24.965570 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c27abc-114d-4196-9bca-3dd521388aa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:24.966622 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c27abc-114d-4196-9bca-3dd521388aa6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:24.967159 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c27abc-114d-4196-9bca-3dd521388aa6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:24.969331 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c27abc-114d-4196-9bca-3dd521388aa6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:24.987487 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 370/740] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:24.990561 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74a97f-2b00-4c98-95e1-deb16d472b94 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:25.003666 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74a97f-2b00-4c98-95e1-deb16d472b94 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:25.010764 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db45cf9-4c96-4b66-847e-51fa880f82be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:25.011715 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db45cf9-4c96-4b66-847e-51fa880f82be admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:25.012198 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db45cf9-4c96-4b66-847e-51fa880f82be admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:25.012744 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db45cf9-4c96-4b66-847e-51fa880f82be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:25.013782 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db45cf9-4c96-4b66-847e-51fa880f82be admin admin] RBAC: Adding query filter params (role.id=4dde72f5d769401aa566e1c65c1f40d5, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=3bd439c1f0764f4cac7eb641a485937a) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:25.014338 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db45cf9-4c96-4b66-847e-51fa880f82be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:25.016535 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db45cf9-4c96-4b66-847e-51fa880f82be admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:25.025429 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 371/741] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:55:24 2021] GET /identity/v3/role_assignments?user.id=3bd439c1f0764f4cac7eb641a485937a&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=4dde72f5d769401aa566e1c65c1f40d5 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:25.737672 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172377d-667b-481c-82c9-edfd206c9aeb None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:25.738616 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172377d-667b-481c-82c9-edfd206c9aeb None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:25.739115 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172377d-667b-481c-82c9-edfd206c9aeb None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:25.741128 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 371/742] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:25 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:25.746892 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab060a48-ca23-4227-9358-55212151a90b None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:25.747346 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab060a48-ca23-4227-9358-55212151a90b None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:25.747518 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab060a48-ca23-4227-9358-55212151a90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:25.769008 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-ab060a48-ca23-4227-9358-55212151a90b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:25.770585 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-ab060a48-ca23-4227-9358-55212151a90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:25.782116 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 372/743] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 03:55:25.806079 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172377d-667b-481c-82c9-edfd206c9aeb None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:25.819360 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172377d-667b-481c-82c9-edfd206c9aeb None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:25.824756 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9782a80-6901-40ac-9fb3-388e23eae069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:25.825634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9782a80-6901-40ac-9fb3-388e23eae069 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:25.826141 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9782a80-6901-40ac-9fb3-388e23eae069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:25.826624 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9782a80-6901-40ac-9fb3-388e23eae069 admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:25.827616 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9782a80-6901-40ac-9fb3-388e23eae069 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:25.828817 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING py.warnings [None req-a9782a80-6901-40ac-9fb3-388e23eae069 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:55:25.828817 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: warnings.warn(msg) Nov 23 03:55:25.828817 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: Nov 23 03:55:25.830598 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9782a80-6901-40ac-9fb3-388e23eae069 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:25.939760 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 372/744] 10.222.0.54 () {60 vars in 1162 bytes} [Tue Nov 23 03:55:25 2021] POST /identity/v3/services => generated 251 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:55:26.629548 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8a838-0f11-437b-8b00-beca04abe3d8 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:26.629926 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8a838-0f11-437b-8b00-beca04abe3d8 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:26.630119 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8a838-0f11-437b-8b00-beca04abe3d8 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:26.632306 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 373/745] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:26.649505 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2a77f-2798-4aab-9b4f-d1b8d35c2594 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:26.649816 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2a77f-2798-4aab-9b4f-d1b8d35c2594 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:26.650072 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2a77f-2798-4aab-9b4f-d1b8d35c2594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:26.675668 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-53a2a77f-2798-4aab-9b4f-d1b8d35c2594 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:26.676908 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-53a2a77f-2798-4aab-9b4f-d1b8d35c2594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:26.713610 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 373/746] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:26 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:26.757375 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8a838-0f11-437b-8b00-beca04abe3d8 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:26.777054 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8a838-0f11-437b-8b00-beca04abe3d8 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:26.781834 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30ae7b-cadf-4f7a-a76b-965f7e04240b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:26.782646 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30ae7b-cadf-4f7a-a76b-965f7e04240b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:26.783523 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30ae7b-cadf-4f7a-a76b-965f7e04240b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:26.783808 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30ae7b-cadf-4f7a-a76b-965f7e04240b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:26.798365 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30ae7b-cadf-4f7a-a76b-965f7e04240b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:26.805641 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-eb30ae7b-cadf-4f7a-a76b-965f7e04240b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:55:26.806865 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 374/747] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:55:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:26.814942 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2a77f-2798-4aab-9b4f-d1b8d35c2594 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:26.824324 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2a77f-2798-4aab-9b4f-d1b8d35c2594 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:26.828901 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8876149-d252-480c-b7b4-369f04266e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:26.829571 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8876149-d252-480c-b7b4-369f04266e74 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:26.830385 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8876149-d252-480c-b7b4-369f04266e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:26.830666 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8876149-d252-480c-b7b4-369f04266e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:26.831457 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8876149-d252-480c-b7b4-369f04266e74 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:26.831768 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8876149-d252-480c-b7b4-369f04266e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:26.833361 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8876149-d252-480c-b7b4-369f04266e74 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:26.842511 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 374/748] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:55:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:26.851448 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30ae7b-cadf-4f7a-a76b-965f7e04240b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:26.864977 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30ae7b-cadf-4f7a-a76b-965f7e04240b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:26.878086 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5d0a8-d605-440f-87e5-e03313f1fb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:26.878086 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5d0a8-d605-440f-87e5-e03313f1fb5c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:26.878086 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5d0a8-d605-440f-87e5-e03313f1fb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:26.878086 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5d0a8-d605-440f-87e5-e03313f1fb5c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:26.878910 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7ba57-4b53-438f-9a4a-e94f436cd062 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:26.878910 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7ba57-4b53-438f-9a4a-e94f436cd062 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:26.879420 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7ba57-4b53-438f-9a4a-e94f436cd062 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:26.882900 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 375/749] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:26 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:26.887875 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f54cf-7ce5-41ee-bf46-df90f6730792 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:26.889815 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f54cf-7ce5-41ee-bf46-df90f6730792 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:26.890323 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f54cf-7ce5-41ee-bf46-df90f6730792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:26.894772 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5d0a8-d605-440f-87e5-e03313f1fb5c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:26.897882 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5d0a8-d605-440f-87e5-e03313f1fb5c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:26.920282 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-c80f54cf-7ce5-41ee-bf46-df90f6730792 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:26.921480 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-c80f54cf-7ce5-41ee-bf46-df90f6730792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:26.931502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-78b5d0a8-d605-440f-87e5-e03313f1fb5c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:26.937235 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 375/750] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:26.940262 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5d0a8-d605-440f-87e5-e03313f1fb5c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:26.943203 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 376/751] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:26 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:55:26.956433 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5d0a8-d605-440f-87e5-e03313f1fb5c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:26.960313 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf3ee4-d6e7-4be0-b4ff-593f83a360df None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:26.960606 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf3ee4-d6e7-4be0-b4ff-593f83a360df None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:26.960959 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf3ee4-d6e7-4be0-b4ff-593f83a360df None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:26.962568 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31cd9d-508c-4be6-802e-21d1429550f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:26.966995 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 377/752] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:55:26.967712 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31cd9d-508c-4be6-802e-21d1429550f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:26.968206 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31cd9d-508c-4be6-802e-21d1429550f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:26.968516 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab86f2-b873-426a-94c6-aed0a3c8af49 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:26.968807 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab86f2-b873-426a-94c6-aed0a3c8af49 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:26.969089 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab86f2-b873-426a-94c6-aed0a3c8af49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:26.969284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31cd9d-508c-4be6-802e-21d1429550f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:26.970211 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31cd9d-508c-4be6-802e-21d1429550f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:26.971495 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31cd9d-508c-4be6-802e-21d1429550f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:26.973527 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31cd9d-508c-4be6-802e-21d1429550f0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:26.992333 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-e9ab86f2-b873-426a-94c6-aed0a3c8af49 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:26.993631 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e9ab86f2-b873-426a-94c6-aed0a3c8af49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:26.996891 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 376/753] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:26.997989 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31cd9d-508c-4be6-802e-21d1429550f0 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:27.009318 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 378/754] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:26 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:27.010248 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab86f2-b873-426a-94c6-aed0a3c8af49 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:27.011468 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31cd9d-508c-4be6-802e-21d1429550f0 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:27.016312 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbbb77-c08f-4203-9f5e-0b89f1b0a000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:27.017573 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbbb77-c08f-4203-9f5e-0b89f1b0a000 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:27.018395 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbbb77-c08f-4203-9f5e-0b89f1b0a000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:27.018852 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbbb77-c08f-4203-9f5e-0b89f1b0a000 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:27.030402 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbbb77-c08f-4203-9f5e-0b89f1b0a000 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:27.037371 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab86f2-b873-426a-94c6-aed0a3c8af49 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:27.039096 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-17cbbb77-c08f-4203-9f5e-0b89f1b0a000 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 03:55:27.040692 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 377/755] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:55:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:27.047264 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbbb77-c08f-4203-9f5e-0b89f1b0a000 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:27.052507 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ac498-2455-4ea2-aedc-a98d99beb182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:27.053422 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ac498-2455-4ea2-aedc-a98d99beb182 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:27.053773 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ac498-2455-4ea2-aedc-a98d99beb182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:27.054116 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ac498-2455-4ea2-aedc-a98d99beb182 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:27.058582 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbbb77-c08f-4203-9f5e-0b89f1b0a000 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:27.062651 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ac498-2455-4ea2-aedc-a98d99beb182 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:27.063686 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8982472-774d-4a79-971e-d1e044a6d25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:27.065069 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8982472-774d-4a79-971e-d1e044a6d25f admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:27.065535 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8982472-774d-4a79-971e-d1e044a6d25f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:27.065892 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ac498-2455-4ea2-aedc-a98d99beb182 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:27.066181 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8982472-774d-4a79-971e-d1e044a6d25f admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:27.067537 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8982472-774d-4a79-971e-d1e044a6d25f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:27.068713 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING py.warnings [None req-f8982472-774d-4a79-971e-d1e044a6d25f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:55:27.068713 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: warnings.warn(msg) Nov 23 03:55:27.068713 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: Nov 23 03:55:27.069940 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8982472-774d-4a79-971e-d1e044a6d25f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:27.083605 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-ed9ac498-2455-4ea2-aedc-a98d99beb182 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 03:55:27.085018 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 379/756] 10.222.0.54 () {56 vars in 1114 bytes} [Tue Nov 23 03:55:27 2021] GET /identity/v3/users/nova => generated 82 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:27.088009 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ac498-2455-4ea2-aedc-a98d99beb182 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:27.103061 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ac498-2455-4ea2-aedc-a98d99beb182 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:27.107586 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee444cbc-4b15-476f-899f-fde3a83b3876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:27.108240 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee444cbc-4b15-476f-899f-fde3a83b3876 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:27.108611 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee444cbc-4b15-476f-899f-fde3a83b3876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:27.108915 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee444cbc-4b15-476f-899f-fde3a83b3876 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:27.109810 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee444cbc-4b15-476f-899f-fde3a83b3876 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:27.110123 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee444cbc-4b15-476f-899f-fde3a83b3876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:27.113177 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee444cbc-4b15-476f-899f-fde3a83b3876 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:27.127357 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 380/757] 10.222.0.54 () {56 vars in 1124 bytes} [Tue Nov 23 03:55:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:27.127357 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee444cbc-4b15-476f-899f-fde3a83b3876 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:27.136701 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee444cbc-4b15-476f-899f-fde3a83b3876 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:27.142074 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702ffde-fa2e-49fe-aea0-450ecb5897f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:27.142738 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702ffde-fa2e-49fe-aea0-450ecb5897f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:27.143025 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702ffde-fa2e-49fe-aea0-450ecb5897f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:27.143627 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702ffde-fa2e-49fe-aea0-450ecb5897f9 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:27.144290 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702ffde-fa2e-49fe-aea0-450ecb5897f9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:27.144601 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702ffde-fa2e-49fe-aea0-450ecb5897f9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:27.146413 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702ffde-fa2e-49fe-aea0-450ecb5897f9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:27.191074 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 381/758] 10.222.0.54 () {56 vars in 1154 bytes} [Tue Nov 23 03:55:27 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:27.191074 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702ffde-fa2e-49fe-aea0-450ecb5897f9 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:27.200445 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702ffde-fa2e-49fe-aea0-450ecb5897f9 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:27.205635 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be078bb7-91aa-4a00-9aeb-6d54b95529ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:27.208034 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be078bb7-91aa-4a00-9aeb-6d54b95529ec admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:27.208957 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be078bb7-91aa-4a00-9aeb-6d54b95529ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:27.209243 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be078bb7-91aa-4a00-9aeb-6d54b95529ec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:27.214193 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 378/759] 10.222.0.54 () {60 vars in 1162 bytes} [Tue Nov 23 03:55:27 2021] POST /identity/v3/services => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 03:55:27.215513 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8982472-774d-4a79-971e-d1e044a6d25f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:27.243891 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be078bb7-91aa-4a00-9aeb-6d54b95529ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:27.245763 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be078bb7-91aa-4a00-9aeb-6d54b95529ec admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:27.256925 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8982472-774d-4a79-971e-d1e044a6d25f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:27.268724 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b6991-a4d6-4253-bc4b-058549f030ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:27.269525 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b6991-a4d6-4253-bc4b-058549f030ee admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:27.269808 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b6991-a4d6-4253-bc4b-058549f030ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:27.270079 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b6991-a4d6-4253-bc4b-058549f030ee admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:27.283652 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-be078bb7-91aa-4a00-9aeb-6d54b95529ec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:27.285096 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 382/760] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:27.288711 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b6991-a4d6-4253-bc4b-058549f030ee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:27.290545 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b6991-a4d6-4253-bc4b-058549f030ee admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:27.292811 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be078bb7-91aa-4a00-9aeb-6d54b95529ec admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:27.309543 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be078bb7-91aa-4a00-9aeb-6d54b95529ec admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:27.319178 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407dc28-4c3c-4333-b30f-df07f32b03a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:27.320095 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407dc28-4c3c-4333-b30f-df07f32b03a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:27.320380 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407dc28-4c3c-4333-b30f-df07f32b03a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:27.320653 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407dc28-4c3c-4333-b30f-df07f32b03a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:27.323050 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407dc28-4c3c-4333-b30f-df07f32b03a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:27.323394 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407dc28-4c3c-4333-b30f-df07f32b03a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:27.327667 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407dc28-4c3c-4333-b30f-df07f32b03a3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:27.332270 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-976b6991-a4d6-4253-bc4b-058549f030ee admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:27.333722 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 379/761] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:27.348297 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b6991-a4d6-4253-bc4b-058549f030ee admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:27.351677 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 383/762] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:27.358238 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407dc28-4c3c-4333-b30f-df07f32b03a3 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:27.360578 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b6991-a4d6-4253-bc4b-058549f030ee admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:27.372080 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efaa27c-94b3-4df7-9b3e-c6028b1518ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:27.372809 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efaa27c-94b3-4df7-9b3e-c6028b1518ee admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:27.373090 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efaa27c-94b3-4df7-9b3e-c6028b1518ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:27.373361 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efaa27c-94b3-4df7-9b3e-c6028b1518ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:27.374168 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efaa27c-94b3-4df7-9b3e-c6028b1518ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:27.374468 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efaa27c-94b3-4df7-9b3e-c6028b1518ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:27.377741 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efaa27c-94b3-4df7-9b3e-c6028b1518ee admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:27.379327 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407dc28-4c3c-4333-b30f-df07f32b03a3 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:27.391516 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d56c9-bf84-492a-83ea-28352f718e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:27.392848 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d56c9-bf84-492a-83ea-28352f718e89 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:27.393182 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d56c9-bf84-492a-83ea-28352f718e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:27.393456 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d56c9-bf84-492a-83ea-28352f718e89 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:27.402005 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 380/763] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:27.409291 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efaa27c-94b3-4df7-9b3e-c6028b1518ee admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:27.414407 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d56c9-bf84-492a-83ea-28352f718e89 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:27.419515 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d56c9-bf84-492a-83ea-28352f718e89 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:27.428029 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efaa27c-94b3-4df7-9b3e-c6028b1518ee admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:27.440898 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfff00-d9f0-448d-be1a-75b1bd3dead6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:27.441994 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfff00-d9f0-448d-be1a-75b1bd3dead6 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:27.442270 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfff00-d9f0-448d-be1a-75b1bd3dead6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:27.442540 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfff00-d9f0-448d-be1a-75b1bd3dead6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:27.447790 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-b20d56c9-bf84-492a-83ea-28352f718e89 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 23 03:55:27.449345 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 384/764] 10.222.0.54 () {56 vars in 1138 bytes} [Tue Nov 23 03:55:27 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:27.450758 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfff00-d9f0-448d-be1a-75b1bd3dead6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:27.452823 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfff00-d9f0-448d-be1a-75b1bd3dead6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:27.456372 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d56c9-bf84-492a-83ea-28352f718e89 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:27.469448 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-decfff00-d9f0-448d-be1a-75b1bd3dead6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:27.471493 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 381/765] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:27.473896 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d56c9-bf84-492a-83ea-28352f718e89 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:27.481867 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfff00-d9f0-448d-be1a-75b1bd3dead6 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:27.485302 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0842c39-e5e2-492c-8ad8-948c40dc1658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:27.487008 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0842c39-e5e2-492c-8ad8-948c40dc1658 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:27.487456 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0842c39-e5e2-492c-8ad8-948c40dc1658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:27.487832 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0842c39-e5e2-492c-8ad8-948c40dc1658 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:27.488786 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0842c39-e5e2-492c-8ad8-948c40dc1658 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:27.489194 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0842c39-e5e2-492c-8ad8-948c40dc1658 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:27.492234 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0842c39-e5e2-492c-8ad8-948c40dc1658 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:27.497122 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfff00-d9f0-448d-be1a-75b1bd3dead6 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:27.502363 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a54e2-6d87-4508-b3ba-498d37414a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:27.503321 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a54e2-6d87-4508-b3ba-498d37414a54 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:27.503759 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a54e2-6d87-4508-b3ba-498d37414a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:27.504174 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a54e2-6d87-4508-b3ba-498d37414a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:27.505120 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a54e2-6d87-4508-b3ba-498d37414a54 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:27.505573 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a54e2-6d87-4508-b3ba-498d37414a54 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:27.507720 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a54e2-6d87-4508-b3ba-498d37414a54 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:27.519169 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 385/766] 10.222.0.54 () {56 vars in 1170 bytes} [Tue Nov 23 03:55:27 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:27.520657 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0842c39-e5e2-492c-8ad8-948c40dc1658 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:27.523270 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 382/767] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:27.533922 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a54e2-6d87-4508-b3ba-498d37414a54 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:27.537494 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0842c39-e5e2-492c-8ad8-948c40dc1658 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:27.542288 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a1d15-42ca-4980-9a8f-cd5e73ccd48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:27.543144 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a1d15-42ca-4980-9a8f-cd5e73ccd48d admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:27.543552 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a1d15-42ca-4980-9a8f-cd5e73ccd48d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:27.544449 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a1d15-42ca-4980-9a8f-cd5e73ccd48d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:27.548092 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a54e2-6d87-4508-b3ba-498d37414a54 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:27.553479 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327ff5f-c50a-4055-9838-fa199100b9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:27.554077 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a1d15-42ca-4980-9a8f-cd5e73ccd48d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:27.554728 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327ff5f-c50a-4055-9838-fa199100b9e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:27.555184 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327ff5f-c50a-4055-9838-fa199100b9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:27.555669 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327ff5f-c50a-4055-9838-fa199100b9e3 admin admin] PATH_INFO: `/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/35e14131fb22470cba63cd5e8db359e2/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:27.556227 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a1d15-42ca-4980-9a8f-cd5e73ccd48d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:27.558180 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327ff5f-c50a-4055-9838-fa199100b9e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa78bb05b3e48f3a9c973567c781357, user_id=35e14131fb22470cba63cd5e8db359e2, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:27.561054 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327ff5f-c50a-4055-9838-fa199100b9e3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:27.567265 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 386/768] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:27 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 03:55:27.572976 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a1d15-42ca-4980-9a8f-cd5e73ccd48d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:27.582308 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a1d15-42ca-4980-9a8f-cd5e73ccd48d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:27.587385 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfffe41-51dc-4f06-a2ab-5baf5c61c544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:27.588839 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfffe41-51dc-4f06-a2ab-5baf5c61c544 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:27.588839 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfffe41-51dc-4f06-a2ab-5baf5c61c544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:27.588839 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfffe41-51dc-4f06-a2ab-5baf5c61c544 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:27.601869 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfffe41-51dc-4f06-a2ab-5baf5c61c544 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:27.603763 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfffe41-51dc-4f06-a2ab-5baf5c61c544 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:27.619020 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 383/769] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:55:27 2021] PUT /identity/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/35e14131fb22470cba63cd5e8db359e2/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:55:27.635129 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-dbfffe41-51dc-4f06-a2ab-5baf5c61c544 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:27.637283 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 387/770] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:27.643686 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327ff5f-c50a-4055-9838-fa199100b9e3 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:27.752622 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327ff5f-c50a-4055-9838-fa199100b9e3 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:27.759491 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a5643-4f94-4a1e-94cd-7862855e7418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:27.760991 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a5643-4f94-4a1e-94cd-7862855e7418 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:27.761476 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a5643-4f94-4a1e-94cd-7862855e7418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:27.762011 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a5643-4f94-4a1e-94cd-7862855e7418 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:27.762970 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a5643-4f94-4a1e-94cd-7862855e7418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:27.763534 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a5643-4f94-4a1e-94cd-7862855e7418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:27.765481 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a5643-4f94-4a1e-94cd-7862855e7418 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:27.785694 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 384/771] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:27.791632 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfffe41-51dc-4f06-a2ab-5baf5c61c544 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:27.802945 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfffe41-51dc-4f06-a2ab-5baf5c61c544 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:27.812859 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fd2b5-1822-4a1b-b7c8-8eb75100112e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:27.814828 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fd2b5-1822-4a1b-b7c8-8eb75100112e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:27.815391 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fd2b5-1822-4a1b-b7c8-8eb75100112e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:27.816570 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fd2b5-1822-4a1b-b7c8-8eb75100112e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:27.825317 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66fd2b5-1822-4a1b-b7c8-8eb75100112e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:27.827932 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66fd2b5-1822-4a1b-b7c8-8eb75100112e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:27.842684 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-a66fd2b5-1822-4a1b-b7c8-8eb75100112e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:27.844697 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 388/772] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:27.851383 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a5643-4f94-4a1e-94cd-7862855e7418 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:27.861756 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a5643-4f94-4a1e-94cd-7862855e7418 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:27.868023 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ca9ee-668b-4ea1-91e7-29ebfdf2b0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:27.868982 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ca9ee-668b-4ea1-91e7-29ebfdf2b0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:27.869486 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ca9ee-668b-4ea1-91e7-29ebfdf2b0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:27.870020 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ca9ee-668b-4ea1-91e7-29ebfdf2b0d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:27.871008 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ca9ee-668b-4ea1-91e7-29ebfdf2b0d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:27.871569 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ca9ee-668b-4ea1-91e7-29ebfdf2b0d3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:27.873668 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ca9ee-668b-4ea1-91e7-29ebfdf2b0d3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:27.888173 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 385/773] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:27.897158 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fd2b5-1822-4a1b-b7c8-8eb75100112e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:27.909077 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fd2b5-1822-4a1b-b7c8-8eb75100112e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:27.915339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308963c-dc6d-4b6a-a318-bcb140b0f82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:27.915996 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308963c-dc6d-4b6a-a318-bcb140b0f82f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:27.916276 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308963c-dc6d-4b6a-a318-bcb140b0f82f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:27.916551 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308963c-dc6d-4b6a-a318-bcb140b0f82f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:27.917389 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308963c-dc6d-4b6a-a318-bcb140b0f82f admin admin] RBAC: Adding query filter params (role.id=4dde72f5d769401aa566e1c65c1f40d5, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=b68d0745d9cb49a5bd9331148967764a) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:27.917696 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308963c-dc6d-4b6a-a318-bcb140b0f82f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:27.919569 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308963c-dc6d-4b6a-a318-bcb140b0f82f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:27.927455 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 389/774] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:55:27 2021] GET /identity/v3/role_assignments?user.id=b68d0745d9cb49a5bd9331148967764a&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=4dde72f5d769401aa566e1c65c1f40d5 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:28.020000 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7324b7-0b86-4979-a355-673f0561310d None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:28.020630 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7324b7-0b86-4979-a355-673f0561310d None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:28.021150 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7324b7-0b86-4979-a355-673f0561310d None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:28.023170 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 386/775] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:28.046541 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5bca4-13bb-4508-984b-ef3d82725440 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:28.046860 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5bca4-13bb-4508-984b-ef3d82725440 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:28.047101 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5bca4-13bb-4508-984b-ef3d82725440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:28.076443 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-eff5bca4-13bb-4508-984b-ef3d82725440 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:28.077654 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-eff5bca4-13bb-4508-984b-ef3d82725440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:28.086635 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 390/776] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:28 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:28.124232 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7324b7-0b86-4979-a355-673f0561310d None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:28.144128 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7324b7-0b86-4979-a355-673f0561310d None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:28.149460 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f90443-f283-48db-b134-d9a701c8efca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:28.150560 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f90443-f283-48db-b134-d9a701c8efca admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:28.151049 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f90443-f283-48db-b134-d9a701c8efca admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:28.151601 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f90443-f283-48db-b134-d9a701c8efca admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:28.165781 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f90443-f283-48db-b134-d9a701c8efca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:28.173122 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-f2f90443-f283-48db-b134-d9a701c8efca admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:55:28.175570 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 387/777] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:55:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:28.181914 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5bca4-13bb-4508-984b-ef3d82725440 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:28.196695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5bca4-13bb-4508-984b-ef3d82725440 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:28.208942 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c399a-e8ee-40df-ae2f-102090ed500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:28.209644 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c399a-e8ee-40df-ae2f-102090ed500f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:28.209936 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c399a-e8ee-40df-ae2f-102090ed500f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:28.210216 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c399a-e8ee-40df-ae2f-102090ed500f admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:28.210998 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c399a-e8ee-40df-ae2f-102090ed500f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:28.211374 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c399a-e8ee-40df-ae2f-102090ed500f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:28.212987 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c399a-e8ee-40df-ae2f-102090ed500f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:28.226458 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 391/778] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:55:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:28.232278 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f90443-f283-48db-b134-d9a701c8efca admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:28.243326 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f90443-f283-48db-b134-d9a701c8efca admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:28.248832 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb25c23-d209-4d9c-a8a6-47fca7bf310b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:28.249844 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb25c23-d209-4d9c-a8a6-47fca7bf310b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:28.250663 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb25c23-d209-4d9c-a8a6-47fca7bf310b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:28.251157 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb25c23-d209-4d9c-a8a6-47fca7bf310b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:28.262385 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb25c23-d209-4d9c-a8a6-47fca7bf310b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:28.264491 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb25c23-d209-4d9c-a8a6-47fca7bf310b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:28.281333 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-ecb25c23-d209-4d9c-a8a6-47fca7bf310b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:28.282804 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 388/779] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:28.289034 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c399a-e8ee-40df-ae2f-102090ed500f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:28.300206 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c399a-e8ee-40df-ae2f-102090ed500f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:28.305255 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b2105-ad6b-4715-837d-1534b05b6ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:28.305904 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b2105-ad6b-4715-837d-1534b05b6ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:28.306184 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b2105-ad6b-4715-837d-1534b05b6ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:28.306455 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b2105-ad6b-4715-837d-1534b05b6ff0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:28.307178 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b2105-ad6b-4715-837d-1534b05b6ff0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:28.307515 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b2105-ad6b-4715-837d-1534b05b6ff0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:28.309082 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b2105-ad6b-4715-837d-1534b05b6ff0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:28.330798 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 392/780] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:28.336773 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb25c23-d209-4d9c-a8a6-47fca7bf310b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:28.346844 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb25c23-d209-4d9c-a8a6-47fca7bf310b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:28.359424 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f2813-d35d-41c5-b7ef-4697a70c5bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:28.360526 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f2813-d35d-41c5-b7ef-4697a70c5bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:28.361116 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f2813-d35d-41c5-b7ef-4697a70c5bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:28.361589 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f2813-d35d-41c5-b7ef-4697a70c5bd1 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:28.370241 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f2813-d35d-41c5-b7ef-4697a70c5bd1 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:28.380596 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f2813-d35d-41c5-b7ef-4697a70c5bd1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:28.394918 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-e80f2813-d35d-41c5-b7ef-4697a70c5bd1 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 23 03:55:28.396392 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 389/781] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:55:28 2021] GET /identity/v3/users/swift => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:28.402624 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b2105-ad6b-4715-837d-1534b05b6ff0 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:28.420224 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b2105-ad6b-4715-837d-1534b05b6ff0 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:28.429828 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be07ff-3d6c-4047-a8cc-b483809177a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:28.430506 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be07ff-3d6c-4047-a8cc-b483809177a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:28.430787 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be07ff-3d6c-4047-a8cc-b483809177a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:28.431059 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be07ff-3d6c-4047-a8cc-b483809177a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:28.431950 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be07ff-3d6c-4047-a8cc-b483809177a0 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:28.432259 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be07ff-3d6c-4047-a8cc-b483809177a0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:28.434073 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be07ff-3d6c-4047-a8cc-b483809177a0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:28.461553 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 393/782] 10.222.0.54 () {56 vars in 1156 bytes} [Tue Nov 23 03:55:28 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:28.467719 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f2813-d35d-41c5-b7ef-4697a70c5bd1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:28.478583 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f2813-d35d-41c5-b7ef-4697a70c5bd1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:28.490755 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764c4cf-dba1-4e4d-85e6-931316d5f721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:28.491720 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764c4cf-dba1-4e4d-85e6-931316d5f721 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:28.492200 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764c4cf-dba1-4e4d-85e6-931316d5f721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:28.492682 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764c4cf-dba1-4e4d-85e6-931316d5f721 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:28.501235 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764c4cf-dba1-4e4d-85e6-931316d5f721 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:28.507943 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764c4cf-dba1-4e4d-85e6-931316d5f721 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:28.522251 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 390/783] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:28 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 03:55:28.528120 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be07ff-3d6c-4047-a8cc-b483809177a0 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:28.544250 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be07ff-3d6c-4047-a8cc-b483809177a0 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:28.551930 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a73250-e6f3-47ca-9fac-bb5fc0188350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:28.552724 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a73250-e6f3-47ca-9fac-bb5fc0188350 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:28.553007 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a73250-e6f3-47ca-9fac-bb5fc0188350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:28.553281 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a73250-e6f3-47ca-9fac-bb5fc0188350 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:28.568296 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a73250-e6f3-47ca-9fac-bb5fc0188350 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:28.570133 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a73250-e6f3-47ca-9fac-bb5fc0188350 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:28.587619 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-97a73250-e6f3-47ca-9fac-bb5fc0188350 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:28.589168 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 394/784] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:28.594895 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764c4cf-dba1-4e4d-85e6-931316d5f721 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:28.609652 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764c4cf-dba1-4e4d-85e6-931316d5f721 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:28.617179 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d86076-dfd4-46ce-98c6-dd860c013355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:28.618020 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d86076-dfd4-46ce-98c6-dd860c013355 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:28.618458 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d86076-dfd4-46ce-98c6-dd860c013355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:28.618870 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d86076-dfd4-46ce-98c6-dd860c013355 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:28.619779 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d86076-dfd4-46ce-98c6-dd860c013355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:28.623475 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d86076-dfd4-46ce-98c6-dd860c013355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:28.625228 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d86076-dfd4-46ce-98c6-dd860c013355 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:28.638839 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 391/785] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:28.644955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a73250-e6f3-47ca-9fac-bb5fc0188350 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:28.659387 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a73250-e6f3-47ca-9fac-bb5fc0188350 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:28.664158 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984a008-fc38-468d-a9bd-1e0b878ec32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:28.665106 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984a008-fc38-468d-a9bd-1e0b878ec32d admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:28.665616 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984a008-fc38-468d-a9bd-1e0b878ec32d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:28.665866 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984a008-fc38-468d-a9bd-1e0b878ec32d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:28.675274 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984a008-fc38-468d-a9bd-1e0b878ec32d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:28.677481 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984a008-fc38-468d-a9bd-1e0b878ec32d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:28.692350 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-6984a008-fc38-468d-a9bd-1e0b878ec32d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:28.694145 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 395/786] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:28.700112 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d86076-dfd4-46ce-98c6-dd860c013355 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:28.714742 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d86076-dfd4-46ce-98c6-dd860c013355 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:28.721152 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd27b07-23e1-4a05-8493-821846a71d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:28.722062 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd27b07-23e1-4a05-8493-821846a71d69 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:28.722572 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd27b07-23e1-4a05-8493-821846a71d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:28.723054 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd27b07-23e1-4a05-8493-821846a71d69 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:28.724197 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd27b07-23e1-4a05-8493-821846a71d69 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:28.724752 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd27b07-23e1-4a05-8493-821846a71d69 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:28.726927 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd27b07-23e1-4a05-8493-821846a71d69 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:28.747359 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 392/787] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:28.753547 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984a008-fc38-468d-a9bd-1e0b878ec32d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:28.768915 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984a008-fc38-468d-a9bd-1e0b878ec32d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:28.774709 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb27a79-4fde-4c3c-981a-b5603bfe143e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:28.775650 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb27a79-4fde-4c3c-981a-b5603bfe143e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:28.776242 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb27a79-4fde-4c3c-981a-b5603bfe143e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:28.776755 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb27a79-4fde-4c3c-981a-b5603bfe143e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:28.777858 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb27a79-4fde-4c3c-981a-b5603bfe143e admin admin] RBAC: Adding query filter params (role.id=3db7012b41944542a50049819500eadd, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=3bd439c1f0764f4cac7eb641a485937a) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:28.778367 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb27a79-4fde-4c3c-981a-b5603bfe143e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:28.780597 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb27a79-4fde-4c3c-981a-b5603bfe143e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:28.790699 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 396/788] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:55:28 2021] GET /identity/v3/role_assignments?user.id=3bd439c1f0764f4cac7eb641a485937a&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=3db7012b41944542a50049819500eadd => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:28.982620 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19f765-2fff-4e55-a0ea-662fb343bfe2 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:28.983120 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19f765-2fff-4e55-a0ea-662fb343bfe2 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:28.983120 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19f765-2fff-4e55-a0ea-662fb343bfe2 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:28.985258 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 393/789] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:28.992473 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59822d78-a891-4743-bc18-87deec371807 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:28.992972 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59822d78-a891-4743-bc18-87deec371807 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:28.993070 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59822d78-a891-4743-bc18-87deec371807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:29.020447 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-59822d78-a891-4743-bc18-87deec371807 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:29.021679 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-59822d78-a891-4743-bc18-87deec371807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:29.034966 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 397/790] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:28 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:29.084923 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19f765-2fff-4e55-a0ea-662fb343bfe2 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:29.099474 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19f765-2fff-4e55-a0ea-662fb343bfe2 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:29.104019 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea061b-3446-4274-8553-86d1fea36c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:29.104886 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea061b-3446-4274-8553-86d1fea36c0b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:29.105174 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea061b-3446-4274-8553-86d1fea36c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:29.105454 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea061b-3446-4274-8553-86d1fea36c0b admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:29.106131 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea061b-3446-4274-8553-86d1fea36c0b admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:29.107756 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea061b-3446-4274-8553-86d1fea36c0b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:29.122779 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-ddea061b-3446-4274-8553-86d1fea36c0b admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 23 03:55:29.128250 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 394/791] 10.222.0.54 () {56 vars in 1150 bytes} [Tue Nov 23 03:55:29 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:29.134479 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59822d78-a891-4743-bc18-87deec371807 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:29.143988 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59822d78-a891-4743-bc18-87deec371807 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:29.151480 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb38af-7059-48dc-a30b-2dbe6256a07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:29.152403 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb38af-7059-48dc-a30b-2dbe6256a07b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:29.152877 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb38af-7059-48dc-a30b-2dbe6256a07b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:29.153328 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb38af-7059-48dc-a30b-2dbe6256a07b admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:29.154229 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb38af-7059-48dc-a30b-2dbe6256a07b admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:29.154709 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb38af-7059-48dc-a30b-2dbe6256a07b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:29.156529 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb38af-7059-48dc-a30b-2dbe6256a07b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:29.197336 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 398/792] 10.222.0.54 () {56 vars in 1145 bytes} [Tue Nov 23 03:55:29 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:29.203066 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea061b-3446-4274-8553-86d1fea36c0b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:29.216140 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea061b-3446-4274-8553-86d1fea36c0b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:29.223300 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fca024-7d44-4cbc-b6a3-898b7ca44650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:29.223954 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fca024-7d44-4cbc-b6a3-898b7ca44650 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:29.224234 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fca024-7d44-4cbc-b6a3-898b7ca44650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:29.224564 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fca024-7d44-4cbc-b6a3-898b7ca44650 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:29.225343 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fca024-7d44-4cbc-b6a3-898b7ca44650 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:29.225646 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fca024-7d44-4cbc-b6a3-898b7ca44650 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:29.227288 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fca024-7d44-4cbc-b6a3-898b7ca44650 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:29.232717 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 395/793] 10.222.0.54 () {56 vars in 1145 bytes} [Tue Nov 23 03:55:29 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:29.238968 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb38af-7059-48dc-a30b-2dbe6256a07b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:29.252553 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb38af-7059-48dc-a30b-2dbe6256a07b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:29.263243 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c810bb-4e6a-486e-bdc1-9d2b11940396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:29.264273 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c810bb-4e6a-486e-bdc1-9d2b11940396 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:29.264757 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c810bb-4e6a-486e-bdc1-9d2b11940396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:29.265227 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c810bb-4e6a-486e-bdc1-9d2b11940396 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:29.266213 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c810bb-4e6a-486e-bdc1-9d2b11940396 admin admin] RBAC: Adding query filter params (interface=public, service_id=b51485de29854d8a911d98e4cc0b5620, region_id=RegionOne) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:29.266732 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c810bb-4e6a-486e-bdc1-9d2b11940396 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:29.268092 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING py.warnings [None req-95c810bb-4e6a-486e-bdc1-9d2b11940396 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:55:29.268092 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: warnings.warn(msg) Nov 23 03:55:29.268092 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: Nov 23 03:55:29.269357 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c810bb-4e6a-486e-bdc1-9d2b11940396 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:29.281358 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 399/794] 10.222.0.54 () {56 vars in 1272 bytes} [Tue Nov 23 03:55:29 2021] GET /identity/v3/endpoints?service_id=b51485de29854d8a911d98e4cc0b5620&interface=public®ion_id=RegionOne => generated 194 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:29.287839 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fca024-7d44-4cbc-b6a3-898b7ca44650 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:29.297880 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fca024-7d44-4cbc-b6a3-898b7ca44650 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:29.306952 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656987dc-5942-4ee4-b678-326131b957e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:29.307659 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656987dc-5942-4ee4-b678-326131b957e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:29.307942 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656987dc-5942-4ee4-b678-326131b957e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:29.308266 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656987dc-5942-4ee4-b678-326131b957e6 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:29.309061 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656987dc-5942-4ee4-b678-326131b957e6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:29.310691 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656987dc-5942-4ee4-b678-326131b957e6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:29.323832 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 396/795] 10.222.0.54 () {56 vars in 1108 bytes} [Tue Nov 23 03:55:29 2021] GET /identity/v3/services => generated 772 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:30.348469 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87004dd7-9045-48f1-a4ce-cf1f20752637 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:30.349018 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87004dd7-9045-48f1-a4ce-cf1f20752637 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:30.349018 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87004dd7-9045-48f1-a4ce-cf1f20752637 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:30.351069 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 400/796] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:30.357141 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e5511-31d7-4eed-809e-c3aa62525b1d None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:30.357561 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e5511-31d7-4eed-809e-c3aa62525b1d None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:30.357751 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e5511-31d7-4eed-809e-c3aa62525b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:30.377360 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9a858-0666-4a72-a97e-a472098b55f2 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:30.377666 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9a858-0666-4a72-a97e-a472098b55f2 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:30.377923 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9a858-0666-4a72-a97e-a472098b55f2 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:30.380009 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 401/797] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:55:30.380505 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-f16e5511-31d7-4eed-809e-c3aa62525b1d None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:30.381847 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-f16e5511-31d7-4eed-809e-c3aa62525b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:30.384921 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef15373-cf6e-4a7a-bbbf-1ce11bd6ba9e None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:30.385205 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef15373-cf6e-4a7a-bbbf-1ce11bd6ba9e None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:30.385491 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef15373-cf6e-4a7a-bbbf-1ce11bd6ba9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:30.405718 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-eef15373-cf6e-4a7a-bbbf-1ce11bd6ba9e None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:30.406957 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-eef15373-cf6e-4a7a-bbbf-1ce11bd6ba9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:30.408841 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 397/798] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:30 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:30.430984 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 402/799] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:30 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:55:30.432795 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e5511-31d7-4eed-809e-c3aa62525b1d None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:30.442168 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e5511-31d7-4eed-809e-c3aa62525b1d None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:30.446753 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25734f1b-bfa3-4268-b1eb-63cf980a3dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:30.447564 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25734f1b-bfa3-4268-b1eb-63cf980a3dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:30.447850 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25734f1b-bfa3-4268-b1eb-63cf980a3dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:30.448132 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25734f1b-bfa3-4268-b1eb-63cf980a3dd0 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:30.448815 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25734f1b-bfa3-4268-b1eb-63cf980a3dd0 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:30.450398 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25734f1b-bfa3-4268-b1eb-63cf980a3dd0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:30.462216 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-25734f1b-bfa3-4268-b1eb-63cf980a3dd0 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 23 03:55:30.467374 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 398/800] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:30 2021] GET /identity/v3/services/network => generated 88 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:30.468516 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef15373-cf6e-4a7a-bbbf-1ce11bd6ba9e None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:30.477436 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25734f1b-bfa3-4268-b1eb-63cf980a3dd0 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:30.480031 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef15373-cf6e-4a7a-bbbf-1ce11bd6ba9e None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:30.491724 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25734f1b-bfa3-4268-b1eb-63cf980a3dd0 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:30.493752 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf299c6e-99c8-4b38-b37b-dbbc2347011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:30.494548 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf299c6e-99c8-4b38-b37b-dbbc2347011a admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:30.494832 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf299c6e-99c8-4b38-b37b-dbbc2347011a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:30.495109 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf299c6e-99c8-4b38-b37b-dbbc2347011a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:30.504271 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d04c8f-d1eb-4244-8f8c-5cddd51177d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:30.504939 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d04c8f-d1eb-4244-8f8c-5cddd51177d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:30.505222 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d04c8f-d1eb-4244-8f8c-5cddd51177d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:30.505500 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d04c8f-d1eb-4244-8f8c-5cddd51177d1 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:30.506226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d04c8f-d1eb-4244-8f8c-5cddd51177d1 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:30.506534 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d04c8f-d1eb-4244-8f8c-5cddd51177d1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:30.508134 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d04c8f-d1eb-4244-8f8c-5cddd51177d1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:30.517710 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf299c6e-99c8-4b38-b37b-dbbc2347011a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:30.523578 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 399/801] 10.222.0.54 () {56 vars in 1133 bytes} [Tue Nov 23 03:55:30 2021] GET /identity/v3/services?name=network => generated 124 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:30.529117 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-cf299c6e-99c8-4b38-b37b-dbbc2347011a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:55:30.531590 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 403/802] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:55:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:30.532746 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d04c8f-d1eb-4244-8f8c-5cddd51177d1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:30.538691 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf299c6e-99c8-4b38-b37b-dbbc2347011a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:30.547826 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d04c8f-d1eb-4244-8f8c-5cddd51177d1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:30.554867 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf299c6e-99c8-4b38-b37b-dbbc2347011a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:30.559317 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90813d18-5746-4f1a-af90-0eb68a0672f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:30.559521 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7e551-b6bc-4a97-bc0a-0a25d6a9510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:30.559980 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90813d18-5746-4f1a-af90-0eb68a0672f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:30.560140 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7e551-b6bc-4a97-bc0a-0a25d6a9510c admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:30.560284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90813d18-5746-4f1a-af90-0eb68a0672f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:30.560424 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7e551-b6bc-4a97-bc0a-0a25d6a9510c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:30.560562 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90813d18-5746-4f1a-af90-0eb68a0672f0 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:30.560721 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7e551-b6bc-4a97-bc0a-0a25d6a9510c admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:30.561235 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90813d18-5746-4f1a-af90-0eb68a0672f0 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:30.561397 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7e551-b6bc-4a97-bc0a-0a25d6a9510c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:30.561534 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90813d18-5746-4f1a-af90-0eb68a0672f0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:30.561679 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7e551-b6bc-4a97-bc0a-0a25d6a9510c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:30.563094 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90813d18-5746-4f1a-af90-0eb68a0672f0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:30.563286 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7e551-b6bc-4a97-bc0a-0a25d6a9510c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:30.573126 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 404/803] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:55:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:30.574574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 400/804] 10.222.0.54 () {56 vars in 1133 bytes} [Tue Nov 23 03:55:30 2021] GET /identity/v3/services?type=network => generated 350 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:30.580976 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7e551-b6bc-4a97-bc0a-0a25d6a9510c admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:30.582552 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90813d18-5746-4f1a-af90-0eb68a0672f0 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:30.590652 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7e551-b6bc-4a97-bc0a-0a25d6a9510c admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:30.601502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90813d18-5746-4f1a-af90-0eb68a0672f0 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:30.604572 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19656c-2e85-4618-b498-ec284434120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:30.605362 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19656c-2e85-4618-b498-ec284434120e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:30.605646 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19656c-2e85-4618-b498-ec284434120e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:30.605924 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19656c-2e85-4618-b498-ec284434120e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:30.615397 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4859b6-e801-4fb3-af39-c56c02094d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:30.616458 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4859b6-e801-4fb3-af39-c56c02094d2e admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:30.616755 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4859b6-e801-4fb3-af39-c56c02094d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:30.617029 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4859b6-e801-4fb3-af39-c56c02094d2e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:30.618128 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4859b6-e801-4fb3-af39-c56c02094d2e admin admin] RBAC: Adding query filter params (interface=public, service_id=ce1d06026b8e4dbc81821a5994ccac19, region_id=RegionOne) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:30.618330 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19656c-2e85-4618-b498-ec284434120e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:30.618483 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4859b6-e801-4fb3-af39-c56c02094d2e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:30.619455 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING py.warnings [None req-cc4859b6-e801-4fb3-af39-c56c02094d2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:55:30.619455 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: warnings.warn(msg) Nov 23 03:55:30.619455 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: Nov 23 03:55:30.620114 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19656c-2e85-4618-b498-ec284434120e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:30.620288 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4859b6-e801-4fb3-af39-c56c02094d2e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:30.633076 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 401/805] 10.222.0.54 () {56 vars in 1272 bytes} [Tue Nov 23 03:55:30 2021] GET /identity/v3/endpoints?service_id=ce1d06026b8e4dbc81821a5994ccac19&interface=public®ion_id=RegionOne => generated 194 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:30.641572 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4859b6-e801-4fb3-af39-c56c02094d2e admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:30.650054 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-fa19656c-2e85-4618-b498-ec284434120e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:30.651791 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 405/806] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:30.660495 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4859b6-e801-4fb3-af39-c56c02094d2e admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:30.666286 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19656c-2e85-4618-b498-ec284434120e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:30.678333 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a95a26-7598-4801-8a92-2cb1a141f55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:30.678333 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a95a26-7598-4801-8a92-2cb1a141f55a admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:30.678333 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a95a26-7598-4801-8a92-2cb1a141f55a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:30.678333 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a95a26-7598-4801-8a92-2cb1a141f55a admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:30.678710 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19656c-2e85-4618-b498-ec284434120e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:30.679386 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a95a26-7598-4801-8a92-2cb1a141f55a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:30.683253 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a95a26-7598-4801-8a92-2cb1a141f55a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:30.688579 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d126e-7b13-4c52-b96a-d1b3a544655d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:30.691498 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d126e-7b13-4c52-b96a-d1b3a544655d admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:30.691788 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d126e-7b13-4c52-b96a-d1b3a544655d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:30.692063 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d126e-7b13-4c52-b96a-d1b3a544655d admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:30.694149 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d126e-7b13-4c52-b96a-d1b3a544655d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:30.694468 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d126e-7b13-4c52-b96a-d1b3a544655d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:30.699751 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 402/807] 10.222.0.54 () {56 vars in 1108 bytes} [Tue Nov 23 03:55:30 2021] GET /identity/v3/services => generated 772 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:30.700826 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d126e-7b13-4c52-b96a-d1b3a544655d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:30.721954 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 406/808] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:30.727699 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a95a26-7598-4801-8a92-2cb1a141f55a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:30.737946 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a95a26-7598-4801-8a92-2cb1a141f55a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:30.749817 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bbb22-448a-4f32-a674-4fd4b44af30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:30.750636 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bbb22-448a-4f32-a674-4fd4b44af30f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:30.750912 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bbb22-448a-4f32-a674-4fd4b44af30f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:30.751183 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bbb22-448a-4f32-a674-4fd4b44af30f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:30.769433 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bbb22-448a-4f32-a674-4fd4b44af30f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:30.771844 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bbb22-448a-4f32-a674-4fd4b44af30f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:30.791092 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-be9bbb22-448a-4f32-a674-4fd4b44af30f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 03:55:30.792351 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 403/809] 10.222.0.54 () {56 vars in 1114 bytes} [Tue Nov 23 03:55:30 2021] GET /identity/v3/users/nova => generated 82 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:30.800473 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d126e-7b13-4c52-b96a-d1b3a544655d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:30.818184 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d126e-7b13-4c52-b96a-d1b3a544655d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:30.821994 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37034b78-0493-41ae-a83e-c8f20a875ab5 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:30.822284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37034b78-0493-41ae-a83e-c8f20a875ab5 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:30.822565 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37034b78-0493-41ae-a83e-c8f20a875ab5 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:30.824492 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 404/810] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:55:30.826248 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fc544-d880-403a-b596-101f9016dd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:30.826928 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fc544-d880-403a-b596-101f9016dd62 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:30.827230 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fc544-d880-403a-b596-101f9016dd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:30.827507 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fc544-d880-403a-b596-101f9016dd62 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:30.828360 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fc544-d880-403a-b596-101f9016dd62 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:30.828667 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fc544-d880-403a-b596-101f9016dd62 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:30.831338 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fc544-d880-403a-b596-101f9016dd62 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:30.833002 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b268e-bdd4-469c-bec1-2f392bd85943 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:30.833573 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b268e-bdd4-469c-bec1-2f392bd85943 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:30.834046 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b268e-bdd4-469c-bec1-2f392bd85943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:30.853768 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-e11b268e-bdd4-469c-bec1-2f392bd85943 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:30.855356 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-e11b268e-bdd4-469c-bec1-2f392bd85943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:30.864743 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 407/811] 10.222.0.54 () {56 vars in 1154 bytes} [Tue Nov 23 03:55:30 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:30.869133 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 405/812] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:30 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:55:30.877095 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fc544-d880-403a-b596-101f9016dd62 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:30.887932 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fc544-d880-403a-b596-101f9016dd62 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:30.893733 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc7790-c8cb-4106-8427-241891a211b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:30.894729 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc7790-c8cb-4106-8427-241891a211b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:30.895345 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc7790-c8cb-4106-8427-241891a211b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:30.895842 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc7790-c8cb-4106-8427-241891a211b1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:30.905316 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc7790-c8cb-4106-8427-241891a211b1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:30.907592 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc7790-c8cb-4106-8427-241891a211b1 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:30.919365 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b268e-bdd4-469c-bec1-2f392bd85943 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:30.925395 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 408/813] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:30 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 03:55:30.926670 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc7790-c8cb-4106-8427-241891a211b1 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:30.933975 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b268e-bdd4-469c-bec1-2f392bd85943 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:30.939900 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2a98b-02ed-45f5-be1d-d1567eedb9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:30.943013 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2a98b-02ed-45f5-be1d-d1567eedb9eb admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:30.944031 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2a98b-02ed-45f5-be1d-d1567eedb9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:30.944741 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2a98b-02ed-45f5-be1d-d1567eedb9eb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:30.949886 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc7790-c8cb-4106-8427-241891a211b1 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:30.960798 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad19cf-b10a-4482-94cc-d978a6b671f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:30.962726 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad19cf-b10a-4482-94cc-d978a6b671f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:30.963633 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad19cf-b10a-4482-94cc-d978a6b671f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:30.963925 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad19cf-b10a-4482-94cc-d978a6b671f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:30.966756 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2a98b-02ed-45f5-be1d-d1567eedb9eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:30.975085 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-9ed2a98b-02ed-45f5-be1d-d1567eedb9eb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 03:55:30.976447 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad19cf-b10a-4482-94cc-d978a6b671f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:30.977084 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 406/814] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:55:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:30.978544 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad19cf-b10a-4482-94cc-d978a6b671f0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:30.982772 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2a98b-02ed-45f5-be1d-d1567eedb9eb admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:30.995566 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2a98b-02ed-45f5-be1d-d1567eedb9eb admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:30.997643 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-a4ad19cf-b10a-4482-94cc-d978a6b671f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:30.999242 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 409/815] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:31.001113 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e24c2-7128-4357-bbe4-88358c93d328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:31.002177 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e24c2-7128-4357-bbe4-88358c93d328 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:31.002662 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e24c2-7128-4357-bbe4-88358c93d328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:31.003132 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e24c2-7128-4357-bbe4-88358c93d328 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:31.004168 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e24c2-7128-4357-bbe4-88358c93d328 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:31.004669 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e24c2-7128-4357-bbe4-88358c93d328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:31.005570 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad19cf-b10a-4482-94cc-d978a6b671f0 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:31.006896 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e24c2-7128-4357-bbe4-88358c93d328 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:31.019731 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad19cf-b10a-4482-94cc-d978a6b671f0 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:31.022439 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 407/816] 10.222.0.54 () {56 vars in 1124 bytes} [Tue Nov 23 03:55:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:31.029549 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72ca17-9682-4b8a-9737-48337b15a38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:31.029708 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e24c2-7128-4357-bbe4-88358c93d328 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:31.029784 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72ca17-9682-4b8a-9737-48337b15a38d admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:31.029784 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72ca17-9682-4b8a-9737-48337b15a38d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:31.029784 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72ca17-9682-4b8a-9737-48337b15a38d admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:31.029982 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72ca17-9682-4b8a-9737-48337b15a38d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:31.030233 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72ca17-9682-4b8a-9737-48337b15a38d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:31.031748 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72ca17-9682-4b8a-9737-48337b15a38d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:31.043908 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e24c2-7128-4357-bbe4-88358c93d328 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:31.051763 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 410/817] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:31.057119 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a12e6-84ce-48cd-8490-842a99ebc841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:31.057816 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72ca17-9682-4b8a-9737-48337b15a38d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:31.057942 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a12e6-84ce-48cd-8490-842a99ebc841 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:31.058202 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a12e6-84ce-48cd-8490-842a99ebc841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:31.058475 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a12e6-84ce-48cd-8490-842a99ebc841 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:31.077875 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72ca17-9682-4b8a-9737-48337b15a38d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:31.079334 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a12e6-84ce-48cd-8490-842a99ebc841 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:31.081695 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a12e6-84ce-48cd-8490-842a99ebc841 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:31.093906 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480bb25-9a9a-4a38-a375-5c6f179b7f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:31.094731 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480bb25-9a9a-4a38-a375-5c6f179b7f87 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:31.095018 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480bb25-9a9a-4a38-a375-5c6f179b7f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:31.095391 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480bb25-9a9a-4a38-a375-5c6f179b7f87 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:31.113632 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-8f6a12e6-84ce-48cd-8490-842a99ebc841 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:31.114781 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 408/818] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:31.115801 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480bb25-9a9a-4a38-a375-5c6f179b7f87 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:31.117813 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480bb25-9a9a-4a38-a375-5c6f179b7f87 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:31.126017 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a12e6-84ce-48cd-8490-842a99ebc841 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:31.134228 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-5480bb25-9a9a-4a38-a375-5c6f179b7f87 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:31.135628 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 411/819] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:31.151204 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a12e6-84ce-48cd-8490-842a99ebc841 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:31.152604 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480bb25-9a9a-4a38-a375-5c6f179b7f87 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:31.164149 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480bb25-9a9a-4a38-a375-5c6f179b7f87 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:31.165493 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb08d7-327a-4175-8fee-a5d8c511d78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:31.166220 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb08d7-327a-4175-8fee-a5d8c511d78b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:31.166506 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb08d7-327a-4175-8fee-a5d8c511d78b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:31.166790 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb08d7-327a-4175-8fee-a5d8c511d78b admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:31.167617 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb08d7-327a-4175-8fee-a5d8c511d78b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:31.167923 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb08d7-327a-4175-8fee-a5d8c511d78b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:31.169691 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb08d7-327a-4175-8fee-a5d8c511d78b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:31.178595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93225b3-5844-472d-93fa-872e6c2d8493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:31.180536 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93225b3-5844-472d-93fa-872e6c2d8493 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:31.180884 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93225b3-5844-472d-93fa-872e6c2d8493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:31.182724 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93225b3-5844-472d-93fa-872e6c2d8493 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:31.183559 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93225b3-5844-472d-93fa-872e6c2d8493 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:31.184410 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93225b3-5844-472d-93fa-872e6c2d8493 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:31.187478 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93225b3-5844-472d-93fa-872e6c2d8493 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:31.193849 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 409/820] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:31.199141 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb08d7-327a-4175-8fee-a5d8c511d78b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:31.212910 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 412/821] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:31.215683 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb08d7-327a-4175-8fee-a5d8c511d78b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:31.221136 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93225b3-5844-472d-93fa-872e6c2d8493 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:31.228402 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c91c2-6dd6-48a5-bbff-16aa9dddfe7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:31.230443 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c91c2-6dd6-48a5-bbff-16aa9dddfe7f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:31.230946 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c91c2-6dd6-48a5-bbff-16aa9dddfe7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:31.231574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c91c2-6dd6-48a5-bbff-16aa9dddfe7f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:31.239417 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93225b3-5844-472d-93fa-872e6c2d8493 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:31.248989 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582ebf3-1c4d-4cad-989c-d2ab3ca9d356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:31.250635 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582ebf3-1c4d-4cad-989c-d2ab3ca9d356 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:31.252719 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c91c2-6dd6-48a5-bbff-16aa9dddfe7f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:31.253005 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582ebf3-1c4d-4cad-989c-d2ab3ca9d356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:31.253468 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582ebf3-1c4d-4cad-989c-d2ab3ca9d356 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:31.255464 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582ebf3-1c4d-4cad-989c-d2ab3ca9d356 admin admin] RBAC: Adding query filter params (role.id=3db7012b41944542a50049819500eadd, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=35e14131fb22470cba63cd5e8db359e2) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:31.255994 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582ebf3-1c4d-4cad-989c-d2ab3ca9d356 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:31.259383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582ebf3-1c4d-4cad-989c-d2ab3ca9d356 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:31.261451 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c91c2-6dd6-48a5-bbff-16aa9dddfe7f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:31.279556 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 413/822] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:55:31 2021] GET /identity/v3/role_assignments?user.id=35e14131fb22470cba63cd5e8db359e2&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=3db7012b41944542a50049819500eadd => generated 608 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:31.286215 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-be3c91c2-6dd6-48a5-bbff-16aa9dddfe7f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 23 03:55:31.287927 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 410/823] 10.222.0.54 () {56 vars in 1138 bytes} [Tue Nov 23 03:55:31 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:31.293723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582ebf3-1c4d-4cad-989c-d2ab3ca9d356 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:31.305362 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582ebf3-1c4d-4cad-989c-d2ab3ca9d356 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:31.310255 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ee96a-23a7-45a0-aabb-48cd0cd16531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:31.311166 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ee96a-23a7-45a0-aabb-48cd0cd16531 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:31.311714 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ee96a-23a7-45a0-aabb-48cd0cd16531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:31.312198 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ee96a-23a7-45a0-aabb-48cd0cd16531 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:31.313405 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ee96a-23a7-45a0-aabb-48cd0cd16531 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:31.314248 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ee96a-23a7-45a0-aabb-48cd0cd16531 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:31.317095 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ee96a-23a7-45a0-aabb-48cd0cd16531 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:31.341833 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 414/824] 10.222.0.54 () {56 vars in 1170 bytes} [Tue Nov 23 03:55:31 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:31.348136 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c91c2-6dd6-48a5-bbff-16aa9dddfe7f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:31.362195 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c91c2-6dd6-48a5-bbff-16aa9dddfe7f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:31.367531 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0ca19-0d08-46c8-bd13-224417dc4bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:31.368593 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0ca19-0d08-46c8-bd13-224417dc4bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:31.369092 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0ca19-0d08-46c8-bd13-224417dc4bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:31.369608 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0ca19-0d08-46c8-bd13-224417dc4bb7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:31.385827 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0ca19-0d08-46c8-bd13-224417dc4bb7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:31.388073 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0ca19-0d08-46c8-bd13-224417dc4bb7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:31.409245 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-b1e0ca19-0d08-46c8-bd13-224417dc4bb7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:31.411563 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 411/825] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:31.417613 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ee96a-23a7-45a0-aabb-48cd0cd16531 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:31.432612 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ee96a-23a7-45a0-aabb-48cd0cd16531 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:31.437598 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ab9eb-baab-4cf6-ab7f-2f9068f84858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:31.438653 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab9eb-baab-4cf6-ab7f-2f9068f84858 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:31.439677 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab9eb-baab-4cf6-ab7f-2f9068f84858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:31.440172 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab9eb-baab-4cf6-ab7f-2f9068f84858 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:31.441371 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ab9eb-baab-4cf6-ab7f-2f9068f84858 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:31.441882 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ab9eb-baab-4cf6-ab7f-2f9068f84858 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:31.443752 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ab9eb-baab-4cf6-ab7f-2f9068f84858 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:31.466325 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 415/826] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:31.472331 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0ca19-0d08-46c8-bd13-224417dc4bb7 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:31.488779 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0ca19-0d08-46c8-bd13-224417dc4bb7 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:31.493507 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4749418-75fd-4f22-9f9a-534f61492ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:31.494540 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4749418-75fd-4f22-9f9a-534f61492ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:31.495027 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4749418-75fd-4f22-9f9a-534f61492ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:31.495527 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4749418-75fd-4f22-9f9a-534f61492ee6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:31.509147 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4749418-75fd-4f22-9f9a-534f61492ee6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:31.511456 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4749418-75fd-4f22-9f9a-534f61492ee6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:31.529072 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-a4749418-75fd-4f22-9f9a-534f61492ee6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:31.530700 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 412/827] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:31.537414 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ab9eb-baab-4cf6-ab7f-2f9068f84858 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:31.554226 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ab9eb-baab-4cf6-ab7f-2f9068f84858 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:31.563316 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e533a-1963-48e6-9da8-0059b68ded7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:31.564296 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e533a-1963-48e6-9da8-0059b68ded7e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:31.564775 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e533a-1963-48e6-9da8-0059b68ded7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:31.565265 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e533a-1963-48e6-9da8-0059b68ded7e admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:31.566509 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e533a-1963-48e6-9da8-0059b68ded7e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:31.567009 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e533a-1963-48e6-9da8-0059b68ded7e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:31.569041 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e533a-1963-48e6-9da8-0059b68ded7e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:31.590525 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 416/828] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:31.597041 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4749418-75fd-4f22-9f9a-534f61492ee6 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:31.613522 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4749418-75fd-4f22-9f9a-534f61492ee6 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:31.621190 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6de985-f067-45cd-9a28-bb91ae0b0728 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:31.621354 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245a7b0-b751-4b5e-9c22-177c1c8b97a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:31.621914 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6de985-f067-45cd-9a28-bb91ae0b0728 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:31.622018 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245a7b0-b751-4b5e-9c22-177c1c8b97a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:31.622298 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245a7b0-b751-4b5e-9c22-177c1c8b97a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:31.622573 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245a7b0-b751-4b5e-9c22-177c1c8b97a4 admin admin] PATH_INFO: `/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/b68d0745d9cb49a5bd9331148967764a/roles/4dde72f5d769401aa566e1c65c1f40d5` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:31.622898 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6de985-f067-45cd-9a28-bb91ae0b0728 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:31.625578 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 417/829] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:31 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:55:31.631651 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bd7ee-8f42-484e-bc01-214829387b4c None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:31.632272 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bd7ee-8f42-484e-bc01-214829387b4c None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:31.632745 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bd7ee-8f42-484e-bc01-214829387b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:31.650590 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245a7b0-b751-4b5e-9c22-177c1c8b97a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa78bb05b3e48f3a9c973567c781357, user_id=b68d0745d9cb49a5bd9331148967764a, role_id=4dde72f5d769401aa566e1c65c1f40d5)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:31.653504 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245a7b0-b751-4b5e-9c22-177c1c8b97a4 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:31.663401 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-fe3bd7ee-8f42-484e-bc01-214829387b4c None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:31.664710 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-fe3bd7ee-8f42-484e-bc01-214829387b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:31.673109 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 418/830] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:31 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:55:31.697965 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bd7ee-8f42-484e-bc01-214829387b4c None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:31.708229 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bd7ee-8f42-484e-bc01-214829387b4c None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:31.713364 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0be7fb-0083-4bf4-b147-ede0e5d3ba4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:31.714235 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0be7fb-0083-4bf4-b147-ede0e5d3ba4e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:31.714519 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0be7fb-0083-4bf4-b147-ede0e5d3ba4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:31.714894 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0be7fb-0083-4bf4-b147-ede0e5d3ba4e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:31.728607 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0be7fb-0083-4bf4-b147-ede0e5d3ba4e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:31.736067 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-3b0be7fb-0083-4bf4-b147-ede0e5d3ba4e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:55:31.737851 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 419/831] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:55:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:31.745924 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0be7fb-0083-4bf4-b147-ede0e5d3ba4e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:31.749342 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 413/832] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:55:31 2021] PUT /identity/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/b68d0745d9cb49a5bd9331148967764a/roles/4dde72f5d769401aa566e1c65c1f40d5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:55:31.761114 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0be7fb-0083-4bf4-b147-ede0e5d3ba4e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:31.828086 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81e815-9ee5-4f6b-8ab4-febeaf15d2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:31.829183 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81e815-9ee5-4f6b-8ab4-febeaf15d2ac admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:31.830193 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81e815-9ee5-4f6b-8ab4-febeaf15d2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:31.830697 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81e815-9ee5-4f6b-8ab4-febeaf15d2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:31.831855 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81e815-9ee5-4f6b-8ab4-febeaf15d2ac admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:31.832404 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81e815-9ee5-4f6b-8ab4-febeaf15d2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:31.834218 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81e815-9ee5-4f6b-8ab4-febeaf15d2ac admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:31.844565 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 420/833] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:55:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:31.851662 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245a7b0-b751-4b5e-9c22-177c1c8b97a4 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:31.863320 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245a7b0-b751-4b5e-9c22-177c1c8b97a4 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:31.868495 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ade4f9-e670-483b-8105-728ddd06b945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:31.869694 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ade4f9-e670-483b-8105-728ddd06b945 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:31.870247 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ade4f9-e670-483b-8105-728ddd06b945 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:31.870785 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ade4f9-e670-483b-8105-728ddd06b945 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:31.882791 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ade4f9-e670-483b-8105-728ddd06b945 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:31.885144 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ade4f9-e670-483b-8105-728ddd06b945 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:31.904612 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-66ade4f9-e670-483b-8105-728ddd06b945 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:31.906690 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 414/834] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:31.913730 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81e815-9ee5-4f6b-8ab4-febeaf15d2ac admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:31.926281 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81e815-9ee5-4f6b-8ab4-febeaf15d2ac admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:31.935390 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f2a84-bae3-43d9-9ffc-3321396a8c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:31.936084 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f2a84-bae3-43d9-9ffc-3321396a8c11 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:31.936369 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f2a84-bae3-43d9-9ffc-3321396a8c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:31.936651 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f2a84-bae3-43d9-9ffc-3321396a8c11 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:31.937410 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f2a84-bae3-43d9-9ffc-3321396a8c11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:31.937718 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f2a84-bae3-43d9-9ffc-3321396a8c11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:31.939758 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f2a84-bae3-43d9-9ffc-3321396a8c11 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:31.955058 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 421/835] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:31.960851 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ade4f9-e670-483b-8105-728ddd06b945 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:31.974411 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ade4f9-e670-483b-8105-728ddd06b945 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:31.983999 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce5560-24ba-4e9d-92ad-33787665a1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:31.985206 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce5560-24ba-4e9d-92ad-33787665a1ed admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:31.986356 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce5560-24ba-4e9d-92ad-33787665a1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:31.986984 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce5560-24ba-4e9d-92ad-33787665a1ed admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:31.997295 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce5560-24ba-4e9d-92ad-33787665a1ed admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:31.999895 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce5560-24ba-4e9d-92ad-33787665a1ed admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:32.019713 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-22ce5560-24ba-4e9d-92ad-33787665a1ed admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 23 03:55:32.021164 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 415/836] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:55:31 2021] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:32.027613 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f2a84-bae3-43d9-9ffc-3321396a8c11 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:32.043613 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f2a84-bae3-43d9-9ffc-3321396a8c11 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:32.049794 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8363a01-8b0c-4d07-bb9e-2800f24a99af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:32.050468 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8363a01-8b0c-4d07-bb9e-2800f24a99af admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:32.050756 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8363a01-8b0c-4d07-bb9e-2800f24a99af admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:32.051037 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8363a01-8b0c-4d07-bb9e-2800f24a99af admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:32.052021 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8363a01-8b0c-4d07-bb9e-2800f24a99af admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:32.052333 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8363a01-8b0c-4d07-bb9e-2800f24a99af admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:32.054172 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8363a01-8b0c-4d07-bb9e-2800f24a99af admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:32.073392 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 422/837] 10.222.0.54 () {56 vars in 1156 bytes} [Tue Nov 23 03:55:32 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:32.080155 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce5560-24ba-4e9d-92ad-33787665a1ed admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:32.090105 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce5560-24ba-4e9d-92ad-33787665a1ed admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:32.094653 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1784d-9fdd-4c28-aef5-92bae498d7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:32.095868 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1784d-9fdd-4c28-aef5-92bae498d7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:32.096235 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1784d-9fdd-4c28-aef5-92bae498d7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:32.096524 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1784d-9fdd-4c28-aef5-92bae498d7c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:32.107349 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1784d-9fdd-4c28-aef5-92bae498d7c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:32.109188 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1784d-9fdd-4c28-aef5-92bae498d7c2 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:32.127985 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-46e1784d-9fdd-4c28-aef5-92bae498d7c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:32.134326 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 416/838] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:32.135654 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8363a01-8b0c-4d07-bb9e-2800f24a99af admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:32.145868 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8363a01-8b0c-4d07-bb9e-2800f24a99af admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:32.150724 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ee051-15bc-4408-83bd-77ab60331906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:32.151541 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ee051-15bc-4408-83bd-77ab60331906 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:32.151902 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ee051-15bc-4408-83bd-77ab60331906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:32.152250 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ee051-15bc-4408-83bd-77ab60331906 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:32.153101 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ee051-15bc-4408-83bd-77ab60331906 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:32.153493 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ee051-15bc-4408-83bd-77ab60331906 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:32.155237 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ee051-15bc-4408-83bd-77ab60331906 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:32.174004 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 423/839] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:32.175381 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1784d-9fdd-4c28-aef5-92bae498d7c2 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:32.185761 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1784d-9fdd-4c28-aef5-92bae498d7c2 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:32.194664 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9b80c-e3e7-450e-b685-b1559542a90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:32.195628 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9b80c-e3e7-450e-b685-b1559542a90c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:32.195980 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9b80c-e3e7-450e-b685-b1559542a90c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:32.196325 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9b80c-e3e7-450e-b685-b1559542a90c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:32.204190 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9b80c-e3e7-450e-b685-b1559542a90c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:32.206587 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9b80c-e3e7-450e-b685-b1559542a90c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:32.225131 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-bde9b80c-e3e7-450e-b685-b1559542a90c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:32.226441 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 417/840] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:32.232953 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ee051-15bc-4408-83bd-77ab60331906 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:32.244255 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ee051-15bc-4408-83bd-77ab60331906 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:32.255160 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffec240-26e9-40f0-b2e7-5a3a96316a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:32.255953 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffec240-26e9-40f0-b2e7-5a3a96316a42 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:32.256342 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffec240-26e9-40f0-b2e7-5a3a96316a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:32.256624 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffec240-26e9-40f0-b2e7-5a3a96316a42 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:32.257488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffec240-26e9-40f0-b2e7-5a3a96316a42 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:32.257803 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffec240-26e9-40f0-b2e7-5a3a96316a42 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:32.259825 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffec240-26e9-40f0-b2e7-5a3a96316a42 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:32.275312 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 424/841] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:32.280678 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9b80c-e3e7-450e-b685-b1559542a90c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:32.292751 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9b80c-e3e7-450e-b685-b1559542a90c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:32.297501 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369960e-7b0d-4a34-8da2-6b1c4b53c728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:32.298504 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369960e-7b0d-4a34-8da2-6b1c4b53c728 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:32.298847 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369960e-7b0d-4a34-8da2-6b1c4b53c728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:32.299134 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369960e-7b0d-4a34-8da2-6b1c4b53c728 admin admin] PATH_INFO: `/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/3bd439c1f0764f4cac7eb641a485937a/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:32.301260 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369960e-7b0d-4a34-8da2-6b1c4b53c728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa78bb05b3e48f3a9c973567c781357, user_id=3bd439c1f0764f4cac7eb641a485937a, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:32.304007 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369960e-7b0d-4a34-8da2-6b1c4b53c728 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:32.397292 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 418/842] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:55:32 2021] PUT /identity/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/3bd439c1f0764f4cac7eb641a485937a/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:55:32.495789 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f83bff-bf5c-4a66-ba38-aebefa06a73b None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:32.495789 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f83bff-bf5c-4a66-ba38-aebefa06a73b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:32.495789 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f83bff-bf5c-4a66-ba38-aebefa06a73b None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:32.495789 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 425/843] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:32.508750 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800397de-b62a-4f24-81ca-e782d83eabdc None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:32.509384 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800397de-b62a-4f24-81ca-e782d83eabdc None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:32.509905 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800397de-b62a-4f24-81ca-e782d83eabdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:32.538343 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-800397de-b62a-4f24-81ca-e782d83eabdc None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:32.539944 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-800397de-b62a-4f24-81ca-e782d83eabdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:32.613029 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 419/844] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:32 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:32.655006 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f83bff-bf5c-4a66-ba38-aebefa06a73b None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:32.674320 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f83bff-bf5c-4a66-ba38-aebefa06a73b None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:32.685055 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675c6f4-0072-4adf-9c83-23c96ee5ae68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:32.685881 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675c6f4-0072-4adf-9c83-23c96ee5ae68 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:32.686165 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675c6f4-0072-4adf-9c83-23c96ee5ae68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:32.686443 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675c6f4-0072-4adf-9c83-23c96ee5ae68 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:32.687121 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675c6f4-0072-4adf-9c83-23c96ee5ae68 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:32.688906 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675c6f4-0072-4adf-9c83-23c96ee5ae68 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:32.701080 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-d675c6f4-0072-4adf-9c83-23c96ee5ae68 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 23 03:55:32.702566 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 426/845] 10.222.0.54 () {56 vars in 1150 bytes} [Tue Nov 23 03:55:32 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:32.709524 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800397de-b62a-4f24-81ca-e782d83eabdc None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:32.718707 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800397de-b62a-4f24-81ca-e782d83eabdc None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:32.725283 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bccd9f-e91b-49ab-a6ff-a9efe8222cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:32.725956 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bccd9f-e91b-49ab-a6ff-a9efe8222cda admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:32.726240 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bccd9f-e91b-49ab-a6ff-a9efe8222cda admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:32.726517 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bccd9f-e91b-49ab-a6ff-a9efe8222cda admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:32.727273 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bccd9f-e91b-49ab-a6ff-a9efe8222cda admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:32.727585 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bccd9f-e91b-49ab-a6ff-a9efe8222cda admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:32.729188 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bccd9f-e91b-49ab-a6ff-a9efe8222cda admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:32.734497 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 420/846] 10.222.0.54 () {56 vars in 1145 bytes} [Tue Nov 23 03:55:32 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:32.740887 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675c6f4-0072-4adf-9c83-23c96ee5ae68 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:32.753123 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675c6f4-0072-4adf-9c83-23c96ee5ae68 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:32.762270 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d230e-271d-4ba5-8587-111acb66a1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:32.762942 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d230e-271d-4ba5-8587-111acb66a1ce admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:32.763238 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d230e-271d-4ba5-8587-111acb66a1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:32.763518 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d230e-271d-4ba5-8587-111acb66a1ce admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:32.764241 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d230e-271d-4ba5-8587-111acb66a1ce admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:32.764551 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d230e-271d-4ba5-8587-111acb66a1ce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:32.766131 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d230e-271d-4ba5-8587-111acb66a1ce admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:32.778703 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 427/847] 10.222.0.54 () {56 vars in 1145 bytes} [Tue Nov 23 03:55:32 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:32.785330 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bccd9f-e91b-49ab-a6ff-a9efe8222cda admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:32.799629 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bccd9f-e91b-49ab-a6ff-a9efe8222cda admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:32.809940 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd256a17-3a75-414e-8f9a-99b4619013e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:32.810944 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd256a17-3a75-414e-8f9a-99b4619013e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:32.811514 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd256a17-3a75-414e-8f9a-99b4619013e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:32.811993 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd256a17-3a75-414e-8f9a-99b4619013e0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:32.813017 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd256a17-3a75-414e-8f9a-99b4619013e0 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:32.814349 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING py.warnings [None req-dd256a17-3a75-414e-8f9a-99b4619013e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:55:32.814349 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: warnings.warn(msg) Nov 23 03:55:32.814349 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: Nov 23 03:55:32.815608 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd256a17-3a75-414e-8f9a-99b4619013e0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:32.933523 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 421/848] 10.222.0.54 () {60 vars in 1165 bytes} [Tue Nov 23 03:55:32 2021] POST /identity/v3/endpoints => generated 346 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:55:33.208782 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0f85f-cc3e-4d63-9f2d-11d5acb60bda None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:33.209124 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0f85f-cc3e-4d63-9f2d-11d5acb60bda None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:33.209298 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0f85f-cc3e-4d63-9f2d-11d5acb60bda None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:33.211432 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 428/849] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:33.217618 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfb672-ab98-4d78-b1f1-8b01b3f6524f None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:33.217896 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfb672-ab98-4d78-b1f1-8b01b3f6524f None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:33.218170 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfb672-ab98-4d78-b1f1-8b01b3f6524f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:33.242186 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-7ccfb672-ab98-4d78-b1f1-8b01b3f6524f None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:33.243416 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-7ccfb672-ab98-4d78-b1f1-8b01b3f6524f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:33.265431 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 422/850] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:33 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:55:33.299874 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0f85f-cc3e-4d63-9f2d-11d5acb60bda None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:33.312570 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0f85f-cc3e-4d63-9f2d-11d5acb60bda None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:33.318827 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d3da8-61fd-4439-aff4-9aa8c98752b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:33.319645 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d3da8-61fd-4439-aff4-9aa8c98752b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:33.319927 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d3da8-61fd-4439-aff4-9aa8c98752b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:33.320198 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d3da8-61fd-4439-aff4-9aa8c98752b7 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:33.320868 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d3da8-61fd-4439-aff4-9aa8c98752b7 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:33.322432 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d3da8-61fd-4439-aff4-9aa8c98752b7 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:33.335483 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-5c1d3da8-61fd-4439-aff4-9aa8c98752b7 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 23 03:55:33.336974 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 429/851] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:33 2021] GET /identity/v3/services/network => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:33.343423 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfb672-ab98-4d78-b1f1-8b01b3f6524f None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:33.353793 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfb672-ab98-4d78-b1f1-8b01b3f6524f None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:33.358503 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc23bdb-4fdd-4a29-b4aa-c2cbf934a961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:33.359389 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc23bdb-4fdd-4a29-b4aa-c2cbf934a961 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:33.359821 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc23bdb-4fdd-4a29-b4aa-c2cbf934a961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:33.360242 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc23bdb-4fdd-4a29-b4aa-c2cbf934a961 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:33.361463 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc23bdb-4fdd-4a29-b4aa-c2cbf934a961 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:33.361973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc23bdb-4fdd-4a29-b4aa-c2cbf934a961 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:33.363805 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc23bdb-4fdd-4a29-b4aa-c2cbf934a961 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:33.369735 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 423/852] 10.222.0.54 () {56 vars in 1133 bytes} [Tue Nov 23 03:55:33 2021] GET /identity/v3/services?name=network => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:33.376055 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d3da8-61fd-4439-aff4-9aa8c98752b7 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:33.389580 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d3da8-61fd-4439-aff4-9aa8c98752b7 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:33.397822 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46896647-61e0-430b-831a-c5f841c30123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:33.398801 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46896647-61e0-430b-831a-c5f841c30123 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:33.399291 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46896647-61e0-430b-831a-c5f841c30123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:33.399717 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46896647-61e0-430b-831a-c5f841c30123 admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:33.400655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46896647-61e0-430b-831a-c5f841c30123 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:33.401118 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46896647-61e0-430b-831a-c5f841c30123 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:33.402967 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46896647-61e0-430b-831a-c5f841c30123 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:33.417963 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 430/853] 10.222.0.54 () {56 vars in 1133 bytes} [Tue Nov 23 03:55:33 2021] GET /identity/v3/services?type=network => generated 350 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:33.424899 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc23bdb-4fdd-4a29-b4aa-c2cbf934a961 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:33.436610 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc23bdb-4fdd-4a29-b4aa-c2cbf934a961 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:33.447591 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91594d83-bf0c-47d2-9d95-524fbec99ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:33.448506 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91594d83-bf0c-47d2-9d95-524fbec99ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:33.448939 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91594d83-bf0c-47d2-9d95-524fbec99ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:33.449424 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91594d83-bf0c-47d2-9d95-524fbec99ae7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:33.450386 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91594d83-bf0c-47d2-9d95-524fbec99ae7 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:33.452243 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91594d83-bf0c-47d2-9d95-524fbec99ae7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:33.563236 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 424/854] 10.222.0.54 () {60 vars in 1165 bytes} [Tue Nov 23 03:55:33 2021] POST /identity/v3/endpoints => generated 327 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:55:34.373668 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe832d4-a1cf-4c34-9c96-62663d97bf1a None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:34.374678 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe832d4-a1cf-4c34-9c96-62663d97bf1a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:34.375190 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe832d4-a1cf-4c34-9c96-62663d97bf1a None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:34.378263 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 431/855] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:34 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:34.384681 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724e45e-4e54-4932-8d64-5a6907ed56e5 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:34.385299 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724e45e-4e54-4932-8d64-5a6907ed56e5 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:34.385844 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724e45e-4e54-4932-8d64-5a6907ed56e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:34.408888 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-6724e45e-4e54-4932-8d64-5a6907ed56e5 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:34.410081 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-6724e45e-4e54-4932-8d64-5a6907ed56e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:34.427405 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 425/856] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:34 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:34.447442 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e61326-1081-4493-8776-eb0269cf10ee None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:34.448055 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e61326-1081-4493-8776-eb0269cf10ee None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:34.448553 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e61326-1081-4493-8776-eb0269cf10ee None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:34.450865 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 432/857] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:34.454069 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724e45e-4e54-4932-8d64-5a6907ed56e5 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:34.456684 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054d425-4ff4-4573-a1cf-94f5548095d6 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:34.457068 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054d425-4ff4-4573-a1cf-94f5548095d6 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:34.457478 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054d425-4ff4-4573-a1cf-94f5548095d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:34.466106 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724e45e-4e54-4932-8d64-5a6907ed56e5 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:34.471832 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca8565-00bd-4f3e-945d-de0a699dd889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:34.472866 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca8565-00bd-4f3e-945d-de0a699dd889 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:34.473384 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca8565-00bd-4f3e-945d-de0a699dd889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:34.473857 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca8565-00bd-4f3e-945d-de0a699dd889 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:34.474818 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca8565-00bd-4f3e-945d-de0a699dd889 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:34.474937 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-2054d425-4ff4-4573-a1cf-94f5548095d6 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:34.476248 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-2054d425-4ff4-4573-a1cf-94f5548095d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:34.476976 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca8565-00bd-4f3e-945d-de0a699dd889 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:34.484524 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 433/858] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:34 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:55:34.489840 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-78ca8565-00bd-4f3e-945d-de0a699dd889 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 23 03:55:34.491286 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 426/859] 10.222.0.54 () {56 vars in 1153 bytes} [Tue Nov 23 03:55:34 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:34.498220 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054d425-4ff4-4573-a1cf-94f5548095d6 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:34.512861 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054d425-4ff4-4573-a1cf-94f5548095d6 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:34.514024 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca8565-00bd-4f3e-945d-de0a699dd889 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:34.517969 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931445e-b9de-4df2-9fc5-de3edd055aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:34.518855 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931445e-b9de-4df2-9fc5-de3edd055aeb admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:34.519493 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931445e-b9de-4df2-9fc5-de3edd055aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:34.519982 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931445e-b9de-4df2-9fc5-de3edd055aeb admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:34.520919 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931445e-b9de-4df2-9fc5-de3edd055aeb admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:34.521304 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931445e-b9de-4df2-9fc5-de3edd055aeb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:34.523050 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931445e-b9de-4df2-9fc5-de3edd055aeb admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:34.532352 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca8565-00bd-4f3e-945d-de0a699dd889 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:34.533031 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 434/860] 10.222.0.54 () {56 vars in 1147 bytes} [Tue Nov 23 03:55:34 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:34.538853 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931445e-b9de-4df2-9fc5-de3edd055aeb admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:34.540823 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda22acd-c432-4ef6-acb8-bf54216e26cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:34.541870 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda22acd-c432-4ef6-acb8-bf54216e26cc admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:34.542347 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda22acd-c432-4ef6-acb8-bf54216e26cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:34.542814 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda22acd-c432-4ef6-acb8-bf54216e26cc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:34.550824 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931445e-b9de-4df2-9fc5-de3edd055aeb admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:34.556961 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d815a-4647-404a-892f-0df6deaabda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:34.557624 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d815a-4647-404a-892f-0df6deaabda3 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:34.558006 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d815a-4647-404a-892f-0df6deaabda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:34.558232 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda22acd-c432-4ef6-acb8-bf54216e26cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:34.558334 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d815a-4647-404a-892f-0df6deaabda3 admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:34.558996 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d815a-4647-404a-892f-0df6deaabda3 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:34.559376 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d815a-4647-404a-892f-0df6deaabda3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:34.561151 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d815a-4647-404a-892f-0df6deaabda3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:34.567687 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-eda22acd-c432-4ef6-acb8-bf54216e26cc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 03:55:34.567815 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 435/861] 10.222.0.54 () {56 vars in 1147 bytes} [Tue Nov 23 03:55:34 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:34.574096 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 427/862] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:55:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:34.580729 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d815a-4647-404a-892f-0df6deaabda3 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:34.591523 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d815a-4647-404a-892f-0df6deaabda3 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:34.597396 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57536f-9bbc-4dc8-ac5d-b2794dbbdc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:34.598585 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57536f-9bbc-4dc8-ac5d-b2794dbbdc7e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:34.599103 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57536f-9bbc-4dc8-ac5d-b2794dbbdc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:34.599524 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57536f-9bbc-4dc8-ac5d-b2794dbbdc7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:34.600361 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57536f-9bbc-4dc8-ac5d-b2794dbbdc7e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:34.600673 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57536f-9bbc-4dc8-ac5d-b2794dbbdc7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:34.602384 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57536f-9bbc-4dc8-ac5d-b2794dbbdc7e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:34.613341 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 436/863] 10.222.0.54 () {56 vars in 1124 bytes} [Tue Nov 23 03:55:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:34.619825 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda22acd-c432-4ef6-acb8-bf54216e26cc admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:34.631299 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda22acd-c432-4ef6-acb8-bf54216e26cc admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:34.636017 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1c9d2-bac3-497d-adf2-8b605c33fce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:34.636901 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1c9d2-bac3-497d-adf2-8b605c33fce3 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:34.637437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1c9d2-bac3-497d-adf2-8b605c33fce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:34.637739 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1c9d2-bac3-497d-adf2-8b605c33fce3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:34.651488 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1c9d2-bac3-497d-adf2-8b605c33fce3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:34.654169 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1c9d2-bac3-497d-adf2-8b605c33fce3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:34.680758 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-99f1c9d2-bac3-497d-adf2-8b605c33fce3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:34.682376 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 428/864] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:34.689133 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57536f-9bbc-4dc8-ac5d-b2794dbbdc7e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:34.700498 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57536f-9bbc-4dc8-ac5d-b2794dbbdc7e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:34.706164 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19450f6b-aaab-4029-aa14-d187cbe64cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:34.707597 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19450f6b-aaab-4029-aa14-d187cbe64cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:34.708186 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19450f6b-aaab-4029-aa14-d187cbe64cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:34.708656 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19450f6b-aaab-4029-aa14-d187cbe64cb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:34.709606 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19450f6b-aaab-4029-aa14-d187cbe64cb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:34.710106 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19450f6b-aaab-4029-aa14-d187cbe64cb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:34.711970 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19450f6b-aaab-4029-aa14-d187cbe64cb9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:34.726231 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 437/865] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:34.732913 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1c9d2-bac3-497d-adf2-8b605c33fce3 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:34.743872 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1c9d2-bac3-497d-adf2-8b605c33fce3 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:34.749050 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299b464-2334-4f0b-ab08-a4d5a630a4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:34.750185 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299b464-2334-4f0b-ab08-a4d5a630a4ff admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:34.750695 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299b464-2334-4f0b-ab08-a4d5a630a4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:34.751256 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299b464-2334-4f0b-ab08-a4d5a630a4ff admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:34.760085 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299b464-2334-4f0b-ab08-a4d5a630a4ff admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:34.762470 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299b464-2334-4f0b-ab08-a4d5a630a4ff admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:34.779487 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-c299b464-2334-4f0b-ab08-a4d5a630a4ff admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 23 03:55:34.786656 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 429/866] 10.222.0.54 () {56 vars in 1138 bytes} [Tue Nov 23 03:55:34 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:34.788496 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19450f6b-aaab-4029-aa14-d187cbe64cb9 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:34.803071 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19450f6b-aaab-4029-aa14-d187cbe64cb9 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:34.808237 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b00335-c1e7-451b-8f53-057caa758797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:34.809242 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b00335-c1e7-451b-8f53-057caa758797 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:34.809748 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b00335-c1e7-451b-8f53-057caa758797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:34.810218 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b00335-c1e7-451b-8f53-057caa758797 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:34.811312 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b00335-c1e7-451b-8f53-057caa758797 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:34.811820 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b00335-c1e7-451b-8f53-057caa758797 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:34.814542 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b00335-c1e7-451b-8f53-057caa758797 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:34.839240 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 438/867] 10.222.0.54 () {56 vars in 1170 bytes} [Tue Nov 23 03:55:34 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:34.840937 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299b464-2334-4f0b-ab08-a4d5a630a4ff admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:34.851315 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299b464-2334-4f0b-ab08-a4d5a630a4ff admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:34.856114 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b37af-8e03-4a28-9c63-f10e51dd7374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:34.857149 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b37af-8e03-4a28-9c63-f10e51dd7374 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:34.857630 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b37af-8e03-4a28-9c63-f10e51dd7374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:34.858095 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b37af-8e03-4a28-9c63-f10e51dd7374 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:34.867642 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b37af-8e03-4a28-9c63-f10e51dd7374 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:34.869699 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b37af-8e03-4a28-9c63-f10e51dd7374 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:34.880753 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 430/868] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:34 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 03:55:34.887890 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b00335-c1e7-451b-8f53-057caa758797 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:34.899799 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b00335-c1e7-451b-8f53-057caa758797 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:34.905133 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3d79f-6b5a-4038-bac1-c1a924da8828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:34.906447 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3d79f-6b5a-4038-bac1-c1a924da8828 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:34.906990 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3d79f-6b5a-4038-bac1-c1a924da8828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:34.907540 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3d79f-6b5a-4038-bac1-c1a924da8828 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:34.920889 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3d79f-6b5a-4038-bac1-c1a924da8828 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:34.923796 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3d79f-6b5a-4038-bac1-c1a924da8828 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:34.950285 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-bcf3d79f-6b5a-4038-bac1-c1a924da8828 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:34.952192 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 439/869] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:34.959093 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b37af-8e03-4a28-9c63-f10e51dd7374 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:34.969414 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b37af-8e03-4a28-9c63-f10e51dd7374 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:34.974717 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876db128-c7e7-4934-994a-ab3bdb075e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:34.976074 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876db128-c7e7-4934-994a-ab3bdb075e9b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:34.976739 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876db128-c7e7-4934-994a-ab3bdb075e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:34.977419 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876db128-c7e7-4934-994a-ab3bdb075e9b admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:34.978677 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876db128-c7e7-4934-994a-ab3bdb075e9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:34.979558 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876db128-c7e7-4934-994a-ab3bdb075e9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:34.981341 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876db128-c7e7-4934-994a-ab3bdb075e9b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:34.995717 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 431/870] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:35.003924 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3d79f-6b5a-4038-bac1-c1a924da8828 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:35.015998 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3d79f-6b5a-4038-bac1-c1a924da8828 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:35.023794 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324663bf-d64a-499f-95ff-0754a73f6474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:35.025061 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324663bf-d64a-499f-95ff-0754a73f6474 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:35.025625 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324663bf-d64a-499f-95ff-0754a73f6474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:35.026134 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324663bf-d64a-499f-95ff-0754a73f6474 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:35.037532 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324663bf-d64a-499f-95ff-0754a73f6474 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:35.041565 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324663bf-d64a-499f-95ff-0754a73f6474 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:35.059057 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-324663bf-d64a-499f-95ff-0754a73f6474 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:35.061536 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 440/871] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:35.068607 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876db128-c7e7-4934-994a-ab3bdb075e9b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:35.080086 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876db128-c7e7-4934-994a-ab3bdb075e9b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:35.085068 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1065b-b27b-4fdb-9e95-f006993bde6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:35.086461 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1065b-b27b-4fdb-9e95-f006993bde6e admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:35.087094 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1065b-b27b-4fdb-9e95-f006993bde6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:35.087891 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1065b-b27b-4fdb-9e95-f006993bde6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:35.089387 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1065b-b27b-4fdb-9e95-f006993bde6e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:35.090149 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1065b-b27b-4fdb-9e95-f006993bde6e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:35.093891 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1065b-b27b-4fdb-9e95-f006993bde6e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:35.109284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 432/872] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:35.117917 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324663bf-d64a-499f-95ff-0754a73f6474 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:35.132678 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324663bf-d64a-499f-95ff-0754a73f6474 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:35.138315 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825db32-a71a-4426-9440-1f3b989b8504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:35.139452 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825db32-a71a-4426-9440-1f3b989b8504 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:35.140249 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825db32-a71a-4426-9440-1f3b989b8504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:35.140728 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825db32-a71a-4426-9440-1f3b989b8504 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:35.143045 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825db32-a71a-4426-9440-1f3b989b8504 admin admin] RBAC: Adding query filter params (role.id=4dde72f5d769401aa566e1c65c1f40d5, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=b68d0745d9cb49a5bd9331148967764a) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:35.143636 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825db32-a71a-4426-9440-1f3b989b8504 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:35.145737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825db32-a71a-4426-9440-1f3b989b8504 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:35.153362 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 441/873] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:55:35 2021] GET /identity/v3/role_assignments?user.id=b68d0745d9cb49a5bd9331148967764a&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=4dde72f5d769401aa566e1c65c1f40d5 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:35.202164 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717f1f9-f76a-414d-9ac5-fa87eff074ff None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:35.202608 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717f1f9-f76a-414d-9ac5-fa87eff074ff None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:35.203064 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717f1f9-f76a-414d-9ac5-fa87eff074ff None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:35.206086 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 433/874] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:35 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:35.212547 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ca432-8b21-42ed-bc89-18aba185fe42 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:35.213156 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ca432-8b21-42ed-bc89-18aba185fe42 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:35.213796 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ca432-8b21-42ed-bc89-18aba185fe42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:35.234407 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-ff3ca432-8b21-42ed-bc89-18aba185fe42 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:35.236475 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-ff3ca432-8b21-42ed-bc89-18aba185fe42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:35.245392 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 442/875] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:35 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:35.271091 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717f1f9-f76a-414d-9ac5-fa87eff074ff None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:35.285076 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717f1f9-f76a-414d-9ac5-fa87eff074ff None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:35.290311 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b329e-70f2-4347-91f4-ee53f5a0aa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:35.291543 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b329e-70f2-4347-91f4-ee53f5a0aa58 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:35.292110 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b329e-70f2-4347-91f4-ee53f5a0aa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:35.292596 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b329e-70f2-4347-91f4-ee53f5a0aa58 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:35.305018 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b329e-70f2-4347-91f4-ee53f5a0aa58 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:35.312571 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-ea3b329e-70f2-4347-91f4-ee53f5a0aa58 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:55:35.315298 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 434/876] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:55:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:35.322442 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ca432-8b21-42ed-bc89-18aba185fe42 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:35.335240 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ca432-8b21-42ed-bc89-18aba185fe42 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:35.340372 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d4f3c-eb55-416b-b9c8-c87b28607e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:35.341503 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d4f3c-eb55-416b-b9c8-c87b28607e56 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:35.342039 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d4f3c-eb55-416b-b9c8-c87b28607e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:35.342533 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d4f3c-eb55-416b-b9c8-c87b28607e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:35.343609 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d4f3c-eb55-416b-b9c8-c87b28607e56 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:35.344171 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d4f3c-eb55-416b-b9c8-c87b28607e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:35.346245 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d4f3c-eb55-416b-b9c8-c87b28607e56 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:35.357001 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 443/877] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:55:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:35.363920 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b329e-70f2-4347-91f4-ee53f5a0aa58 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:35.374640 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b329e-70f2-4347-91f4-ee53f5a0aa58 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:35.380802 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e0dc4-7fb9-4f39-b1e8-e2aba39ac7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:35.382055 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e0dc4-7fb9-4f39-b1e8-e2aba39ac7bc admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:35.382559 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e0dc4-7fb9-4f39-b1e8-e2aba39ac7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:35.383049 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e0dc4-7fb9-4f39-b1e8-e2aba39ac7bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:35.396733 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e0dc4-7fb9-4f39-b1e8-e2aba39ac7bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:35.398904 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e0dc4-7fb9-4f39-b1e8-e2aba39ac7bc admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:35.417451 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-299e0dc4-7fb9-4f39-b1e8-e2aba39ac7bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:35.418890 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 435/878] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:35.424993 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d4f3c-eb55-416b-b9c8-c87b28607e56 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:35.435437 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d4f3c-eb55-416b-b9c8-c87b28607e56 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:35.441674 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9605dd-d7f0-43d1-b502-eb644b3ded92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:35.442336 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9605dd-d7f0-43d1-b502-eb644b3ded92 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:35.442617 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9605dd-d7f0-43d1-b502-eb644b3ded92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:35.442887 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9605dd-d7f0-43d1-b502-eb644b3ded92 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:35.443662 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9605dd-d7f0-43d1-b502-eb644b3ded92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:35.443982 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9605dd-d7f0-43d1-b502-eb644b3ded92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:35.445525 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9605dd-d7f0-43d1-b502-eb644b3ded92 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:35.458331 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 444/879] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:35.464218 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e0dc4-7fb9-4f39-b1e8-e2aba39ac7bc admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:35.474585 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e0dc4-7fb9-4f39-b1e8-e2aba39ac7bc admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:35.480462 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95047a-bfb8-4bfa-993a-ae5173866129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:35.481258 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95047a-bfb8-4bfa-993a-ae5173866129 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:35.481541 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95047a-bfb8-4bfa-993a-ae5173866129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:35.481817 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95047a-bfb8-4bfa-993a-ae5173866129 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:35.492036 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc95047a-bfb8-4bfa-993a-ae5173866129 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:35.494382 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc95047a-bfb8-4bfa-993a-ae5173866129 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:35.509435 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-dc95047a-bfb8-4bfa-993a-ae5173866129 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 23 03:55:35.511350 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 436/880] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:55:35 2021] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:35.517840 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9605dd-d7f0-43d1-b502-eb644b3ded92 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:35.528998 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9605dd-d7f0-43d1-b502-eb644b3ded92 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:35.533956 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34dfda4-96ba-4a23-9d93-a8db287b2293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:35.534952 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dfda4-96ba-4a23-9d93-a8db287b2293 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:35.535487 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dfda4-96ba-4a23-9d93-a8db287b2293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:35.536027 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dfda4-96ba-4a23-9d93-a8db287b2293 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:35.537077 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34dfda4-96ba-4a23-9d93-a8db287b2293 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:35.537592 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34dfda4-96ba-4a23-9d93-a8db287b2293 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:35.539683 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34dfda4-96ba-4a23-9d93-a8db287b2293 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:35.559052 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 445/881] 10.222.0.54 () {56 vars in 1156 bytes} [Tue Nov 23 03:55:35 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:35.566587 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95047a-bfb8-4bfa-993a-ae5173866129 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:35.577660 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95047a-bfb8-4bfa-993a-ae5173866129 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:35.582967 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdabeba-4353-4abf-abd2-77d8cfce3dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:35.584069 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdabeba-4353-4abf-abd2-77d8cfce3dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:35.584611 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdabeba-4353-4abf-abd2-77d8cfce3dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:35.585086 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdabeba-4353-4abf-abd2-77d8cfce3dd6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:35.594617 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdabeba-4353-4abf-abd2-77d8cfce3dd6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:35.596912 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdabeba-4353-4abf-abd2-77d8cfce3dd6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:35.607695 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 437/882] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:35 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 03:55:35.614895 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34dfda4-96ba-4a23-9d93-a8db287b2293 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:35.625142 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34dfda4-96ba-4a23-9d93-a8db287b2293 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:35.630549 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9306b-0efc-49f4-a476-6fe47bbfde19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:35.631663 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9306b-0efc-49f4-a476-6fe47bbfde19 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:35.632188 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9306b-0efc-49f4-a476-6fe47bbfde19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:35.632680 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9306b-0efc-49f4-a476-6fe47bbfde19 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:35.643619 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9306b-0efc-49f4-a476-6fe47bbfde19 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:35.645699 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9306b-0efc-49f4-a476-6fe47bbfde19 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:35.668846 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-e4f9306b-0efc-49f4-a476-6fe47bbfde19 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:35.670718 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 446/883] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:35.680524 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdabeba-4353-4abf-abd2-77d8cfce3dd6 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:35.690274 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdabeba-4353-4abf-abd2-77d8cfce3dd6 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:35.694995 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab8c56-35c0-4628-a21b-9c7acd717b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:35.695673 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab8c56-35c0-4628-a21b-9c7acd717b09 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:35.695952 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab8c56-35c0-4628-a21b-9c7acd717b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:35.696228 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab8c56-35c0-4628-a21b-9c7acd717b09 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:35.697021 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab8c56-35c0-4628-a21b-9c7acd717b09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:35.697327 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab8c56-35c0-4628-a21b-9c7acd717b09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:35.698938 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab8c56-35c0-4628-a21b-9c7acd717b09 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:35.712812 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 438/884] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:35.718769 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9306b-0efc-49f4-a476-6fe47bbfde19 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:35.728730 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9306b-0efc-49f4-a476-6fe47bbfde19 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:35.733331 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49d738-f350-4d13-b419-bcc777d0e8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:35.734163 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49d738-f350-4d13-b419-bcc777d0e8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:35.734496 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49d738-f350-4d13-b419-bcc777d0e8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:35.734784 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49d738-f350-4d13-b419-bcc777d0e8b3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:35.742755 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49d738-f350-4d13-b419-bcc777d0e8b3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:35.744777 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49d738-f350-4d13-b419-bcc777d0e8b3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:35.758009 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-0f49d738-f350-4d13-b419-bcc777d0e8b3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:35.759533 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 447/885] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:35.762076 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f212e5-1b18-483b-b9a0-bdcf9927ab50 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:35.762363 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f212e5-1b18-483b-b9a0-bdcf9927ab50 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:35.762637 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f212e5-1b18-483b-b9a0-bdcf9927ab50 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:35.764754 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 439/886] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:35.765628 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49d738-f350-4d13-b419-bcc777d0e8b3 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:35.771591 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6a3b9-665c-420b-a24f-67f870ca2229 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:35.771872 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6a3b9-665c-420b-a24f-67f870ca2229 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:35.772149 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6a3b9-665c-420b-a24f-67f870ca2229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:35.777076 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49d738-f350-4d13-b419-bcc777d0e8b3 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:35.781691 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a668d-05aa-4d81-9e51-58cf14c03c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:35.782362 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a668d-05aa-4d81-9e51-58cf14c03c20 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:35.782703 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a668d-05aa-4d81-9e51-58cf14c03c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:35.782978 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a668d-05aa-4d81-9e51-58cf14c03c20 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:35.783799 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a668d-05aa-4d81-9e51-58cf14c03c20 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:35.784104 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a668d-05aa-4d81-9e51-58cf14c03c20 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:35.785925 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a668d-05aa-4d81-9e51-58cf14c03c20 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:35.790606 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-63d6a3b9-665c-420b-a24f-67f870ca2229 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:35.791825 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-63d6a3b9-665c-420b-a24f-67f870ca2229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:35.799115 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 448/887] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:35.805123 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 440/888] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:35 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:55:35.805406 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a668d-05aa-4d81-9e51-58cf14c03c20 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:35.819472 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a668d-05aa-4d81-9e51-58cf14c03c20 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:35.824151 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf40242-dd19-4ea1-af60-8e02f5564c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:35.824844 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf40242-dd19-4ea1-af60-8e02f5564c2e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:35.825126 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf40242-dd19-4ea1-af60-8e02f5564c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:35.825403 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf40242-dd19-4ea1-af60-8e02f5564c2e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:35.826295 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf40242-dd19-4ea1-af60-8e02f5564c2e admin admin] RBAC: Adding query filter params (role.id=3db7012b41944542a50049819500eadd, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=3bd439c1f0764f4cac7eb641a485937a) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:35.826659 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf40242-dd19-4ea1-af60-8e02f5564c2e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:35.828549 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf40242-dd19-4ea1-af60-8e02f5564c2e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:35.828735 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6a3b9-665c-420b-a24f-67f870ca2229 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:35.836125 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 449/889] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:55:35 2021] GET /identity/v3/role_assignments?user.id=3bd439c1f0764f4cac7eb641a485937a&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=3db7012b41944542a50049819500eadd => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:35.838767 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6a3b9-665c-420b-a24f-67f870ca2229 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:35.843925 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e734a-9048-4303-9fc8-027297fc3736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:35.845098 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e734a-9048-4303-9fc8-027297fc3736 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:35.845705 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e734a-9048-4303-9fc8-027297fc3736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:35.846090 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e734a-9048-4303-9fc8-027297fc3736 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:35.846967 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e734a-9048-4303-9fc8-027297fc3736 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:35.848996 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e734a-9048-4303-9fc8-027297fc3736 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:35.861654 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-e39e734a-9048-4303-9fc8-027297fc3736 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 23 03:55:35.863401 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 441/890] 10.222.0.54 () {56 vars in 1135 bytes} [Tue Nov 23 03:55:35 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:35.870355 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf40242-dd19-4ea1-af60-8e02f5564c2e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:35.881183 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf40242-dd19-4ea1-af60-8e02f5564c2e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:35.885860 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa692265-6644-41dd-9e6f-c22a4e1ab7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:35.886575 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa692265-6644-41dd-9e6f-c22a4e1ab7cf admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:35.886857 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa692265-6644-41dd-9e6f-c22a4e1ab7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:35.887187 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa692265-6644-41dd-9e6f-c22a4e1ab7cf admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:35.887947 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa692265-6644-41dd-9e6f-c22a4e1ab7cf admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:35.888250 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa692265-6644-41dd-9e6f-c22a4e1ab7cf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:35.889911 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa692265-6644-41dd-9e6f-c22a4e1ab7cf admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:35.896314 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 450/891] 10.222.0.54 () {56 vars in 1135 bytes} [Tue Nov 23 03:55:35 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:35.902866 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e734a-9048-4303-9fc8-027297fc3736 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:35.913549 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e734a-9048-4303-9fc8-027297fc3736 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:35.918390 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ce2cb-2f55-4a72-96fb-d9e5dc5c5b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:35.919166 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ce2cb-2f55-4a72-96fb-d9e5dc5c5b18 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:35.919430 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ce2cb-2f55-4a72-96fb-d9e5dc5c5b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:35.919696 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ce2cb-2f55-4a72-96fb-d9e5dc5c5b18 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:35.920489 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ce2cb-2f55-4a72-96fb-d9e5dc5c5b18 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:35.920793 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ce2cb-2f55-4a72-96fb-d9e5dc5c5b18 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:35.922450 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ce2cb-2f55-4a72-96fb-d9e5dc5c5b18 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:35.928508 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 442/892] 10.222.0.54 () {56 vars in 1135 bytes} [Tue Nov 23 03:55:35 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:37.027142 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabebd7-a947-451f-b8a0-be6d4c285d82 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:37.027142 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabebd7-a947-451f-b8a0-be6d4c285d82 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:37.027142 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabebd7-a947-451f-b8a0-be6d4c285d82 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:37.028459 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 451/893] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:37.035570 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c9879-a16c-410f-a2f3-0996800e04ee None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:37.038089 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c9879-a16c-410f-a2f3-0996800e04ee None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:37.038089 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c9879-a16c-410f-a2f3-0996800e04ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:37.057138 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-569c9879-a16c-410f-a2f3-0996800e04ee None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:37.058669 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-569c9879-a16c-410f-a2f3-0996800e04ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:37.075311 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 443/894] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:37 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:37.093440 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabebd7-a947-451f-b8a0-be6d4c285d82 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:37.106773 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabebd7-a947-451f-b8a0-be6d4c285d82 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:37.112717 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e797b41-744b-4281-ac3b-5a9a3ce4e47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:37.113630 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e797b41-744b-4281-ac3b-5a9a3ce4e47a admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:37.114119 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e797b41-744b-4281-ac3b-5a9a3ce4e47a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:37.114619 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e797b41-744b-4281-ac3b-5a9a3ce4e47a admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:37.115581 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e797b41-744b-4281-ac3b-5a9a3ce4e47a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:37.117350 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e797b41-744b-4281-ac3b-5a9a3ce4e47a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:37.199412 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 452/895] 10.222.0.54 () {60 vars in 1162 bytes} [Tue Nov 23 03:55:37 2021] POST /identity/v3/services => generated 269 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:55:37.645323 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce183b-1a22-4cda-9bc2-2b1cde6dcc7b None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:37.645726 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce183b-1a22-4cda-9bc2-2b1cde6dcc7b None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:37.645903 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce183b-1a22-4cda-9bc2-2b1cde6dcc7b None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:37.647987 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 444/896] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:37.653929 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d383b-5a91-4d58-9f26-5893fc137f1f None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:37.654226 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d383b-5a91-4d58-9f26-5893fc137f1f None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:37.654505 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d383b-5a91-4d58-9f26-5893fc137f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:37.673053 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-6b0d383b-5a91-4d58-9f26-5893fc137f1f None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:37.674421 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-6b0d383b-5a91-4d58-9f26-5893fc137f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:37.701526 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 453/897] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:37 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:37.725284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce183b-1a22-4cda-9bc2-2b1cde6dcc7b None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:37.738935 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce183b-1a22-4cda-9bc2-2b1cde6dcc7b None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:37.743533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b85f2-5025-4e5d-863d-1918364dc488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:37.744384 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b85f2-5025-4e5d-863d-1918364dc488 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:37.744669 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b85f2-5025-4e5d-863d-1918364dc488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:37.744996 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b85f2-5025-4e5d-863d-1918364dc488 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:37.756288 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b85f2-5025-4e5d-863d-1918364dc488 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:37.763653 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-595b85f2-5025-4e5d-863d-1918364dc488 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 23 03:55:37.770502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 445/898] 10.222.0.54 () {56 vars in 1141 bytes} [Tue Nov 23 03:55:37 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:37.772749 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d383b-5a91-4d58-9f26-5893fc137f1f None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:37.782044 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d383b-5a91-4d58-9f26-5893fc137f1f None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:37.787470 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299e6e8-783d-4d06-a461-b769a1586ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:37.788131 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299e6e8-783d-4d06-a461-b769a1586ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:37.788418 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299e6e8-783d-4d06-a461-b769a1586ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:37.788694 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299e6e8-783d-4d06-a461-b769a1586ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:37.789485 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299e6e8-783d-4d06-a461-b769a1586ac5 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:37.789791 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299e6e8-783d-4d06-a461-b769a1586ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:37.791419 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299e6e8-783d-4d06-a461-b769a1586ac5 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:37.806594 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 454/899] 10.222.0.54 () {56 vars in 1136 bytes} [Tue Nov 23 03:55:37 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:37.807962 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b85f2-5025-4e5d-863d-1918364dc488 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:37.819015 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b85f2-5025-4e5d-863d-1918364dc488 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:37.823815 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a9dcb-5530-4b79-98ce-bd493629bba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:37.824673 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a9dcb-5530-4b79-98ce-bd493629bba1 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:37.824959 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a9dcb-5530-4b79-98ce-bd493629bba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:37.825331 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a9dcb-5530-4b79-98ce-bd493629bba1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:37.840296 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a9dcb-5530-4b79-98ce-bd493629bba1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:37.842393 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a9dcb-5530-4b79-98ce-bd493629bba1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:37.859636 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-188a9dcb-5530-4b79-98ce-bd493629bba1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:37.861997 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 446/900] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:37.867977 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299e6e8-783d-4d06-a461-b769a1586ac5 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:37.878919 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299e6e8-783d-4d06-a461-b769a1586ac5 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:37.883563 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d494f93-2b74-4349-a574-4c2f633c51b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:37.884220 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d494f93-2b74-4349-a574-4c2f633c51b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:37.884506 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d494f93-2b74-4349-a574-4c2f633c51b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:37.884786 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d494f93-2b74-4349-a574-4c2f633c51b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:37.885520 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d494f93-2b74-4349-a574-4c2f633c51b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:37.885830 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d494f93-2b74-4349-a574-4c2f633c51b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:37.887425 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d494f93-2b74-4349-a574-4c2f633c51b0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:37.905388 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 455/901] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:37.906769 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a9dcb-5530-4b79-98ce-bd493629bba1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:37.920635 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a9dcb-5530-4b79-98ce-bd493629bba1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:37.927027 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd269b5-908f-474e-87fb-03e1bdd5461e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:37.928148 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd269b5-908f-474e-87fb-03e1bdd5461e admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:37.928661 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd269b5-908f-474e-87fb-03e1bdd5461e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:37.929197 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd269b5-908f-474e-87fb-03e1bdd5461e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:37.937895 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd269b5-908f-474e-87fb-03e1bdd5461e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:37.941615 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd269b5-908f-474e-87fb-03e1bdd5461e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:37.957025 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-0fd269b5-908f-474e-87fb-03e1bdd5461e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 23 03:55:37.963342 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 447/902] 10.222.0.54 () {56 vars in 1138 bytes} [Tue Nov 23 03:55:37 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:37.965456 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d494f93-2b74-4349-a574-4c2f633c51b0 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:37.976435 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d494f93-2b74-4349-a574-4c2f633c51b0 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:37.981576 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e25ba-d79a-4c2a-bb7e-c1b55c60f549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:37.982538 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e25ba-d79a-4c2a-bb7e-c1b55c60f549 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:37.983042 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e25ba-d79a-4c2a-bb7e-c1b55c60f549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:37.983550 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e25ba-d79a-4c2a-bb7e-c1b55c60f549 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:37.984620 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e25ba-d79a-4c2a-bb7e-c1b55c60f549 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:37.985107 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e25ba-d79a-4c2a-bb7e-c1b55c60f549 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:37.988480 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e25ba-d79a-4c2a-bb7e-c1b55c60f549 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:38.013216 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 456/903] 10.222.0.54 () {56 vars in 1170 bytes} [Tue Nov 23 03:55:37 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:38.014902 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd269b5-908f-474e-87fb-03e1bdd5461e admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:38.026903 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd269b5-908f-474e-87fb-03e1bdd5461e admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:38.032351 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a68a9-a250-4975-b701-481d0fdc0fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:38.033948 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a68a9-a250-4975-b701-481d0fdc0fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:38.034449 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a68a9-a250-4975-b701-481d0fdc0fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:38.034935 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a68a9-a250-4975-b701-481d0fdc0fc1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:38.044827 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a68a9-a250-4975-b701-481d0fdc0fc1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:38.047652 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a68a9-a250-4975-b701-481d0fdc0fc1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:38.066450 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 448/904] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:38 2021] GET /identity/v3/auth/tokens => generated 1562 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 03:55:38.068295 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e25ba-d79a-4c2a-bb7e-c1b55c60f549 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:38.080187 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e25ba-d79a-4c2a-bb7e-c1b55c60f549 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:38.086108 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbe376-b424-4e05-9d2b-6ef12f941d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:38.087225 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbe376-b424-4e05-9d2b-6ef12f941d10 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:38.087720 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbe376-b424-4e05-9d2b-6ef12f941d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:38.096962 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbe376-b424-4e05-9d2b-6ef12f941d10 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:38.100472 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbe376-b424-4e05-9d2b-6ef12f941d10 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:38.102303 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbe376-b424-4e05-9d2b-6ef12f941d10 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:38.120748 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-aebbe376-b424-4e05-9d2b-6ef12f941d10 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:38.128719 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 457/905] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:38.130022 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a68a9-a250-4975-b701-481d0fdc0fc1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:38.139615 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a68a9-a250-4975-b701-481d0fdc0fc1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:38.145273 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c87f69-f7ca-4956-850f-29e9188df038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:38.146218 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c87f69-f7ca-4956-850f-29e9188df038 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:38.146707 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c87f69-f7ca-4956-850f-29e9188df038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:38.147250 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c87f69-f7ca-4956-850f-29e9188df038 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:38.148226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c87f69-f7ca-4956-850f-29e9188df038 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:38.148734 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c87f69-f7ca-4956-850f-29e9188df038 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:38.150613 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c87f69-f7ca-4956-850f-29e9188df038 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:38.165049 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 449/906] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:38.171644 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbe376-b424-4e05-9d2b-6ef12f941d10 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:38.182860 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbe376-b424-4e05-9d2b-6ef12f941d10 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:38.187818 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7980c-4a46-4d21-98f0-f3b2eefd4edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:38.190002 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7980c-4a46-4d21-98f0-f3b2eefd4edf admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:38.190499 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7980c-4a46-4d21-98f0-f3b2eefd4edf admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:38.191324 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7980c-4a46-4d21-98f0-f3b2eefd4edf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:38.199179 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7980c-4a46-4d21-98f0-f3b2eefd4edf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:38.201513 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7980c-4a46-4d21-98f0-f3b2eefd4edf admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:38.214740 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632563a2-4c19-4f48-bb67-2c9e435873df None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:38.215075 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632563a2-4c19-4f48-bb67-2c9e435873df None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:38.215393 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632563a2-4c19-4f48-bb67-2c9e435873df None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:38.217311 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 450/907] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:55:38.221149 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-00c7980c-4a46-4d21-98f0-f3b2eefd4edf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:38.224800 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bbe9f-4ddf-4174-bd1d-32654334049f None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:38.225335 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bbe9f-4ddf-4174-bd1d-32654334049f None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:38.225831 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bbe9f-4ddf-4174-bd1d-32654334049f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:38.227354 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 458/908] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:38.229367 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7980c-4a46-4d21-98f0-f3b2eefd4edf admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:38.242815 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7980c-4a46-4d21-98f0-f3b2eefd4edf admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:38.247495 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8208e-4590-4ba7-ac35-b78f875389b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:38.248204 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8208e-4590-4ba7-ac35-b78f875389b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:38.248488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8208e-4590-4ba7-ac35-b78f875389b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:38.248767 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8208e-4590-4ba7-ac35-b78f875389b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:38.249622 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8208e-4590-4ba7-ac35-b78f875389b3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:38.249935 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8208e-4590-4ba7-ac35-b78f875389b3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:38.252653 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8208e-4590-4ba7-ac35-b78f875389b3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:38.252827 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-606bbe9f-4ddf-4174-bd1d-32654334049f None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:38.254474 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-606bbe9f-4ddf-4174-bd1d-32654334049f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:38.263977 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 451/909] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:38 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:55:38.265495 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e7555-4053-4eb1-86e1-a1a131291110 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:38.265996 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e7555-4053-4eb1-86e1-a1a131291110 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:38.266476 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e7555-4053-4eb1-86e1-a1a131291110 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:38.268556 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 452/911] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:38.270888 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 459/911] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:38.272058 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e7555-4053-4eb1-86e1-a1a131291110 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:38.277123 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ea2bd-c356-4b09-9b77-598e8d9a07d9 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:38.277416 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ea2bd-c356-4b09-9b77-598e8d9a07d9 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:38.277697 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ea2bd-c356-4b09-9b77-598e8d9a07d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:38.286735 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e7555-4053-4eb1-86e1-a1a131291110 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:38.292338 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f7b73-27fd-401c-96c2-76e62d91c7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:38.293556 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f7b73-27fd-401c-96c2-76e62d91c7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:38.294061 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f7b73-27fd-401c-96c2-76e62d91c7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:38.294552 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f7b73-27fd-401c-96c2-76e62d91c7b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:38.295672 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f7b73-27fd-401c-96c2-76e62d91c7b4 admin admin] RBAC: Adding query filter params (role.id=6132be24a4fd4b2898805fc917e8da2a, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=b68d0745d9cb49a5bd9331148967764a) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:38.296270 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f7b73-27fd-401c-96c2-76e62d91c7b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:38.296788 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-fa9ea2bd-c356-4b09-9b77-598e8d9a07d9 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:38.298058 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-fa9ea2bd-c356-4b09-9b77-598e8d9a07d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:38.299134 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f7b73-27fd-401c-96c2-76e62d91c7b4 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:38.306136 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 453/912] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:55:38 2021] GET /identity/v3/role_assignments?user.id=b68d0745d9cb49a5bd9331148967764a&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=6132be24a4fd4b2898805fc917e8da2a => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:38.307259 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f7b73-27fd-401c-96c2-76e62d91c7b4 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:38.316281 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 460/913] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:38 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:55:38.318793 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f7b73-27fd-401c-96c2-76e62d91c7b4 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:38.324262 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdfedf-53e4-4608-a20e-fe4479f90b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:38.325676 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdfedf-53e4-4608-a20e-fe4479f90b63 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:38.326149 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdfedf-53e4-4608-a20e-fe4479f90b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:38.326588 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdfedf-53e4-4608-a20e-fe4479f90b63 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:38.327626 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdfedf-53e4-4608-a20e-fe4479f90b63 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:38.330092 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdfedf-53e4-4608-a20e-fe4479f90b63 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:38.336309 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ea2bd-c356-4b09-9b77-598e8d9a07d9 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:38.344643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-94bdfedf-53e4-4608-a20e-fe4479f90b63 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 23 03:55:38.346708 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ea2bd-c356-4b09-9b77-598e8d9a07d9 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:38.347154 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 454/914] 10.222.0.54 () {56 vars in 1147 bytes} [Tue Nov 23 03:55:38 2021] GET /identity/v3/services/object-store => generated 93 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:38.355245 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd577f21-b785-43e0-8e6f-538a72cb93a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:38.355245 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd577f21-b785-43e0-8e6f-538a72cb93a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:38.355245 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd577f21-b785-43e0-8e6f-538a72cb93a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:38.355245 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd577f21-b785-43e0-8e6f-538a72cb93a9 admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:38.355665 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd577f21-b785-43e0-8e6f-538a72cb93a9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:38.355665 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd577f21-b785-43e0-8e6f-538a72cb93a9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:38.357759 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdfedf-53e4-4608-a20e-fe4479f90b63 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:38.368070 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdfedf-53e4-4608-a20e-fe4479f90b63 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:38.372814 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bf90a-1343-4d18-9bbd-1955d918912a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:38.373609 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bf90a-1343-4d18-9bbd-1955d918912a admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:38.373951 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bf90a-1343-4d18-9bbd-1955d918912a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:38.374281 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bf90a-1343-4d18-9bbd-1955d918912a admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:38.375101 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2bf90a-1343-4d18-9bbd-1955d918912a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:38.381120 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2bf90a-1343-4d18-9bbd-1955d918912a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:38.381120 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2bf90a-1343-4d18-9bbd-1955d918912a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:38.386585 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 455/915] 10.222.0.54 () {56 vars in 1143 bytes} [Tue Nov 23 03:55:38 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:38.389840 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bf90a-1343-4d18-9bbd-1955d918912a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:38.400224 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bf90a-1343-4d18-9bbd-1955d918912a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:38.404912 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b8882-b181-4cd8-80f3-c40382f91388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:38.405589 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b8882-b181-4cd8-80f3-c40382f91388 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:38.405874 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b8882-b181-4cd8-80f3-c40382f91388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:38.406152 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b8882-b181-4cd8-80f3-c40382f91388 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:38.406888 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b8882-b181-4cd8-80f3-c40382f91388 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:38.409856 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b8882-b181-4cd8-80f3-c40382f91388 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:38.410102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b8882-b181-4cd8-80f3-c40382f91388 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:38.415341 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 456/916] 10.222.0.54 () {56 vars in 1143 bytes} [Tue Nov 23 03:55:38 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:38.437676 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 461/917] 10.222.0.54 () {60 vars in 1162 bytes} [Tue Nov 23 03:55:38 2021] POST /identity/v3/services => generated 251 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 03:55:39.592286 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fb5e2-f60c-4bc8-a15d-ab16524eba61 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:39.592877 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fb5e2-f60c-4bc8-a15d-ab16524eba61 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:39.592877 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fb5e2-f60c-4bc8-a15d-ab16524eba61 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:39.594913 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 457/918] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:39.601138 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09260c58-d9c2-442e-96f9-e2c669baf5b3 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:39.601653 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09260c58-d9c2-442e-96f9-e2c669baf5b3 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:39.601791 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09260c58-d9c2-442e-96f9-e2c669baf5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:39.620188 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-09260c58-d9c2-442e-96f9-e2c669baf5b3 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:39.621418 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-09260c58-d9c2-442e-96f9-e2c669baf5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:39.640779 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 462/919] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:39 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:55:39.667557 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fb5e2-f60c-4bc8-a15d-ab16524eba61 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:39.685211 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fb5e2-f60c-4bc8-a15d-ab16524eba61 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:39.690367 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089fc82-660d-4149-944b-1cb70dcab01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:39.691452 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089fc82-660d-4149-944b-1cb70dcab01a admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:39.691734 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089fc82-660d-4149-944b-1cb70dcab01a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:39.692008 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089fc82-660d-4149-944b-1cb70dcab01a admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:39.692676 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089fc82-660d-4149-944b-1cb70dcab01a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:39.694239 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089fc82-660d-4149-944b-1cb70dcab01a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:39.705484 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-a089fc82-660d-4149-944b-1cb70dcab01a admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 23 03:55:39.706952 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 458/920] 10.222.0.54 () {56 vars in 1153 bytes} [Tue Nov 23 03:55:39 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:39.713450 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09260c58-d9c2-442e-96f9-e2c669baf5b3 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:39.722966 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09260c58-d9c2-442e-96f9-e2c669baf5b3 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:39.727595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978f14a-8a18-43fa-a0d1-bcf123040d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:39.728255 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978f14a-8a18-43fa-a0d1-bcf123040d96 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:39.728537 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978f14a-8a18-43fa-a0d1-bcf123040d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:39.728814 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978f14a-8a18-43fa-a0d1-bcf123040d96 admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:39.729536 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978f14a-8a18-43fa-a0d1-bcf123040d96 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:39.729842 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978f14a-8a18-43fa-a0d1-bcf123040d96 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:39.731460 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978f14a-8a18-43fa-a0d1-bcf123040d96 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:39.737280 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 463/921] 10.222.0.54 () {56 vars in 1147 bytes} [Tue Nov 23 03:55:39 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:39.743511 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089fc82-660d-4149-944b-1cb70dcab01a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:39.753874 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089fc82-660d-4149-944b-1cb70dcab01a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:39.758391 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ef782-bfa5-48bc-8669-4179b1276d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:39.759029 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ef782-bfa5-48bc-8669-4179b1276d7f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:39.759343 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ef782-bfa5-48bc-8669-4179b1276d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:39.759622 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ef782-bfa5-48bc-8669-4179b1276d7f admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:39.760337 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ef782-bfa5-48bc-8669-4179b1276d7f admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:39.760640 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ef782-bfa5-48bc-8669-4179b1276d7f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:39.762212 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ef782-bfa5-48bc-8669-4179b1276d7f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:39.767547 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 459/922] 10.222.0.54 () {56 vars in 1147 bytes} [Tue Nov 23 03:55:39 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:39.773793 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978f14a-8a18-43fa-a0d1-bcf123040d96 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:39.784195 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978f14a-8a18-43fa-a0d1-bcf123040d96 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:39.788759 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135cde3-9474-4d0a-aa0f-7be1da896024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:39.789409 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135cde3-9474-4d0a-aa0f-7be1da896024 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:39.789694 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135cde3-9474-4d0a-aa0f-7be1da896024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:39.789971 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135cde3-9474-4d0a-aa0f-7be1da896024 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:39.790768 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135cde3-9474-4d0a-aa0f-7be1da896024 admin admin] RBAC: Adding query filter params (interface=public, service_id=7cabcc4100bc4808b92b337542848e7c, region_id=RegionOne) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:39.791077 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135cde3-9474-4d0a-aa0f-7be1da896024 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:39.792687 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135cde3-9474-4d0a-aa0f-7be1da896024 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:39.798453 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 464/923] 10.222.0.54 () {56 vars in 1272 bytes} [Tue Nov 23 03:55:39 2021] GET /identity/v3/endpoints?service_id=7cabcc4100bc4808b92b337542848e7c&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:39.804595 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ef782-bfa5-48bc-8669-4179b1276d7f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:39.815280 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ef782-bfa5-48bc-8669-4179b1276d7f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:39.820231 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41481afa-0b42-4b13-8e96-a8bad8dafb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:39.820932 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41481afa-0b42-4b13-8e96-a8bad8dafb37 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:39.821213 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41481afa-0b42-4b13-8e96-a8bad8dafb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:39.821490 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41481afa-0b42-4b13-8e96-a8bad8dafb37 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:39.822243 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41481afa-0b42-4b13-8e96-a8bad8dafb37 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:39.823896 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41481afa-0b42-4b13-8e96-a8bad8dafb37 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:39.830389 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 460/924] 10.222.0.54 () {56 vars in 1108 bytes} [Tue Nov 23 03:55:39 2021] GET /identity/v3/services => generated 1268 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 03:55:40.656583 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358f14a-02e9-47f1-afee-661814468271 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:40.656583 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358f14a-02e9-47f1-afee-661814468271 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:40.656583 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358f14a-02e9-47f1-afee-661814468271 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:40.656583 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 465/925] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:40.666156 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ed809-48ce-4adb-8993-783ffad530c4 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:40.666156 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ed809-48ce-4adb-8993-783ffad530c4 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:40.666156 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ed809-48ce-4adb-8993-783ffad530c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:40.687770 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-723ed809-48ce-4adb-8993-783ffad530c4 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:40.689515 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-723ed809-48ce-4adb-8993-783ffad530c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:40.697904 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 461/926] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:40 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:40.720987 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358f14a-02e9-47f1-afee-661814468271 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:40.733345 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358f14a-02e9-47f1-afee-661814468271 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:40.738394 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aeef62-1964-4ad4-b0e3-16f97ff9795c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:40.739263 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aeef62-1964-4ad4-b0e3-16f97ff9795c admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:40.739550 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aeef62-1964-4ad4-b0e3-16f97ff9795c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:40.739823 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aeef62-1964-4ad4-b0e3-16f97ff9795c admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:40.750877 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aeef62-1964-4ad4-b0e3-16f97ff9795c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:40.758337 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-07aeef62-1964-4ad4-b0e3-16f97ff9795c admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 23 03:55:40.759914 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 466/927] 10.222.0.54 () {56 vars in 1141 bytes} [Tue Nov 23 03:55:40 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:40.766136 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ed809-48ce-4adb-8993-783ffad530c4 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:40.775817 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ed809-48ce-4adb-8993-783ffad530c4 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:40.780150 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0fce5-ed15-4d7e-a016-2330f010d8e0 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:40.780448 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1dc59-a467-45c8-85b0-3ad000419db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:40.780883 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0fce5-ed15-4d7e-a016-2330f010d8e0 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:40.781100 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1dc59-a467-45c8-85b0-3ad000419db2 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:40.781380 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1dc59-a467-45c8-85b0-3ad000419db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:40.781649 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1dc59-a467-45c8-85b0-3ad000419db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:40.781951 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0fce5-ed15-4d7e-a016-2330f010d8e0 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:40.782671 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1dc59-a467-45c8-85b0-3ad000419db2 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:40.782969 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1dc59-a467-45c8-85b0-3ad000419db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:40.784690 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1dc59-a467-45c8-85b0-3ad000419db2 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:40.784943 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 467/928] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:40 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:55:40.790860 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188247ce-65cf-4b2f-99d8-fb41fc60ee1b None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:40.791561 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188247ce-65cf-4b2f-99d8-fb41fc60ee1b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:40.792023 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188247ce-65cf-4b2f-99d8-fb41fc60ee1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:40.793777 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 462/929] 10.222.0.54 () {56 vars in 1136 bytes} [Tue Nov 23 03:55:40 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:40.795099 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a6d79-7d89-49d0-aa02-c48f959c1b14 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:40.795427 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a6d79-7d89-49d0-aa02-c48f959c1b14 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:40.795703 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a6d79-7d89-49d0-aa02-c48f959c1b14 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:40.797597 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 463/930] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:40.801424 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a6d79-7d89-49d0-aa02-c48f959c1b14 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:40.812485 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-188247ce-65cf-4b2f-99d8-fb41fc60ee1b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:40.813769 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-188247ce-65cf-4b2f-99d8-fb41fc60ee1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:40.814913 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a6d79-7d89-49d0-aa02-c48f959c1b14 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:40.819915 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954c5f9-955a-4326-a4e8-db91ccfe2398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:40.820665 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954c5f9-955a-4326-a4e8-db91ccfe2398 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:40.820955 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954c5f9-955a-4326-a4e8-db91ccfe2398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:40.821236 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954c5f9-955a-4326-a4e8-db91ccfe2398 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:40.823434 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 468/931] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:40 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:55:40.823434 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0594f7-ec39-4329-bb1e-81e289f0521b None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:40.823644 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0594f7-ec39-4329-bb1e-81e289f0521b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:40.823917 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0594f7-ec39-4329-bb1e-81e289f0521b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:40.833968 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954c5f9-955a-4326-a4e8-db91ccfe2398 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:40.836021 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954c5f9-955a-4326-a4e8-db91ccfe2398 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:40.850706 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-7c0594f7-ec39-4329-bb1e-81e289f0521b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:40.851914 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-7c0594f7-ec39-4329-bb1e-81e289f0521b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:40.855344 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-d954c5f9-955a-4326-a4e8-db91ccfe2398 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:40.857003 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 464/932] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:40.857979 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954c5f9-955a-4326-a4e8-db91ccfe2398 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:40.859405 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 469/933] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:40 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:40.864728 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0594f7-ec39-4329-bb1e-81e289f0521b None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:40.869233 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954c5f9-955a-4326-a4e8-db91ccfe2398 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:40.875113 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258200a-f21e-4a67-8004-604535a37e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:40.876563 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258200a-f21e-4a67-8004-604535a37e3d admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:40.877077 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258200a-f21e-4a67-8004-604535a37e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:40.877210 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0594f7-ec39-4329-bb1e-81e289f0521b None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:40.877619 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258200a-f21e-4a67-8004-604535a37e3d admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:40.878562 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258200a-f21e-4a67-8004-604535a37e3d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:40.880390 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258200a-f21e-4a67-8004-604535a37e3d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:40.881997 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f36340-f5ea-4783-9a94-656b4128c8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:40.882750 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f36340-f5ea-4783-9a94-656b4128c8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:40.883230 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f36340-f5ea-4783-9a94-656b4128c8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:40.883611 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f36340-f5ea-4783-9a94-656b4128c8c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:40.884358 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f36340-f5ea-4783-9a94-656b4128c8c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:40.884667 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f36340-f5ea-4783-9a94-656b4128c8c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:40.886245 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f36340-f5ea-4783-9a94-656b4128c8c2 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:40.897849 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 470/934] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:40.900147 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f36340-f5ea-4783-9a94-656b4128c8c2 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:40.909567 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f36340-f5ea-4783-9a94-656b4128c8c2 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:40.913846 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e40396-9df8-4166-8754-55c139f1892d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:40.914607 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e40396-9df8-4166-8754-55c139f1892d admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:40.914891 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e40396-9df8-4166-8754-55c139f1892d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:40.915168 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e40396-9df8-4166-8754-55c139f1892d admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:40.915856 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e40396-9df8-4166-8754-55c139f1892d admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:40.917417 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e40396-9df8-4166-8754-55c139f1892d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:40.929246 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-74e40396-9df8-4166-8754-55c139f1892d admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 23 03:55:40.930417 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 471/935] 10.222.0.54 () {56 vars in 1135 bytes} [Tue Nov 23 03:55:40 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:40.931168 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e40396-9df8-4166-8754-55c139f1892d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:40.941485 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e40396-9df8-4166-8754-55c139f1892d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:40.946165 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f848b72-4c42-47be-be1d-20cd86984d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:40.946949 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f848b72-4c42-47be-be1d-20cd86984d4b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:40.947250 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f848b72-4c42-47be-be1d-20cd86984d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:40.947610 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f848b72-4c42-47be-be1d-20cd86984d4b admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:40.955955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f848b72-4c42-47be-be1d-20cd86984d4b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:40.958966 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f848b72-4c42-47be-be1d-20cd86984d4b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:40.961523 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 465/936] 10.222.0.54 () {60 vars in 1162 bytes} [Tue Nov 23 03:55:40 2021] POST /identity/v3/services => generated 241 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:55:40.971524 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258200a-f21e-4a67-8004-604535a37e3d admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:40.972962 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-2f848b72-4c42-47be-be1d-20cd86984d4b admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 23 03:55:40.974531 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 472/937] 10.222.0.54 () {56 vars in 1138 bytes} [Tue Nov 23 03:55:40 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:40.984529 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f848b72-4c42-47be-be1d-20cd86984d4b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:40.998450 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f848b72-4c42-47be-be1d-20cd86984d4b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:40.999639 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258200a-f21e-4a67-8004-604535a37e3d admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:41.004440 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd697e-3748-4e5b-95b8-1a6a21202cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:41.005133 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd697e-3748-4e5b-95b8-1a6a21202cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:41.005480 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd697e-3748-4e5b-95b8-1a6a21202cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:41.005742 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd697e-3748-4e5b-95b8-1a6a21202cf8 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:41.006162 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5b16c-6d80-4c9d-bcc5-19888828de19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:41.006658 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd697e-3748-4e5b-95b8-1a6a21202cf8 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:41.007011 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd697e-3748-4e5b-95b8-1a6a21202cf8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:41.007370 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5b16c-6d80-4c9d-bcc5-19888828de19 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:41.007785 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5b16c-6d80-4c9d-bcc5-19888828de19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:41.008245 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5b16c-6d80-4c9d-bcc5-19888828de19 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:41.009067 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd697e-3748-4e5b-95b8-1a6a21202cf8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:41.009262 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5b16c-6d80-4c9d-bcc5-19888828de19 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:41.009769 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5b16c-6d80-4c9d-bcc5-19888828de19 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:41.011826 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5b16c-6d80-4c9d-bcc5-19888828de19 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:41.019107 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 466/938] 10.222.0.54 () {56 vars in 1135 bytes} [Tue Nov 23 03:55:40 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:41.027278 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5b16c-6d80-4c9d-bcc5-19888828de19 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:41.038015 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5b16c-6d80-4c9d-bcc5-19888828de19 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:41.038686 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 473/939] 10.222.0.54 () {56 vars in 1170 bytes} [Tue Nov 23 03:55:40 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:41.039964 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd697e-3748-4e5b-95b8-1a6a21202cf8 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:41.043053 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95a922-5f45-4944-aa01-8b789021d752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:41.043868 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95a922-5f45-4944-aa01-8b789021d752 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:41.044278 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95a922-5f45-4944-aa01-8b789021d752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:41.044645 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95a922-5f45-4944-aa01-8b789021d752 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:41.045526 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95a922-5f45-4944-aa01-8b789021d752 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:41.045925 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95a922-5f45-4944-aa01-8b789021d752 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:41.048502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95a922-5f45-4944-aa01-8b789021d752 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:41.053520 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd697e-3748-4e5b-95b8-1a6a21202cf8 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:41.058701 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2c492-4c21-4a6d-b482-bcfbe9a28385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:41.059664 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 467/940] 10.222.0.54 () {56 vars in 1135 bytes} [Tue Nov 23 03:55:41 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:41.060130 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2c492-4c21-4a6d-b482-bcfbe9a28385 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:41.061164 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2c492-4c21-4a6d-b482-bcfbe9a28385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:41.061353 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95a922-5f45-4944-aa01-8b789021d752 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:41.061956 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2c492-4c21-4a6d-b482-bcfbe9a28385 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:41.076089 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2c492-4c21-4a6d-b482-bcfbe9a28385 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:41.078032 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2c492-4c21-4a6d-b482-bcfbe9a28385 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:41.078776 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95a922-5f45-4944-aa01-8b789021d752 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:41.085448 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c755698-3642-4184-8708-459c4aa8e183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:41.086462 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c755698-3642-4184-8708-459c4aa8e183 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:41.087538 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c755698-3642-4184-8708-459c4aa8e183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:41.088093 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c755698-3642-4184-8708-459c4aa8e183 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:41.089539 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c755698-3642-4184-8708-459c4aa8e183 admin admin] RBAC: Adding query filter params (interface=public, service_id=b6f5b4e693244d918ce5585ac3175a26, region_id=RegionOne) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:41.090335 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c755698-3642-4184-8708-459c4aa8e183 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:41.092293 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c755698-3642-4184-8708-459c4aa8e183 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:41.098970 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 468/941] 10.222.0.54 () {56 vars in 1272 bytes} [Tue Nov 23 03:55:41 2021] GET /identity/v3/endpoints?service_id=b6f5b4e693244d918ce5585ac3175a26&interface=public®ion_id=RegionOne => generated 194 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:41.104310 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-ddc2c492-4c21-4a6d-b482-bcfbe9a28385 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:41.105528 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c755698-3642-4184-8708-459c4aa8e183 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:41.105639 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 474/942] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:41.113983 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2c492-4c21-4a6d-b482-bcfbe9a28385 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:41.117349 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c755698-3642-4184-8708-459c4aa8e183 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:41.123505 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a3e9b-1b61-4b83-814d-528ac8b2dd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:41.124521 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a3e9b-1b61-4b83-814d-528ac8b2dd22 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:41.125013 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a3e9b-1b61-4b83-814d-528ac8b2dd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:41.125400 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2c492-4c21-4a6d-b482-bcfbe9a28385 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:41.125733 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a3e9b-1b61-4b83-814d-528ac8b2dd22 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:41.127604 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a3e9b-1b61-4b83-814d-528ac8b2dd22 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:41.129521 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a3e9b-1b61-4b83-814d-528ac8b2dd22 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:41.131066 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b481e9-9e59-434a-8a8f-918dab7406dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:41.132248 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b481e9-9e59-434a-8a8f-918dab7406dc admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:41.132361 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b481e9-9e59-434a-8a8f-918dab7406dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:41.132731 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b481e9-9e59-434a-8a8f-918dab7406dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:41.133496 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b481e9-9e59-434a-8a8f-918dab7406dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:41.133799 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b481e9-9e59-434a-8a8f-918dab7406dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:41.135577 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b481e9-9e59-434a-8a8f-918dab7406dc admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:41.139290 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 469/943] 10.222.0.54 () {56 vars in 1108 bytes} [Tue Nov 23 03:55:41 2021] GET /identity/v3/services => generated 1497 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 03:55:41.154180 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 475/944] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:41.160833 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a3e9b-1b61-4b83-814d-528ac8b2dd22 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:41.172181 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a3e9b-1b61-4b83-814d-528ac8b2dd22 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:41.177994 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6d670-a0a2-49ac-8775-ec0b85b17319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:41.179256 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6d670-a0a2-49ac-8775-ec0b85b17319 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:41.179770 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6d670-a0a2-49ac-8775-ec0b85b17319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:41.190533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6d670-a0a2-49ac-8775-ec0b85b17319 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:41.190533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6d670-a0a2-49ac-8775-ec0b85b17319 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:41.192259 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6d670-a0a2-49ac-8775-ec0b85b17319 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:41.206936 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-6da6d670-a0a2-49ac-8775-ec0b85b17319 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:41.208754 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 470/945] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:41.215316 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b481e9-9e59-434a-8a8f-918dab7406dc admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:41.227821 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b481e9-9e59-434a-8a8f-918dab7406dc admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:41.232655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acb32f-7335-4d3b-bb6f-f6bb49da025f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:41.233499 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acb32f-7335-4d3b-bb6f-f6bb49da025f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:41.233875 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acb32f-7335-4d3b-bb6f-f6bb49da025f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:41.234249 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acb32f-7335-4d3b-bb6f-f6bb49da025f admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:41.235160 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acb32f-7335-4d3b-bb6f-f6bb49da025f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:41.235675 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acb32f-7335-4d3b-bb6f-f6bb49da025f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:41.237754 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acb32f-7335-4d3b-bb6f-f6bb49da025f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:41.252527 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 476/946] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:41.259316 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6d670-a0a2-49ac-8775-ec0b85b17319 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:41.270415 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6d670-a0a2-49ac-8775-ec0b85b17319 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:41.275268 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2de47-b488-475d-ba79-a51334fde6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:41.276296 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2de47-b488-475d-ba79-a51334fde6d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:41.276712 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2de47-b488-475d-ba79-a51334fde6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:41.277050 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2de47-b488-475d-ba79-a51334fde6d2 admin admin] PATH_INFO: `/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/b68d0745d9cb49a5bd9331148967764a/roles/6132be24a4fd4b2898805fc917e8da2a` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:41.279538 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2de47-b488-475d-ba79-a51334fde6d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa78bb05b3e48f3a9c973567c781357, user_id=b68d0745d9cb49a5bd9331148967764a, role_id=6132be24a4fd4b2898805fc917e8da2a)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:41.282899 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2de47-b488-475d-ba79-a51334fde6d2 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:41.357749 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 471/947] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:55:41 2021] PUT /identity/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/b68d0745d9cb49a5bd9331148967764a/roles/6132be24a4fd4b2898805fc917e8da2a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:55:42.148094 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5f4cd-5895-48dd-a898-44c0bb512032 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:42.148805 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5f4cd-5895-48dd-a898-44c0bb512032 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:42.148805 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5f4cd-5895-48dd-a898-44c0bb512032 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:42.150644 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 477/948] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:42.156728 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5df20-d72b-4b44-a086-002f230abf3e None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:42.157729 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5df20-d72b-4b44-a086-002f230abf3e None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:42.158008 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5df20-d72b-4b44-a086-002f230abf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:42.175822 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-04f5df20-d72b-4b44-a086-002f230abf3e None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:42.177009 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-04f5df20-d72b-4b44-a086-002f230abf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:42.237834 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 472/949] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:42 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:42.261592 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5f4cd-5895-48dd-a898-44c0bb512032 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:42.274568 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5f4cd-5895-48dd-a898-44c0bb512032 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:42.278981 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6d9a5-38f5-408d-8c21-dc7e188ed1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:42.279798 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6d9a5-38f5-408d-8c21-dc7e188ed1eb admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:42.280077 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6d9a5-38f5-408d-8c21-dc7e188ed1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:42.280348 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6d9a5-38f5-408d-8c21-dc7e188ed1eb admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:42.281009 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6d9a5-38f5-408d-8c21-dc7e188ed1eb admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:42.282851 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6d9a5-38f5-408d-8c21-dc7e188ed1eb admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:42.294198 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-06d6d9a5-38f5-408d-8c21-dc7e188ed1eb admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 23 03:55:42.295667 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 478/950] 10.222.0.54 () {56 vars in 1153 bytes} [Tue Nov 23 03:55:42 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:42.302644 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5df20-d72b-4b44-a086-002f230abf3e None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:42.311742 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5df20-d72b-4b44-a086-002f230abf3e None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:42.317039 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cb394-3469-415f-9925-7586ee382847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:42.317734 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cb394-3469-415f-9925-7586ee382847 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:42.318016 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cb394-3469-415f-9925-7586ee382847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:42.318295 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cb394-3469-415f-9925-7586ee382847 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:42.319101 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cb394-3469-415f-9925-7586ee382847 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:42.319449 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cb394-3469-415f-9925-7586ee382847 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:42.321149 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cb394-3469-415f-9925-7586ee382847 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:42.326952 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 473/951] 10.222.0.54 () {56 vars in 1147 bytes} [Tue Nov 23 03:55:42 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:42.333756 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6d9a5-38f5-408d-8c21-dc7e188ed1eb admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:42.343426 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6d9a5-38f5-408d-8c21-dc7e188ed1eb admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:42.348485 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a0c2d-4f29-4b0a-abe3-e43d01f7f4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:42.349132 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a0c2d-4f29-4b0a-abe3-e43d01f7f4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:42.349417 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a0c2d-4f29-4b0a-abe3-e43d01f7f4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:42.349695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a0c2d-4f29-4b0a-abe3-e43d01f7f4d5 admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:42.350412 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a0c2d-4f29-4b0a-abe3-e43d01f7f4d5 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:42.350717 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a0c2d-4f29-4b0a-abe3-e43d01f7f4d5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:42.352312 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a0c2d-4f29-4b0a-abe3-e43d01f7f4d5 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:42.357397 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 479/952] 10.222.0.54 () {56 vars in 1147 bytes} [Tue Nov 23 03:55:42 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:42.363389 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cb394-3469-415f-9925-7586ee382847 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:42.372935 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cb394-3469-415f-9925-7586ee382847 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:42.377439 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861d6bc-f742-45f3-abf8-b4d6bfd05e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:42.378084 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d6bc-f742-45f3-abf8-b4d6bfd05e79 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:42.378371 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d6bc-f742-45f3-abf8-b4d6bfd05e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:42.378648 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d6bc-f742-45f3-abf8-b4d6bfd05e79 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:42.379447 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861d6bc-f742-45f3-abf8-b4d6bfd05e79 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:42.381014 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861d6bc-f742-45f3-abf8-b4d6bfd05e79 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:42.455503 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 474/953] 10.222.0.54 () {60 vars in 1165 bytes} [Tue Nov 23 03:55:42 2021] POST /identity/v3/endpoints => generated 347 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 03:55:43.378525 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ad328-e797-48fc-8f93-7baa2a10fedb None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:43.379272 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ad328-e797-48fc-8f93-7baa2a10fedb None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:43.379272 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ad328-e797-48fc-8f93-7baa2a10fedb None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:43.381217 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 480/954] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:43.387366 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9d164-04bf-460a-8863-7f671ffc95dc None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:43.387883 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9d164-04bf-460a-8863-7f671ffc95dc None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:43.388047 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9d164-04bf-460a-8863-7f671ffc95dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:43.405797 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-41f9d164-04bf-460a-8863-7f671ffc95dc None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:43.407546 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-41f9d164-04bf-460a-8863-7f671ffc95dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:43.425492 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 475/955] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:43 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:43.454730 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ad328-e797-48fc-8f93-7baa2a10fedb None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:43.463804 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ad328-e797-48fc-8f93-7baa2a10fedb None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:43.468444 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fef5c4-ba02-4150-b0b4-b4644be0b8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:43.469995 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fef5c4-ba02-4150-b0b4-b4644be0b8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:43.470502 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fef5c4-ba02-4150-b0b4-b4644be0b8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:43.471150 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fef5c4-ba02-4150-b0b4-b4644be0b8b3 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:43.472008 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fef5c4-ba02-4150-b0b4-b4644be0b8b3 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:43.473180 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0e046-19dd-4794-860f-519c56e65489 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:43.473563 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0e046-19dd-4794-860f-519c56e65489 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:43.473937 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0e046-19dd-4794-860f-519c56e65489 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:43.474217 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fef5c4-ba02-4150-b0b4-b4644be0b8b3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:43.476218 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 476/956] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:55:43.481978 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71551b1-475d-4391-af7c-c39d8b015702 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:43.482536 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71551b1-475d-4391-af7c-c39d8b015702 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:43.482536 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71551b1-475d-4391-af7c-c39d8b015702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:43.487996 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-18fef5c4-ba02-4150-b0b4-b4644be0b8b3 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 23 03:55:43.489681 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 481/957] 10.222.0.54 () {56 vars in 1147 bytes} [Tue Nov 23 03:55:43 2021] GET /identity/v3/services/object-store => generated 93 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:43.496099 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fef5c4-ba02-4150-b0b4-b4644be0b8b3 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:43.501305 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-d71551b1-475d-4391-af7c-c39d8b015702 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:43.502577 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-d71551b1-475d-4391-af7c-c39d8b015702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:43.507634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fef5c4-ba02-4150-b0b4-b4644be0b8b3 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:43.512563 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9819882-ea53-4228-93b8-e3238ea4fca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:43.513501 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9819882-ea53-4228-93b8-e3238ea4fca8 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:43.513989 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9819882-ea53-4228-93b8-e3238ea4fca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:43.514467 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9819882-ea53-4228-93b8-e3238ea4fca8 admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:43.515416 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9819882-ea53-4228-93b8-e3238ea4fca8 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:43.515952 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9819882-ea53-4228-93b8-e3238ea4fca8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:43.517900 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9819882-ea53-4228-93b8-e3238ea4fca8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:43.519356 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 477/958] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:43 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:43.524357 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 482/959] 10.222.0.54 () {56 vars in 1143 bytes} [Tue Nov 23 03:55:43 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:43.531304 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71551b1-475d-4391-af7c-c39d8b015702 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:43.536440 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9819882-ea53-4228-93b8-e3238ea4fca8 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:43.543681 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71551b1-475d-4391-af7c-c39d8b015702 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:43.546627 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9819882-ea53-4228-93b8-e3238ea4fca8 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:43.551685 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dead530-92de-483a-8b62-2742cbfdbefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:43.552366 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dead530-92de-483a-8b62-2742cbfdbefc admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:43.552643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dead530-92de-483a-8b62-2742cbfdbefc admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:43.552915 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dead530-92de-483a-8b62-2742cbfdbefc admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:43.553654 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dead530-92de-483a-8b62-2742cbfdbefc admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:43.553961 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dead530-92de-483a-8b62-2742cbfdbefc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:43.555646 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dead530-92de-483a-8b62-2742cbfdbefc admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:43.558298 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8a61a-3559-4a36-819e-685ca32bd083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:43.559413 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8a61a-3559-4a36-819e-685ca32bd083 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:43.559947 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8a61a-3559-4a36-819e-685ca32bd083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:43.560429 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8a61a-3559-4a36-819e-685ca32bd083 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:43.561332 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8a61a-3559-4a36-819e-685ca32bd083 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:43.561508 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 478/960] 10.222.0.54 () {56 vars in 1143 bytes} [Tue Nov 23 03:55:43 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:43.564259 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8a61a-3559-4a36-819e-685ca32bd083 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:43.570811 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dead530-92de-483a-8b62-2742cbfdbefc admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:43.576851 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-c4f8a61a-3559-4a36-819e-685ca32bd083 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 23 03:55:43.578853 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 483/961] 10.222.0.54 () {56 vars in 1135 bytes} [Tue Nov 23 03:55:43 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:43.585663 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dead530-92de-483a-8b62-2742cbfdbefc admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:43.587126 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8a61a-3559-4a36-819e-685ca32bd083 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:43.594498 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc6974-c97e-443c-8ad9-bc4b2890a2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:43.595404 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc6974-c97e-443c-8ad9-bc4b2890a2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:43.595920 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc6974-c97e-443c-8ad9-bc4b2890a2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:43.596390 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc6974-c97e-443c-8ad9-bc4b2890a2b9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:43.597402 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8a61a-3559-4a36-819e-685ca32bd083 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:43.597511 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc6974-c97e-443c-8ad9-bc4b2890a2b9 admin admin] RBAC: Adding query filter params (interface=public, service_id=aac561652ea74ae8a7c5815be0ad18bf, region_id=RegionOne) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:43.598155 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc6974-c97e-443c-8ad9-bc4b2890a2b9 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:43.600339 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc6974-c97e-443c-8ad9-bc4b2890a2b9 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:43.602012 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb723b5-733d-459f-9b8a-faac0c60d172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:43.602655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb723b5-733d-459f-9b8a-faac0c60d172 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:43.602945 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb723b5-733d-459f-9b8a-faac0c60d172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:43.603246 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb723b5-733d-459f-9b8a-faac0c60d172 admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:43.603965 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb723b5-733d-459f-9b8a-faac0c60d172 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:43.604275 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb723b5-733d-459f-9b8a-faac0c60d172 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:43.605843 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb723b5-733d-459f-9b8a-faac0c60d172 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:43.611954 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 484/963] 10.222.0.54 () {56 vars in 1135 bytes} [Tue Nov 23 03:55:43 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:43.612219 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 479/963] 10.222.0.54 () {56 vars in 1272 bytes} [Tue Nov 23 03:55:43 2021] GET /identity/v3/endpoints?service_id=aac561652ea74ae8a7c5815be0ad18bf&interface=public®ion_id=RegionOne => generated 194 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:43.616803 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb723b5-733d-459f-9b8a-faac0c60d172 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:43.617309 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc6974-c97e-443c-8ad9-bc4b2890a2b9 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:43.627794 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb723b5-733d-459f-9b8a-faac0c60d172 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:43.628216 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc6974-c97e-443c-8ad9-bc4b2890a2b9 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:43.632705 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b202dc5-1276-45dd-a4a1-807e1e443f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:43.633308 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b202dc5-1276-45dd-a4a1-807e1e443f6b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:43.633594 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b202dc5-1276-45dd-a4a1-807e1e443f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:43.633871 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b202dc5-1276-45dd-a4a1-807e1e443f6b admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:43.634583 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b202dc5-1276-45dd-a4a1-807e1e443f6b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:43.634902 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06000c-9545-4442-b0ff-036638837829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:43.635831 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06000c-9545-4442-b0ff-036638837829 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:43.636473 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b202dc5-1276-45dd-a4a1-807e1e443f6b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:43.636709 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06000c-9545-4442-b0ff-036638837829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:43.637374 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06000c-9545-4442-b0ff-036638837829 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:43.638850 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06000c-9545-4442-b0ff-036638837829 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:43.639493 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06000c-9545-4442-b0ff-036638837829 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:43.641281 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06000c-9545-4442-b0ff-036638837829 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:43.643899 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 485/964] 10.222.0.54 () {56 vars in 1108 bytes} [Tue Nov 23 03:55:43 2021] GET /identity/v3/services => generated 1497 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 03:55:43.648689 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 480/965] 10.222.0.54 () {56 vars in 1135 bytes} [Tue Nov 23 03:55:43 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:43.659357 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b202dc5-1276-45dd-a4a1-807e1e443f6b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:43.669806 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b202dc5-1276-45dd-a4a1-807e1e443f6b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:43.674794 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a243cc8-1272-4953-ba00-1cbdc9b27e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:43.675516 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a243cc8-1272-4953-ba00-1cbdc9b27e90 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:43.675854 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a243cc8-1272-4953-ba00-1cbdc9b27e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:43.676143 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a243cc8-1272-4953-ba00-1cbdc9b27e90 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:43.676989 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a243cc8-1272-4953-ba00-1cbdc9b27e90 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:43.678070 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING py.warnings [None req-0a243cc8-1272-4953-ba00-1cbdc9b27e90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:55:43.678070 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: warnings.warn(msg) Nov 23 03:55:43.678070 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: Nov 23 03:55:43.678963 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a243cc8-1272-4953-ba00-1cbdc9b27e90 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:43.724122 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9465db-65bb-40a0-bbc1-95ad5c794012 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:43.724447 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9465db-65bb-40a0-bbc1-95ad5c794012 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:43.724692 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9465db-65bb-40a0-bbc1-95ad5c794012 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:43.726958 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 481/966] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:55:43.732955 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d605f-96dd-444c-af48-5f9d2a191cef None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:43.733277 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d605f-96dd-444c-af48-5f9d2a191cef None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:43.733509 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d605f-96dd-444c-af48-5f9d2a191cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:43.753659 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-667d605f-96dd-444c-af48-5f9d2a191cef None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:43.754868 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-667d605f-96dd-444c-af48-5f9d2a191cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:43.763244 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 482/967] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:43 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:55:43.774660 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 486/968] 10.222.0.54 () {60 vars in 1165 bytes} [Tue Nov 23 03:55:43 2021] POST /identity/v3/endpoints => generated 346 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:55:43.789627 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d605f-96dd-444c-af48-5f9d2a191cef None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:43.800436 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d605f-96dd-444c-af48-5f9d2a191cef None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:43.817231 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5ff88-36e0-4969-9daf-ee34426dfaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:43.818067 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5ff88-36e0-4969-9daf-ee34426dfaff admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:43.818349 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5ff88-36e0-4969-9daf-ee34426dfaff admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:43.818624 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5ff88-36e0-4969-9daf-ee34426dfaff admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:43.831447 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5ff88-36e0-4969-9daf-ee34426dfaff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:43.839078 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-fac5ff88-36e0-4969-9daf-ee34426dfaff admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 23 03:55:43.840742 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 483/969] 10.222.0.54 () {56 vars in 1141 bytes} [Tue Nov 23 03:55:43 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:43.848019 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a243cc8-1272-4953-ba00-1cbdc9b27e90 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:43.858964 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a243cc8-1272-4953-ba00-1cbdc9b27e90 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:43.864307 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94b2d3-43c0-48d8-b22e-1d760451cd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:43.865005 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94b2d3-43c0-48d8-b22e-1d760451cd66 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:43.865279 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94b2d3-43c0-48d8-b22e-1d760451cd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:43.865559 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94b2d3-43c0-48d8-b22e-1d760451cd66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:43.866343 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94b2d3-43c0-48d8-b22e-1d760451cd66 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:43.866651 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94b2d3-43c0-48d8-b22e-1d760451cd66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:43.868337 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94b2d3-43c0-48d8-b22e-1d760451cd66 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:43.883531 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 487/970] 10.222.0.54 () {56 vars in 1136 bytes} [Tue Nov 23 03:55:43 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:43.885642 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5ff88-36e0-4969-9daf-ee34426dfaff admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:43.896420 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5ff88-36e0-4969-9daf-ee34426dfaff admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:43.901025 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6852ac-808d-42f3-9837-4f6ab8b60ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:43.901828 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6852ac-808d-42f3-9837-4f6ab8b60ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:43.902114 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6852ac-808d-42f3-9837-4f6ab8b60ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:43.902392 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6852ac-808d-42f3-9837-4f6ab8b60ea3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:43.914395 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6852ac-808d-42f3-9837-4f6ab8b60ea3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:43.916756 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6852ac-808d-42f3-9837-4f6ab8b60ea3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:43.938372 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-2e6852ac-808d-42f3-9837-4f6ab8b60ea3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:43.941058 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 484/971] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:43.947778 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94b2d3-43c0-48d8-b22e-1d760451cd66 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:43.958339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94b2d3-43c0-48d8-b22e-1d760451cd66 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:43.963483 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416a8ad-2f94-441d-81e6-f1d36ad131b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:43.964477 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416a8ad-2f94-441d-81e6-f1d36ad131b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:43.964994 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416a8ad-2f94-441d-81e6-f1d36ad131b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:43.965528 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416a8ad-2f94-441d-81e6-f1d36ad131b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:43.966496 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416a8ad-2f94-441d-81e6-f1d36ad131b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:43.967005 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416a8ad-2f94-441d-81e6-f1d36ad131b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:43.968834 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416a8ad-2f94-441d-81e6-f1d36ad131b2 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:43.982120 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 488/972] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:43.989145 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6852ac-808d-42f3-9837-4f6ab8b60ea3 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:43.999571 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6852ac-808d-42f3-9837-4f6ab8b60ea3 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:44.004688 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f74214-aba6-456b-9e37-ad4363e8a902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:44.005738 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f74214-aba6-456b-9e37-ad4363e8a902 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:44.006229 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f74214-aba6-456b-9e37-ad4363e8a902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:44.006724 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f74214-aba6-456b-9e37-ad4363e8a902 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:44.015432 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f74214-aba6-456b-9e37-ad4363e8a902 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:44.018487 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f74214-aba6-456b-9e37-ad4363e8a902 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:44.033799 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-25f74214-aba6-456b-9e37-ad4363e8a902 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 23 03:55:44.035150 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 485/973] 10.222.0.54 () {56 vars in 1138 bytes} [Tue Nov 23 03:55:43 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:44.041199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416a8ad-2f94-441d-81e6-f1d36ad131b2 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:44.051718 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416a8ad-2f94-441d-81e6-f1d36ad131b2 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:44.056406 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace86acf-aad0-4323-aaa2-0c5d9628e1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:44.057073 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace86acf-aad0-4323-aaa2-0c5d9628e1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:44.057358 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace86acf-aad0-4323-aaa2-0c5d9628e1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:44.057636 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace86acf-aad0-4323-aaa2-0c5d9628e1b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:44.058485 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace86acf-aad0-4323-aaa2-0c5d9628e1b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:44.058788 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace86acf-aad0-4323-aaa2-0c5d9628e1b6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:44.060655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace86acf-aad0-4323-aaa2-0c5d9628e1b6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:44.079416 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 489/974] 10.222.0.54 () {56 vars in 1170 bytes} [Tue Nov 23 03:55:44 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:44.085574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f74214-aba6-456b-9e37-ad4363e8a902 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:44.095534 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f74214-aba6-456b-9e37-ad4363e8a902 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:44.100207 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b249bd8-a55d-41d3-9dc5-bfb1404a479e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:44.100844 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b249bd8-a55d-41d3-9dc5-bfb1404a479e admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:44.101126 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b249bd8-a55d-41d3-9dc5-bfb1404a479e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:44.101406 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b249bd8-a55d-41d3-9dc5-bfb1404a479e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:44.109902 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b249bd8-a55d-41d3-9dc5-bfb1404a479e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:44.112267 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b249bd8-a55d-41d3-9dc5-bfb1404a479e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:44.121522 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 486/975] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:44 2021] GET /identity/v3/auth/tokens => generated 2138 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 03:55:44.128754 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace86acf-aad0-4323-aaa2-0c5d9628e1b6 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:44.138732 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace86acf-aad0-4323-aaa2-0c5d9628e1b6 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:44.143595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b5bd8-f90f-4bd1-a646-78d3660efdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:44.144387 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b5bd8-f90f-4bd1-a646-78d3660efdff admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:44.144669 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b5bd8-f90f-4bd1-a646-78d3660efdff admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:44.144975 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b5bd8-f90f-4bd1-a646-78d3660efdff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:44.155782 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b5bd8-f90f-4bd1-a646-78d3660efdff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:44.158500 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b5bd8-f90f-4bd1-a646-78d3660efdff admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:44.175996 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-167b5bd8-f90f-4bd1-a646-78d3660efdff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:44.177493 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 490/976] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:44.183492 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b249bd8-a55d-41d3-9dc5-bfb1404a479e admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:44.193333 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b249bd8-a55d-41d3-9dc5-bfb1404a479e admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:44.197927 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be4962-56f7-4cbd-b03c-274776595e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:44.198632 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be4962-56f7-4cbd-b03c-274776595e00 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:44.198912 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be4962-56f7-4cbd-b03c-274776595e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:44.199187 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be4962-56f7-4cbd-b03c-274776595e00 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:44.199988 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be4962-56f7-4cbd-b03c-274776595e00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:44.200294 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be4962-56f7-4cbd-b03c-274776595e00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:44.201858 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be4962-56f7-4cbd-b03c-274776595e00 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:44.215703 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 487/977] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:44.222285 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b5bd8-f90f-4bd1-a646-78d3660efdff admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:44.232250 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b5bd8-f90f-4bd1-a646-78d3660efdff admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:44.236914 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73ef4a-bc75-4bf7-a95f-1a2d07d429e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:44.237696 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73ef4a-bc75-4bf7-a95f-1a2d07d429e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:44.238025 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73ef4a-bc75-4bf7-a95f-1a2d07d429e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:44.238302 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73ef4a-bc75-4bf7-a95f-1a2d07d429e4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:44.245728 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73ef4a-bc75-4bf7-a95f-1a2d07d429e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:44.247774 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73ef4a-bc75-4bf7-a95f-1a2d07d429e4 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:44.261439 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-1c73ef4a-bc75-4bf7-a95f-1a2d07d429e4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:44.262768 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 491/978] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:44.269541 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be4962-56f7-4cbd-b03c-274776595e00 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:44.279301 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be4962-56f7-4cbd-b03c-274776595e00 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:44.283914 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f4499-8f83-45e0-8329-3f6269215b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:44.284606 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f4499-8f83-45e0-8329-3f6269215b1e admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:44.284888 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f4499-8f83-45e0-8329-3f6269215b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:44.285164 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f4499-8f83-45e0-8329-3f6269215b1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:44.285961 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f4499-8f83-45e0-8329-3f6269215b1e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:44.286271 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f4499-8f83-45e0-8329-3f6269215b1e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:44.288184 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f4499-8f83-45e0-8329-3f6269215b1e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:44.300965 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 488/979] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:44.307321 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73ef4a-bc75-4bf7-a95f-1a2d07d429e4 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:44.319037 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73ef4a-bc75-4bf7-a95f-1a2d07d429e4 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:44.323786 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56ac41-1760-4748-889b-ddef3417b8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:44.324427 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56ac41-1760-4748-889b-ddef3417b8ea admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:44.324767 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56ac41-1760-4748-889b-ddef3417b8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:44.325045 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56ac41-1760-4748-889b-ddef3417b8ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:44.325933 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56ac41-1760-4748-889b-ddef3417b8ea admin admin] RBAC: Adding query filter params (role.id=6132be24a4fd4b2898805fc917e8da2a, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=b68d0745d9cb49a5bd9331148967764a) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:44.326244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56ac41-1760-4748-889b-ddef3417b8ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:44.328149 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56ac41-1760-4748-889b-ddef3417b8ea admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:44.334941 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 492/980] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:55:44 2021] GET /identity/v3/role_assignments?user.id=b68d0745d9cb49a5bd9331148967764a&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=6132be24a4fd4b2898805fc917e8da2a => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:44.789774 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ee8aa-7ddf-4ef5-b833-d453c5e644ca None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:44.790300 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ee8aa-7ddf-4ef5-b833-d453c5e644ca None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:44.790300 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ee8aa-7ddf-4ef5-b833-d453c5e644ca None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:44.792401 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 489/981] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:44.800222 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8cb6b-576d-489a-b329-3aa8e7d73942 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:44.800756 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8cb6b-576d-489a-b329-3aa8e7d73942 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:44.800756 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8cb6b-576d-489a-b329-3aa8e7d73942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:44.818960 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-fca8cb6b-576d-489a-b329-3aa8e7d73942 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:44.820194 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-fca8cb6b-576d-489a-b329-3aa8e7d73942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:44.828241 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 493/982] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:44 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:55:44.851666 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ee8aa-7ddf-4ef5-b833-d453c5e644ca None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:44.864363 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ee8aa-7ddf-4ef5-b833-d453c5e644ca None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:44.868926 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c3a01-77e6-4af1-a766-c47d38075c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:44.869736 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c3a01-77e6-4af1-a766-c47d38075c05 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:44.870020 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c3a01-77e6-4af1-a766-c47d38075c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:44.870297 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c3a01-77e6-4af1-a766-c47d38075c05 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:44.870982 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c3a01-77e6-4af1-a766-c47d38075c05 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:44.872648 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c3a01-77e6-4af1-a766-c47d38075c05 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:44.885106 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-221c3a01-77e6-4af1-a766-c47d38075c05 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 23 03:55:44.886486 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 490/983] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:44 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:44.893007 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8cb6b-576d-489a-b329-3aa8e7d73942 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:44.902096 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8cb6b-576d-489a-b329-3aa8e7d73942 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:44.906698 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4ba4c-a2a6-4abf-aeeb-6018e5776aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:44.908249 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4ba4c-a2a6-4abf-aeeb-6018e5776aae admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:44.908569 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4ba4c-a2a6-4abf-aeeb-6018e5776aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:44.908854 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4ba4c-a2a6-4abf-aeeb-6018e5776aae admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:44.909571 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4ba4c-a2a6-4abf-aeeb-6018e5776aae admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:44.909874 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4ba4c-a2a6-4abf-aeeb-6018e5776aae admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:44.911471 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4ba4c-a2a6-4abf-aeeb-6018e5776aae admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:44.916586 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 494/984] 10.222.0.54 () {56 vars in 1133 bytes} [Tue Nov 23 03:55:44 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:44.922522 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c3a01-77e6-4af1-a766-c47d38075c05 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:44.932564 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c3a01-77e6-4af1-a766-c47d38075c05 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:44.937099 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d916e-da3b-45da-8282-a4c009b064e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:44.937745 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d916e-da3b-45da-8282-a4c009b064e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:44.938027 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d916e-da3b-45da-8282-a4c009b064e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:44.938842 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d916e-da3b-45da-8282-a4c009b064e4 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:44.939763 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d916e-da3b-45da-8282-a4c009b064e4 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:44.940068 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d916e-da3b-45da-8282-a4c009b064e4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:44.941928 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d916e-da3b-45da-8282-a4c009b064e4 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:44.946780 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 491/985] 10.222.0.54 () {56 vars in 1133 bytes} [Tue Nov 23 03:55:44 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:46.031885 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7b901-bdee-4728-9be4-031be80c2675 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:46.032634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7b901-bdee-4728-9be4-031be80c2675 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:46.032634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7b901-bdee-4728-9be4-031be80c2675 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:46.034670 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 495/986] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:46.041432 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a5035-3909-4550-9ea0-dbbbef7301da None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:46.042059 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a5035-3909-4550-9ea0-dbbbef7301da None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:46.042059 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a5035-3909-4550-9ea0-dbbbef7301da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:46.062699 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-689a5035-3909-4550-9ea0-dbbbef7301da None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:46.064503 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-689a5035-3909-4550-9ea0-dbbbef7301da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:46.072833 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 492/987] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:46 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:55:46.096801 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7b901-bdee-4728-9be4-031be80c2675 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:46.110676 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7b901-bdee-4728-9be4-031be80c2675 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:46.116458 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fcbcd-6ae5-45b6-bcd7-9f9e89aa0ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:46.117270 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fcbcd-6ae5-45b6-bcd7-9f9e89aa0ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:46.117549 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fcbcd-6ae5-45b6-bcd7-9f9e89aa0ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:46.117823 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fcbcd-6ae5-45b6-bcd7-9f9e89aa0ad6 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:46.118489 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33fcbcd-6ae5-45b6-bcd7-9f9e89aa0ad6 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:46.120110 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33fcbcd-6ae5-45b6-bcd7-9f9e89aa0ad6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:46.131857 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-b33fcbcd-6ae5-45b6-bcd7-9f9e89aa0ad6 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 23 03:55:46.133338 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 496/988] 10.222.0.54 () {56 vars in 1147 bytes} [Tue Nov 23 03:55:46 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:46.139996 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a5035-3909-4550-9ea0-dbbbef7301da None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:46.149856 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a5035-3909-4550-9ea0-dbbbef7301da None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:46.154433 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a93fea-3d5d-4365-8ae9-57b7e79e2c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:46.155102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a93fea-3d5d-4365-8ae9-57b7e79e2c1b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:46.155401 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a93fea-3d5d-4365-8ae9-57b7e79e2c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:46.155678 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a93fea-3d5d-4365-8ae9-57b7e79e2c1b admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:46.159963 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a93fea-3d5d-4365-8ae9-57b7e79e2c1b admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:46.159963 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a93fea-3d5d-4365-8ae9-57b7e79e2c1b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:46.159963 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a93fea-3d5d-4365-8ae9-57b7e79e2c1b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:46.163661 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 493/989] 10.222.0.54 () {56 vars in 1143 bytes} [Tue Nov 23 03:55:46 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:46.169913 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fcbcd-6ae5-45b6-bcd7-9f9e89aa0ad6 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:46.180272 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fcbcd-6ae5-45b6-bcd7-9f9e89aa0ad6 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:46.184835 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ede78b-a743-4cf7-8d46-2cd8c2381c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:46.185493 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ede78b-a743-4cf7-8d46-2cd8c2381c1e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:46.185774 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ede78b-a743-4cf7-8d46-2cd8c2381c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:46.186054 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ede78b-a743-4cf7-8d46-2cd8c2381c1e admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:46.186767 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ede78b-a743-4cf7-8d46-2cd8c2381c1e admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:46.187101 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ede78b-a743-4cf7-8d46-2cd8c2381c1e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:46.188770 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ede78b-a743-4cf7-8d46-2cd8c2381c1e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:46.194631 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 497/990] 10.222.0.54 () {56 vars in 1143 bytes} [Tue Nov 23 03:55:46 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:46.200884 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a93fea-3d5d-4365-8ae9-57b7e79e2c1b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:46.211769 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a93fea-3d5d-4365-8ae9-57b7e79e2c1b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:46.216377 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c7e18-540d-4355-a531-13fbfa876880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:46.217022 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c7e18-540d-4355-a531-13fbfa876880 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:46.217302 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c7e18-540d-4355-a531-13fbfa876880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:46.217576 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c7e18-540d-4355-a531-13fbfa876880 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:46.218338 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c7e18-540d-4355-a531-13fbfa876880 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:46.220180 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c7e18-540d-4355-a531-13fbfa876880 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:46.238104 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b203ca1-fcc1-4208-b10b-dcc0383df8d3 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:46.238391 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b203ca1-fcc1-4208-b10b-dcc0383df8d3 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:46.238733 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b203ca1-fcc1-4208-b10b-dcc0383df8d3 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:46.240602 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 498/991] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 03:55:46.246640 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0714f2-bc2c-47a8-8517-769d0428d9cb None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:46.247005 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0714f2-bc2c-47a8-8517-769d0428d9cb None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:46.247408 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0714f2-bc2c-47a8-8517-769d0428d9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:46.267247 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-2a0714f2-bc2c-47a8-8517-769d0428d9cb None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:46.268480 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-2a0714f2-bc2c-47a8-8517-769d0428d9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:46.276784 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 499/992] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:46 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:55:46.301584 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0714f2-bc2c-47a8-8517-769d0428d9cb None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:46.311860 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0714f2-bc2c-47a8-8517-769d0428d9cb None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:46.318322 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9329ce-8764-4dd1-a03f-b3e1839cfe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:46.318977 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9329ce-8764-4dd1-a03f-b3e1839cfe20 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:46.319290 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9329ce-8764-4dd1-a03f-b3e1839cfe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:46.319565 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9329ce-8764-4dd1-a03f-b3e1839cfe20 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:46.320282 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9329ce-8764-4dd1-a03f-b3e1839cfe20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:46.322230 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9329ce-8764-4dd1-a03f-b3e1839cfe20 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:46.323613 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.common [None req-ae9329ce-8764-4dd1-a03f-b3e1839cfe20 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 23 03:55:46.325609 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 494/993] 10.222.0.54 () {60 vars in 1165 bytes} [Tue Nov 23 03:55:46 2021] POST /identity/v3/endpoints => generated 349 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:55:46.385067 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.sql.core [None req-ae9329ce-8764-4dd1-a03f-b3e1839cfe20 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 23 03:55:46.385067 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 23 03:55:46.385067 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [parameters: {'id': 'c7b6afb2f66b4200a0fa3959c7e38ec5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 23 03:55:46.385067 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79251) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 23 03:55:46.393164 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-ae9329ce-8764-4dd1-a03f-b3e1839cfe20 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c7b6afb2f66b4200a0fa3959c7e38ec5.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c7b6afb2f66b4200a0fa3959c7e38ec5. Nov 23 03:55:46.395474 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 500/994] 10.222.0.54 () {60 vars in 1161 bytes} [Tue Nov 23 03:55:46 2021] POST /identity/v3/projects => generated 262 bytes in 94 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:55:46.401474 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c7e18-540d-4355-a531-13fbfa876880 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:46.424788 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c7e18-540d-4355-a531-13fbfa876880 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:46.429482 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4dabb-47d6-4f2d-94c2-87661a678546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:46.430281 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4dabb-47d6-4f2d-94c2-87661a678546 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:46.430563 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4dabb-47d6-4f2d-94c2-87661a678546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:46.430838 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4dabb-47d6-4f2d-94c2-87661a678546 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:46.438522 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4dabb-47d6-4f2d-94c2-87661a678546 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:46.440924 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4dabb-47d6-4f2d-94c2-87661a678546 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:46.456745 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-2bd4dabb-47d6-4f2d-94c2-87661a678546 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:46.458398 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 495/995] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:46.466461 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9329ce-8764-4dd1-a03f-b3e1839cfe20 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:46.480823 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9329ce-8764-4dd1-a03f-b3e1839cfe20 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:46.486745 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe261501-4963-4c6e-896b-9cbd1b8206c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:46.487510 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe261501-4963-4c6e-896b-9cbd1b8206c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:46.487793 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe261501-4963-4c6e-896b-9cbd1b8206c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:46.488119 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe261501-4963-4c6e-896b-9cbd1b8206c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:46.488966 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe261501-4963-4c6e-896b-9cbd1b8206c3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:46.489273 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe261501-4963-4c6e-896b-9cbd1b8206c3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:46.491624 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe261501-4963-4c6e-896b-9cbd1b8206c3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:46.515060 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 501/996] 10.222.0.54 () {56 vars in 1133 bytes} [Tue Nov 23 03:55:46 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:46.655923 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4840d-f9a4-4954-afce-eac96e96794c None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:46.656115 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4840d-f9a4-4954-afce-eac96e96794c None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:46.656381 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4840d-f9a4-4954-afce-eac96e96794c None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:46.658850 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 496/997] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:46.665074 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0c277-76ec-4b9b-9e46-475dea80cbd0 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:46.665359 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0c277-76ec-4b9b-9e46-475dea80cbd0 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:46.665634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0c277-76ec-4b9b-9e46-475dea80cbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:46.685591 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-dcc0c277-76ec-4b9b-9e46-475dea80cbd0 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:46.687554 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-dcc0c277-76ec-4b9b-9e46-475dea80cbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:46.703377 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 502/998] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:46 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:55:46.721945 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4840d-f9a4-4954-afce-eac96e96794c None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:46.737096 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4840d-f9a4-4954-afce-eac96e96794c None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:46.742725 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4d5d7-f1fc-46ea-b8e0-25443fa14bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:46.743821 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4d5d7-f1fc-46ea-b8e0-25443fa14bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:46.744341 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4d5d7-f1fc-46ea-b8e0-25443fa14bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:46.744826 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4d5d7-f1fc-46ea-b8e0-25443fa14bf3 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:46.745633 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4d5d7-f1fc-46ea-b8e0-25443fa14bf3 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:46.747477 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4d5d7-f1fc-46ea-b8e0-25443fa14bf3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:46.759488 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-fce4d5d7-f1fc-46ea-b8e0-25443fa14bf3 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 23 03:55:46.765657 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 497/999] 10.222.0.54 () {56 vars in 1126 bytes} [Tue Nov 23 03:55:46 2021] GET /identity/v3/services/image => generated 86 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:46.768004 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0c277-76ec-4b9b-9e46-475dea80cbd0 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:46.777141 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0c277-76ec-4b9b-9e46-475dea80cbd0 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:46.783785 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c7ea9-c921-478c-bd6b-289299939fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:46.784636 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c7ea9-c921-478c-bd6b-289299939fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:46.784959 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c7ea9-c921-478c-bd6b-289299939fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:46.785354 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c7ea9-c921-478c-bd6b-289299939fa7 admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:46.786180 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c7ea9-c921-478c-bd6b-289299939fa7 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:46.790630 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c7ea9-c921-478c-bd6b-289299939fa7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:46.792392 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c7ea9-c921-478c-bd6b-289299939fa7 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:46.798743 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 503/1000] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:46 2021] GET /identity/v3/services?name=image => generated 122 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:46.805428 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4d5d7-f1fc-46ea-b8e0-25443fa14bf3 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:46.817045 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4d5d7-f1fc-46ea-b8e0-25443fa14bf3 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:46.822364 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceaabf3-b0d4-44c9-bef4-94f8fe82623d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:46.823022 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceaabf3-b0d4-44c9-bef4-94f8fe82623d admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:46.823381 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceaabf3-b0d4-44c9-bef4-94f8fe82623d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:46.823656 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceaabf3-b0d4-44c9-bef4-94f8fe82623d admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:46.824366 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceaabf3-b0d4-44c9-bef4-94f8fe82623d admin admin] RBAC: Adding query filter params (type=image) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:46.824667 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceaabf3-b0d4-44c9-bef4-94f8fe82623d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:46.826230 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceaabf3-b0d4-44c9-bef4-94f8fe82623d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:46.831831 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 498/1001] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:46 2021] GET /identity/v3/services?type=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:47.271000 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045141e7-0ef6-4797-9b56-e99a517dcb05 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:47.271534 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045141e7-0ef6-4797-9b56-e99a517dcb05 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:47.271612 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045141e7-0ef6-4797-9b56-e99a517dcb05 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:47.273607 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 504/1002] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:47.279458 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a740cd6-4b75-4cda-8627-7fcdafaa7853 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:47.279854 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a740cd6-4b75-4cda-8627-7fcdafaa7853 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:47.280018 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a740cd6-4b75-4cda-8627-7fcdafaa7853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:47.299530 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-6a740cd6-4b75-4cda-8627-7fcdafaa7853 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:47.300722 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-6a740cd6-4b75-4cda-8627-7fcdafaa7853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:47.308684 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 499/1003] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:47 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:47.332579 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045141e7-0ef6-4797-9b56-e99a517dcb05 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:47.347243 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045141e7-0ef6-4797-9b56-e99a517dcb05 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:47.351674 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de0170-7555-44a9-b0cb-efcb88465f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:47.352325 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de0170-7555-44a9-b0cb-efcb88465f26 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:47.352604 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de0170-7555-44a9-b0cb-efcb88465f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:47.352877 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de0170-7555-44a9-b0cb-efcb88465f26 admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:47.353676 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de0170-7555-44a9-b0cb-efcb88465f26 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:47.355330 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de0170-7555-44a9-b0cb-efcb88465f26 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:47.437152 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 505/1004] 10.222.0.54 () {60 vars in 1162 bytes} [Tue Nov 23 03:55:47 2021] POST /identity/v3/services => generated 242 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:55:48.682966 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71114d62-42dc-41dc-bfb0-fb73dc53936b None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:48.683540 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71114d62-42dc-41dc-bfb0-fb73dc53936b None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:48.683698 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71114d62-42dc-41dc-bfb0-fb73dc53936b None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:48.685585 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 500/1005] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:48.692422 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75e584-9032-41f6-9ed1-28007fc88135 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:48.692846 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75e584-9032-41f6-9ed1-28007fc88135 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:48.692981 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75e584-9032-41f6-9ed1-28007fc88135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:48.711263 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-8c75e584-9032-41f6-9ed1-28007fc88135 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:48.712446 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-8c75e584-9032-41f6-9ed1-28007fc88135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:48.730731 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 506/1006] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:48 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:48.755437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71114d62-42dc-41dc-bfb0-fb73dc53936b None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:48.768383 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71114d62-42dc-41dc-bfb0-fb73dc53936b None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:48.773158 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062a0c6-3a73-4476-8ffb-715a40fe2d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:48.773984 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062a0c6-3a73-4476-8ffb-715a40fe2d1b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:48.774268 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062a0c6-3a73-4476-8ffb-715a40fe2d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:48.774547 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062a0c6-3a73-4476-8ffb-715a40fe2d1b admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:48.775284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062a0c6-3a73-4476-8ffb-715a40fe2d1b admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:48.776935 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062a0c6-3a73-4476-8ffb-715a40fe2d1b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:48.789976 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-e062a0c6-3a73-4476-8ffb-715a40fe2d1b admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 23 03:55:48.791591 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 501/1007] 10.222.0.54 () {56 vars in 1147 bytes} [Tue Nov 23 03:55:48 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:48.798536 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75e584-9032-41f6-9ed1-28007fc88135 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:48.807720 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75e584-9032-41f6-9ed1-28007fc88135 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:48.812391 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a4826-262f-4c0e-9667-2077cd6335f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:48.813692 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a4826-262f-4c0e-9667-2077cd6335f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:48.814078 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a4826-262f-4c0e-9667-2077cd6335f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:48.814360 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a4826-262f-4c0e-9667-2077cd6335f2 admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:48.815094 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a4826-262f-4c0e-9667-2077cd6335f2 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:48.815437 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a4826-262f-4c0e-9667-2077cd6335f2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:48.817278 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a4826-262f-4c0e-9667-2077cd6335f2 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:48.822589 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 507/1008] 10.222.0.54 () {56 vars in 1143 bytes} [Tue Nov 23 03:55:48 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:48.828896 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062a0c6-3a73-4476-8ffb-715a40fe2d1b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:48.838657 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062a0c6-3a73-4476-8ffb-715a40fe2d1b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:48.843240 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cce93-3930-4a31-bbc2-cf3089e7279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:48.843919 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cce93-3930-4a31-bbc2-cf3089e7279d admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:48.844763 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cce93-3930-4a31-bbc2-cf3089e7279d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:48.845060 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cce93-3930-4a31-bbc2-cf3089e7279d admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:48.845793 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5cce93-3930-4a31-bbc2-cf3089e7279d admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:48.846097 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5cce93-3930-4a31-bbc2-cf3089e7279d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:48.847715 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5cce93-3930-4a31-bbc2-cf3089e7279d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:48.853203 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 502/1009] 10.222.0.54 () {56 vars in 1143 bytes} [Tue Nov 23 03:55:48 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:48.859433 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a4826-262f-4c0e-9667-2077cd6335f2 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:48.869402 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a4826-262f-4c0e-9667-2077cd6335f2 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:48.874092 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b6be4-ae08-4e45-b10e-8bc9ebcd4ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:48.874739 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b6be4-ae08-4e45-b10e-8bc9ebcd4ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:48.875022 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b6be4-ae08-4e45-b10e-8bc9ebcd4ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:48.875350 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b6be4-ae08-4e45-b10e-8bc9ebcd4ed8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:48.876750 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b6be4-ae08-4e45-b10e-8bc9ebcd4ed8 admin admin] RBAC: Adding query filter params (interface=admin, service_id=aac561652ea74ae8a7c5815be0ad18bf, region_id=RegionOne) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:48.877112 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b6be4-ae08-4e45-b10e-8bc9ebcd4ed8 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:48.878699 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b6be4-ae08-4e45-b10e-8bc9ebcd4ed8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:48.884273 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 508/1010] 10.222.0.54 () {56 vars in 1270 bytes} [Tue Nov 23 03:55:48 2021] GET /identity/v3/endpoints?service_id=aac561652ea74ae8a7c5815be0ad18bf&interface=admin®ion_id=RegionOne => generated 193 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:48.890407 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cce93-3930-4a31-bbc2-cf3089e7279d admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:48.900955 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cce93-3930-4a31-bbc2-cf3089e7279d admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:48.905529 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb7f80-9f77-4a62-98c3-72a5dfea4ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:48.906180 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb7f80-9f77-4a62-98c3-72a5dfea4ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:48.906464 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb7f80-9f77-4a62-98c3-72a5dfea4ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:48.906787 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb7f80-9f77-4a62-98c3-72a5dfea4ed7 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:48.907521 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb7f80-9f77-4a62-98c3-72a5dfea4ed7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:48.909081 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb7f80-9f77-4a62-98c3-72a5dfea4ed7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:48.915790 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 503/1011] 10.222.0.54 () {56 vars in 1108 bytes} [Tue Nov 23 03:55:48 2021] GET /identity/v3/services => generated 1727 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 03:55:48.961549 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0bd42-286e-4664-86a0-242e7442107b None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:48.961732 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0bd42-286e-4664-86a0-242e7442107b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:48.962025 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0bd42-286e-4664-86a0-242e7442107b None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:48.964250 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 509/1012] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:48.975906 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a4d18-2e02-4b6c-bd0f-175f46c8ecaa None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:48.976695 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a4d18-2e02-4b6c-bd0f-175f46c8ecaa None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:48.977282 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a4d18-2e02-4b6c-bd0f-175f46c8ecaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:48.997391 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-9b7a4d18-2e02-4b6c-bd0f-175f46c8ecaa None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:48.998944 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-9b7a4d18-2e02-4b6c-bd0f-175f46c8ecaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:49.008349 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 504/1013] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:48 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:49.034393 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0bd42-286e-4664-86a0-242e7442107b None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:49.047869 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0bd42-286e-4664-86a0-242e7442107b None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:49.052756 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36510fb-0429-459f-bf7a-6842b4942395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:49.053437 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36510fb-0429-459f-bf7a-6842b4942395 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:49.053779 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36510fb-0429-459f-bf7a-6842b4942395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:49.054064 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36510fb-0429-459f-bf7a-6842b4942395 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:49.054823 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36510fb-0429-459f-bf7a-6842b4942395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:49.056723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36510fb-0429-459f-bf7a-6842b4942395 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:49.134144 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.sql.core [None req-e36510fb-0429-459f-bf7a-6842b4942395 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 23 03:55:49.134144 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 23 03:55:49.134144 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [parameters: {'user_id': 'ba27a54f09244cb191a4c3e08e40bde5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 23 03:55:49.134144 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79251) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 23 03:55:49.139202 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-e36510fb-0429-459f-bf7a-6842b4942395 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 23 03:55:49.142693 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 510/1014] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 03:55:49 2021] POST /identity/v3/users => generated 160 bytes in 107 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:49.143233 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c879-3f49-45e3-bbd8-efb9ba938d96 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:49.143524 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c879-3f49-45e3-bbd8-efb9ba938d96 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:49.143857 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c879-3f49-45e3-bbd8-efb9ba938d96 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:49.146369 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 505/1015] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:49 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:49.149476 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36510fb-0429-459f-bf7a-6842b4942395 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:49.152719 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460209b-c1d2-40e8-afba-b60eb553d39c None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:49.153014 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460209b-c1d2-40e8-afba-b60eb553d39c None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:49.153290 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460209b-c1d2-40e8-afba-b60eb553d39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:49.162900 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36510fb-0429-459f-bf7a-6842b4942395 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:49.170202 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99e21b-ae90-4446-9cc6-e361aaa0ffc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:49.171098 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99e21b-ae90-4446-9cc6-e361aaa0ffc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:49.171434 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99e21b-ae90-4446-9cc6-e361aaa0ffc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:49.171634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99e21b-ae90-4446-9cc6-e361aaa0ffc4 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:49.175246 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-2460209b-c1d2-40e8-afba-b60eb553d39c None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:49.180407 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-2460209b-c1d2-40e8-afba-b60eb553d39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:49.180527 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99e21b-ae90-4446-9cc6-e361aaa0ffc4 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:49.182269 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99e21b-ae90-4446-9cc6-e361aaa0ffc4 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:49.185584 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 506/1016] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:49 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:49.197858 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-cb99e21b-ae90-4446-9cc6-e361aaa0ffc4 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 23 03:55:49.199303 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 511/1017] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:55:49 2021] GET /identity/v3/users/cinder => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:49.207147 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460209b-c1d2-40e8-afba-b60eb553d39c None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:49.212563 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99e21b-ae90-4446-9cc6-e361aaa0ffc4 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:49.217097 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460209b-c1d2-40e8-afba-b60eb553d39c None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:49.222648 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25439ef2-33df-4388-ab3d-302c129c0de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:49.223729 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25439ef2-33df-4388-ab3d-302c129c0de0 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:49.224182 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99e21b-ae90-4446-9cc6-e361aaa0ffc4 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:49.224393 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25439ef2-33df-4388-ab3d-302c129c0de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:49.224818 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25439ef2-33df-4388-ab3d-302c129c0de0 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:49.225797 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25439ef2-33df-4388-ab3d-302c129c0de0 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:49.226254 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25439ef2-33df-4388-ab3d-302c129c0de0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:49.228317 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25439ef2-33df-4388-ab3d-302c129c0de0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:49.228896 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1061f-154b-4735-9d67-1c85ce16ff7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:49.229582 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1061f-154b-4735-9d67-1c85ce16ff7b admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:49.229863 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1061f-154b-4735-9d67-1c85ce16ff7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:49.230194 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1061f-154b-4735-9d67-1c85ce16ff7b admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:49.231287 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1061f-154b-4735-9d67-1c85ce16ff7b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:49.233052 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1061f-154b-4735-9d67-1c85ce16ff7b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:49.266793 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 507/1018] 10.222.0.54 () {56 vars in 1122 bytes} [Tue Nov 23 03:55:49 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:49.357394 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 512/1019] 10.222.0.54 () {60 vars in 1162 bytes} [Tue Nov 23 03:55:49 2021] POST /identity/v3/services => generated 242 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:55:49.796055 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930d8fb-c9f4-49d1-b45c-5ecc859c12e6 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:49.796595 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930d8fb-c9f4-49d1-b45c-5ecc859c12e6 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:49.796595 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930d8fb-c9f4-49d1-b45c-5ecc859c12e6 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:49.799025 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 508/1020] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:49.804709 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d698a1-a5ab-466b-98e2-2269582fb598 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:49.805106 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d698a1-a5ab-466b-98e2-2269582fb598 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:49.805287 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d698a1-a5ab-466b-98e2-2269582fb598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:49.823778 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-09d698a1-a5ab-466b-98e2-2269582fb598 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:49.825279 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-09d698a1-a5ab-466b-98e2-2269582fb598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:49.841926 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 513/1021] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:49 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:49.865631 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930d8fb-c9f4-49d1-b45c-5ecc859c12e6 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:49.878159 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930d8fb-c9f4-49d1-b45c-5ecc859c12e6 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:49.882567 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da889d85-f0ed-4aa4-83b9-07adfebea130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:49.883362 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da889d85-f0ed-4aa4-83b9-07adfebea130 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:49.883642 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da889d85-f0ed-4aa4-83b9-07adfebea130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:49.883912 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da889d85-f0ed-4aa4-83b9-07adfebea130 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:49.884572 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da889d85-f0ed-4aa4-83b9-07adfebea130 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:49.886148 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da889d85-f0ed-4aa4-83b9-07adfebea130 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:49.897073 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-da889d85-f0ed-4aa4-83b9-07adfebea130 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 23 03:55:49.898279 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 509/1022] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:49 2021] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:49.904463 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d698a1-a5ab-466b-98e2-2269582fb598 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:49.915960 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d698a1-a5ab-466b-98e2-2269582fb598 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:49.920497 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46595f1e-9767-45d6-a14b-3004810111af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:49.921151 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46595f1e-9767-45d6-a14b-3004810111af admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:49.921433 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46595f1e-9767-45d6-a14b-3004810111af admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:49.921706 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46595f1e-9767-45d6-a14b-3004810111af admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:49.923057 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46595f1e-9767-45d6-a14b-3004810111af admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:49.923396 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46595f1e-9767-45d6-a14b-3004810111af admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:49.924955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46595f1e-9767-45d6-a14b-3004810111af admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:49.930083 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 514/1023] 10.222.0.54 () {56 vars in 1133 bytes} [Tue Nov 23 03:55:49 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:49.935939 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da889d85-f0ed-4aa4-83b9-07adfebea130 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:49.946461 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da889d85-f0ed-4aa4-83b9-07adfebea130 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:49.950911 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f294c9-a3cc-4ce4-aa98-2d3acd592e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:49.951550 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f294c9-a3cc-4ce4-aa98-2d3acd592e41 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:49.951826 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f294c9-a3cc-4ce4-aa98-2d3acd592e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:49.952096 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f294c9-a3cc-4ce4-aa98-2d3acd592e41 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:49.952798 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f294c9-a3cc-4ce4-aa98-2d3acd592e41 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:49.953101 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f294c9-a3cc-4ce4-aa98-2d3acd592e41 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:49.955461 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f294c9-a3cc-4ce4-aa98-2d3acd592e41 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:49.960256 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 510/1024] 10.222.0.54 () {56 vars in 1133 bytes} [Tue Nov 23 03:55:49 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:49.966633 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46595f1e-9767-45d6-a14b-3004810111af admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:49.976958 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46595f1e-9767-45d6-a14b-3004810111af admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:49.981483 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b495d86-ba2a-4b76-9ea8-c37c1b21ffd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:49.982212 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b495d86-ba2a-4b76-9ea8-c37c1b21ffd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:49.982559 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b495d86-ba2a-4b76-9ea8-c37c1b21ffd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:49.982904 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b495d86-ba2a-4b76-9ea8-c37c1b21ffd5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:49.983844 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b495d86-ba2a-4b76-9ea8-c37c1b21ffd5 admin admin] RBAC: Adding query filter params (interface=public, service_id=4d88cf8a915145b090425f66dac7d485, region_id=RegionOne) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:49.984182 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b495d86-ba2a-4b76-9ea8-c37c1b21ffd5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:49.985935 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b495d86-ba2a-4b76-9ea8-c37c1b21ffd5 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:49.991106 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 515/1025] 10.222.0.54 () {56 vars in 1272 bytes} [Tue Nov 23 03:55:49 2021] GET /identity/v3/endpoints?service_id=4d88cf8a915145b090425f66dac7d485&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:49.996804 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f294c9-a3cc-4ce4-aa98-2d3acd592e41 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:50.006405 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f294c9-a3cc-4ce4-aa98-2d3acd592e41 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:50.010889 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674a184-901c-4088-8dcb-fabff64a8c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:50.011568 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674a184-901c-4088-8dcb-fabff64a8c6d admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:50.011854 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674a184-901c-4088-8dcb-fabff64a8c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:50.012130 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674a184-901c-4088-8dcb-fabff64a8c6d admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:50.012821 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674a184-901c-4088-8dcb-fabff64a8c6d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:50.014533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674a184-901c-4088-8dcb-fabff64a8c6d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:50.021872 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 511/1026] 10.222.0.54 () {56 vars in 1108 bytes} [Tue Nov 23 03:55:49 2021] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 03:55:51.250302 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbbef4-ebdc-42f0-b9a3-3ccd3bfc38cf None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:51.250858 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbbef4-ebdc-42f0-b9a3-3ccd3bfc38cf None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:51.251150 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbbef4-ebdc-42f0-b9a3-3ccd3bfc38cf None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:51.253134 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 516/1027] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:51.258773 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b10ed-ebd1-49c6-b157-ac1619713d51 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:51.259185 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b10ed-ebd1-49c6-b157-ac1619713d51 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:51.259403 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b10ed-ebd1-49c6-b157-ac1619713d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:51.277349 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-714b10ed-ebd1-49c6-b157-ac1619713d51 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:51.278529 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-714b10ed-ebd1-49c6-b157-ac1619713d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:51.286449 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 512/1028] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:51 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:51.309956 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbbef4-ebdc-42f0-b9a3-3ccd3bfc38cf None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:51.322223 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbbef4-ebdc-42f0-b9a3-3ccd3bfc38cf None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:51.326437 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab7d95-dbc6-4546-8b40-efffb54a431f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:51.327232 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab7d95-dbc6-4546-8b40-efffb54a431f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:51.327556 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab7d95-dbc6-4546-8b40-efffb54a431f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:51.327827 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab7d95-dbc6-4546-8b40-efffb54a431f admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:51.329035 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab7d95-dbc6-4546-8b40-efffb54a431f admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:51.330712 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab7d95-dbc6-4546-8b40-efffb54a431f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:51.341872 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-60ab7d95-dbc6-4546-8b40-efffb54a431f admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 23 03:55:51.343270 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 517/1029] 10.222.0.54 () {56 vars in 1147 bytes} [Tue Nov 23 03:55:51 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:51.349721 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b10ed-ebd1-49c6-b157-ac1619713d51 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:51.358939 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b10ed-ebd1-49c6-b157-ac1619713d51 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:51.364417 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06328fa5-4f06-43c5-96ff-4362c0285bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:51.365141 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06328fa5-4f06-43c5-96ff-4362c0285bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:51.365496 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06328fa5-4f06-43c5-96ff-4362c0285bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:51.365844 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06328fa5-4f06-43c5-96ff-4362c0285bf1 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:51.366637 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06328fa5-4f06-43c5-96ff-4362c0285bf1 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:51.367060 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06328fa5-4f06-43c5-96ff-4362c0285bf1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:51.368746 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06328fa5-4f06-43c5-96ff-4362c0285bf1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:51.373673 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 513/1030] 10.222.0.54 () {56 vars in 1143 bytes} [Tue Nov 23 03:55:51 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:51.380588 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab7d95-dbc6-4546-8b40-efffb54a431f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:51.390094 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab7d95-dbc6-4546-8b40-efffb54a431f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:51.394955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766cf63-5634-4a22-b6fb-a8b85e002d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:51.395634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766cf63-5634-4a22-b6fb-a8b85e002d25 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:51.395914 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766cf63-5634-4a22-b6fb-a8b85e002d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:51.396185 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766cf63-5634-4a22-b6fb-a8b85e002d25 admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:51.396893 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766cf63-5634-4a22-b6fb-a8b85e002d25 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:51.397193 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766cf63-5634-4a22-b6fb-a8b85e002d25 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:51.398747 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766cf63-5634-4a22-b6fb-a8b85e002d25 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:51.403933 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 518/1031] 10.222.0.54 () {56 vars in 1143 bytes} [Tue Nov 23 03:55:51 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:51.409998 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06328fa5-4f06-43c5-96ff-4362c0285bf1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:51.419821 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06328fa5-4f06-43c5-96ff-4362c0285bf1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:51.424766 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131e94f-56f1-4f76-aff4-090d0944edb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:51.425406 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131e94f-56f1-4f76-aff4-090d0944edb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:51.425754 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131e94f-56f1-4f76-aff4-090d0944edb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:51.426029 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131e94f-56f1-4f76-aff4-090d0944edb8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:51.426955 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131e94f-56f1-4f76-aff4-090d0944edb8 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:51.428581 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131e94f-56f1-4f76-aff4-090d0944edb8 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:51.511404 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 514/1032] 10.222.0.54 () {60 vars in 1165 bytes} [Tue Nov 23 03:55:51 2021] POST /identity/v3/endpoints => generated 325 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:55:51.679361 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb125b83-77f2-4bb1-968a-fd58da24557d None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:51.679645 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb125b83-77f2-4bb1-968a-fd58da24557d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:51.679924 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb125b83-77f2-4bb1-968a-fd58da24557d None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:51.681940 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 519/1033] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:51.688537 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1b5ad-552d-4d96-b6f0-9b74edc5dcda None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:51.688922 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1b5ad-552d-4d96-b6f0-9b74edc5dcda None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:51.689206 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1b5ad-552d-4d96-b6f0-9b74edc5dcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:51.708354 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-2ac1b5ad-552d-4d96-b6f0-9b74edc5dcda None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:51.709778 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-2ac1b5ad-552d-4d96-b6f0-9b74edc5dcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:51.729109 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 515/1034] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:51 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:51.753041 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb125b83-77f2-4bb1-968a-fd58da24557d None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:51.765365 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb125b83-77f2-4bb1-968a-fd58da24557d None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:51.770544 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d5c57-af24-496d-a619-d94321e9dacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:51.771423 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d5c57-af24-496d-a619-d94321e9dacf admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:51.771708 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d5c57-af24-496d-a619-d94321e9dacf admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:51.771981 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d5c57-af24-496d-a619-d94321e9dacf admin admin] PATH_INFO: `/v3/services/image` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:51.772650 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d5c57-af24-496d-a619-d94321e9dacf admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:51.774211 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d5c57-af24-496d-a619-d94321e9dacf admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:51.785195 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-292d5c57-af24-496d-a619-d94321e9dacf admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 23 03:55:51.786555 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 520/1035] 10.222.0.54 () {56 vars in 1126 bytes} [Tue Nov 23 03:55:51 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:51.792763 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1b5ad-552d-4d96-b6f0-9b74edc5dcda None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:51.802142 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1b5ad-552d-4d96-b6f0-9b74edc5dcda None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:51.806672 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1ded1-a049-4f27-b2f8-96bc9f860a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:51.807439 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1ded1-a049-4f27-b2f8-96bc9f860a4a admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:51.807797 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1ded1-a049-4f27-b2f8-96bc9f860a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:51.808145 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1ded1-a049-4f27-b2f8-96bc9f860a4a admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:51.808870 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1ded1-a049-4f27-b2f8-96bc9f860a4a admin admin] RBAC: Adding query filter params (name=image) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:51.809178 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1ded1-a049-4f27-b2f8-96bc9f860a4a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:51.810746 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1ded1-a049-4f27-b2f8-96bc9f860a4a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:51.819241 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 516/1036] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:51 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:51.822976 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d5c57-af24-496d-a619-d94321e9dacf admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:51.833248 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d5c57-af24-496d-a619-d94321e9dacf admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:51.837834 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb786c3c-62f2-4826-9c71-66e22b6d95f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:51.838552 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb786c3c-62f2-4826-9c71-66e22b6d95f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:51.838905 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb786c3c-62f2-4826-9c71-66e22b6d95f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:51.839187 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb786c3c-62f2-4826-9c71-66e22b6d95f2 admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:51.839923 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb786c3c-62f2-4826-9c71-66e22b6d95f2 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:51.840235 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb786c3c-62f2-4826-9c71-66e22b6d95f2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:51.841790 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb786c3c-62f2-4826-9c71-66e22b6d95f2 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:51.847507 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 521/1037] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:51 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:51.853585 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1ded1-a049-4f27-b2f8-96bc9f860a4a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:51.864051 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1ded1-a049-4f27-b2f8-96bc9f860a4a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:51.868449 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3470c-3969-49ec-81c8-adcb526abbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:51.869088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3470c-3969-49ec-81c8-adcb526abbfb admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:51.869371 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3470c-3969-49ec-81c8-adcb526abbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:51.869644 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3470c-3969-49ec-81c8-adcb526abbfb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:51.870436 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3470c-3969-49ec-81c8-adcb526abbfb admin admin] RBAC: Adding query filter params (interface=public, service_id=ac51c0d4f2954689b28e1a689189e595, region_id=RegionOne) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:51.870744 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3470c-3969-49ec-81c8-adcb526abbfb admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:51.872346 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3470c-3969-49ec-81c8-adcb526abbfb admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:51.877804 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 517/1038] 10.222.0.54 () {56 vars in 1272 bytes} [Tue Nov 23 03:55:51 2021] GET /identity/v3/endpoints?service_id=ac51c0d4f2954689b28e1a689189e595&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:51.883654 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb786c3c-62f2-4826-9c71-66e22b6d95f2 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:51.893428 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb786c3c-62f2-4826-9c71-66e22b6d95f2 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:51.897845 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227388e-237c-427d-9127-d61017f5099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:51.898487 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227388e-237c-427d-9127-d61017f5099a admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:51.898771 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227388e-237c-427d-9127-d61017f5099a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:51.899043 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227388e-237c-427d-9127-d61017f5099a admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:51.899773 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227388e-237c-427d-9127-d61017f5099a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:51.901335 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227388e-237c-427d-9127-d61017f5099a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:51.908693 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 522/1039] 10.222.0.54 () {56 vars in 1108 bytes} [Tue Nov 23 03:55:51 2021] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 03:55:52.324821 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84156789-a49e-463e-81a2-01e21b0bfa95 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:52.325367 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84156789-a49e-463e-81a2-01e21b0bfa95 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:52.325367 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84156789-a49e-463e-81a2-01e21b0bfa95 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:52.327145 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 518/1040] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:52.334009 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ea179-f66d-49c8-b189-a41617f81bf0 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:52.334433 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ea179-f66d-49c8-b189-a41617f81bf0 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:52.334619 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ea179-f66d-49c8-b189-a41617f81bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:52.352731 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-db2ea179-f66d-49c8-b189-a41617f81bf0 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:52.354339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-db2ea179-f66d-49c8-b189-a41617f81bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:52.362352 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 523/1041] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:52 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:55:52.386865 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84156789-a49e-463e-81a2-01e21b0bfa95 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:52.399529 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84156789-a49e-463e-81a2-01e21b0bfa95 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:52.403956 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877b2fa-2a7d-434e-9a67-d3137b258c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:52.404733 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877b2fa-2a7d-434e-9a67-d3137b258c77 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:52.405016 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877b2fa-2a7d-434e-9a67-d3137b258c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:52.405288 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877b2fa-2a7d-434e-9a67-d3137b258c77 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:52.405996 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877b2fa-2a7d-434e-9a67-d3137b258c77 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:52.410146 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877b2fa-2a7d-434e-9a67-d3137b258c77 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:52.418917 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-c877b2fa-2a7d-434e-9a67-d3137b258c77 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 23 03:55:52.420107 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 519/1042] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:52 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:52.426780 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ea179-f66d-49c8-b189-a41617f81bf0 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:52.435745 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ea179-f66d-49c8-b189-a41617f81bf0 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:52.441127 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fd6e5-1039-45fe-b1c0-3b2f8c58ab60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:52.441776 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd6e5-1039-45fe-b1c0-3b2f8c58ab60 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:52.442063 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd6e5-1039-45fe-b1c0-3b2f8c58ab60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:52.442338 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd6e5-1039-45fe-b1c0-3b2f8c58ab60 admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:52.443055 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fd6e5-1039-45fe-b1c0-3b2f8c58ab60 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:52.443395 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fd6e5-1039-45fe-b1c0-3b2f8c58ab60 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:52.444970 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fd6e5-1039-45fe-b1c0-3b2f8c58ab60 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:52.449925 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 524/1043] 10.222.0.54 () {56 vars in 1133 bytes} [Tue Nov 23 03:55:52 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:52.456547 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877b2fa-2a7d-434e-9a67-d3137b258c77 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:52.467144 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877b2fa-2a7d-434e-9a67-d3137b258c77 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:52.473260 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edbe25-febf-46d4-9521-317441f75690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:52.474058 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edbe25-febf-46d4-9521-317441f75690 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:52.474342 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edbe25-febf-46d4-9521-317441f75690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:52.474622 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edbe25-febf-46d4-9521-317441f75690 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:52.475367 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8edbe25-febf-46d4-9521-317441f75690 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:52.485542 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8edbe25-febf-46d4-9521-317441f75690 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:52.485542 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8edbe25-febf-46d4-9521-317441f75690 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:52.485542 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 520/1044] 10.222.0.54 () {56 vars in 1133 bytes} [Tue Nov 23 03:55:52 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:52.489324 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fd6e5-1039-45fe-b1c0-3b2f8c58ab60 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:52.498716 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fd6e5-1039-45fe-b1c0-3b2f8c58ab60 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:52.503338 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f94682-7ae7-4378-9301-74ef3f769f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:52.503976 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f94682-7ae7-4378-9301-74ef3f769f51 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:52.504258 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f94682-7ae7-4378-9301-74ef3f769f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:52.504530 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f94682-7ae7-4378-9301-74ef3f769f51 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:52.505275 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f94682-7ae7-4378-9301-74ef3f769f51 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:52.506821 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f94682-7ae7-4378-9301-74ef3f769f51 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:52.575007 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 525/1045] 10.222.0.54 () {60 vars in 1165 bytes} [Tue Nov 23 03:55:52 2021] POST /identity/v3/endpoints => generated 334 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:55:53.814233 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c1949-7444-4886-8234-2f9af034d4b2 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:53.814771 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c1949-7444-4886-8234-2f9af034d4b2 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:53.814771 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c1949-7444-4886-8234-2f9af034d4b2 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:53.816953 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 521/1046] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:53.823087 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7406bb-72f8-4fdc-a9c3-e4a7b817069d None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:53.823633 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7406bb-72f8-4fdc-a9c3-e4a7b817069d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:53.823736 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7406bb-72f8-4fdc-a9c3-e4a7b817069d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:53.841658 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-dd7406bb-72f8-4fdc-a9c3-e4a7b817069d None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:53.842838 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-dd7406bb-72f8-4fdc-a9c3-e4a7b817069d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:53.863262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 526/1047] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:53 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:53.884866 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c1949-7444-4886-8234-2f9af034d4b2 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:53.897663 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c1949-7444-4886-8234-2f9af034d4b2 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:53.902058 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0d4bc-3763-44cc-9306-7acd79a59fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:53.902823 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0d4bc-3763-44cc-9306-7acd79a59fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:53.903103 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0d4bc-3763-44cc-9306-7acd79a59fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:53.903402 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0d4bc-3763-44cc-9306-7acd79a59fe8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:53.904568 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0d4bc-3763-44cc-9306-7acd79a59fe8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:53.906221 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0d4bc-3763-44cc-9306-7acd79a59fe8 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:53.907908 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 522/1048] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:53.914351 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7406bb-72f8-4fdc-a9c3-e4a7b817069d None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:53.923339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7406bb-72f8-4fdc-a9c3-e4a7b817069d None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:53.927889 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abaa7f-475d-43e6-bab1-80cd3894dc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:53.928539 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abaa7f-475d-43e6-bab1-80cd3894dc17 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:53.928824 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abaa7f-475d-43e6-bab1-80cd3894dc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:53.929097 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abaa7f-475d-43e6-bab1-80cd3894dc17 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:53.929858 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41abaa7f-475d-43e6-bab1-80cd3894dc17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:53.931822 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41abaa7f-475d-43e6-bab1-80cd3894dc17 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:54.030706 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 527/1049] 10.222.0.54 () {60 vars in 1162 bytes} [Tue Nov 23 03:55:53 2021] POST /identity/v3/projects => generated 311 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 03:55:54.260390 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72dbcf-e3f5-4001-abe1-1487241ae612 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:54.260689 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72dbcf-e3f5-4001-abe1-1487241ae612 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:54.260966 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72dbcf-e3f5-4001-abe1-1487241ae612 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:54.262743 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 523/1050] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:54.269633 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa04f5-cf5b-4ae8-b39e-456e42a58e1b None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:54.269926 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa04f5-cf5b-4ae8-b39e-456e42a58e1b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:54.270210 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa04f5-cf5b-4ae8-b39e-456e42a58e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:54.289020 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-c6fa04f5-cf5b-4ae8-b39e-456e42a58e1b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:54.290210 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-c6fa04f5-cf5b-4ae8-b39e-456e42a58e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:54.348752 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 528/1051] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:54 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:54.372142 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72dbcf-e3f5-4001-abe1-1487241ae612 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:54.384646 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72dbcf-e3f5-4001-abe1-1487241ae612 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:54.388864 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550f3a4-209f-403d-b5f1-04b96a118c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:54.389627 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550f3a4-209f-403d-b5f1-04b96a118c89 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:54.389904 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550f3a4-209f-403d-b5f1-04b96a118c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:54.390172 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550f3a4-209f-403d-b5f1-04b96a118c89 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:54.391460 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550f3a4-209f-403d-b5f1-04b96a118c89 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:54.392582 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550f3a4-209f-403d-b5f1-04b96a118c89 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:54.403052 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-2550f3a4-209f-403d-b5f1-04b96a118c89 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 23 03:55:54.404413 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 524/1052] 10.222.0.54 () {56 vars in 1126 bytes} [Tue Nov 23 03:55:54 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:54.410868 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa04f5-cf5b-4ae8-b39e-456e42a58e1b None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:54.420303 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa04f5-cf5b-4ae8-b39e-456e42a58e1b None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:54.425438 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d206e-2ca8-4c53-84fc-454dfbc7f5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:54.426092 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d206e-2ca8-4c53-84fc-454dfbc7f5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:54.426375 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d206e-2ca8-4c53-84fc-454dfbc7f5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:54.426652 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d206e-2ca8-4c53-84fc-454dfbc7f5e5 admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:54.427398 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d206e-2ca8-4c53-84fc-454dfbc7f5e5 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:54.427708 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d206e-2ca8-4c53-84fc-454dfbc7f5e5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:54.429286 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d206e-2ca8-4c53-84fc-454dfbc7f5e5 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:54.435025 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 529/1053] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:54 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:54.441269 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550f3a4-209f-403d-b5f1-04b96a118c89 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:54.451480 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550f3a4-209f-403d-b5f1-04b96a118c89 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:54.456057 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442922c-4096-4caa-b1af-1da4ce790c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:54.456694 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442922c-4096-4caa-b1af-1da4ce790c61 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:54.456970 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442922c-4096-4caa-b1af-1da4ce790c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:54.457241 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442922c-4096-4caa-b1af-1da4ce790c61 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:54.458085 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442922c-4096-4caa-b1af-1da4ce790c61 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:54.458388 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442922c-4096-4caa-b1af-1da4ce790c61 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:54.459977 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442922c-4096-4caa-b1af-1da4ce790c61 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:54.465192 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 525/1054] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:54 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:54.471295 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d206e-2ca8-4c53-84fc-454dfbc7f5e5 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:54.480708 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d206e-2ca8-4c53-84fc-454dfbc7f5e5 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:54.485609 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a79bf-c4c1-476a-8b63-f42d1b911986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:54.486242 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a79bf-c4c1-476a-8b63-f42d1b911986 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:54.486522 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a79bf-c4c1-476a-8b63-f42d1b911986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:54.486795 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a79bf-c4c1-476a-8b63-f42d1b911986 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:54.487572 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a79bf-c4c1-476a-8b63-f42d1b911986 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:54.489141 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a79bf-c4c1-476a-8b63-f42d1b911986 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:54.573090 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 530/1055] 10.222.0.54 () {60 vars in 1165 bytes} [Tue Nov 23 03:55:54 2021] POST /identity/v3/endpoints => generated 327 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 03:55:54.990137 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2eaa32-a120-464f-8ead-c7d4f271ece7 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:54.990640 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2eaa32-a120-464f-8ead-c7d4f271ece7 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:54.990715 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2eaa32-a120-464f-8ead-c7d4f271ece7 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:54.992528 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 526/1056] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:54.998442 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c98ffe-a6c7-42dd-acb3-56dc5c5a9f98 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:54.998858 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c98ffe-a6c7-42dd-acb3-56dc5c5a9f98 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:54.999154 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c98ffe-a6c7-42dd-acb3-56dc5c5a9f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:55.018203 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-64c98ffe-a6c7-42dd-acb3-56dc5c5a9f98 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:55.019414 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-64c98ffe-a6c7-42dd-acb3-56dc5c5a9f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:55.043236 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 531/1057] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:54 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:55:55.061683 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2eaa32-a120-464f-8ead-c7d4f271ece7 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:55.074030 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2eaa32-a120-464f-8ead-c7d4f271ece7 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:55.078860 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41c82f-d55b-4280-87d5-14b337cb5289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:55.079679 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41c82f-d55b-4280-87d5-14b337cb5289 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:55.079968 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41c82f-d55b-4280-87d5-14b337cb5289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:55.080244 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41c82f-d55b-4280-87d5-14b337cb5289 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:55.090468 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41c82f-d55b-4280-87d5-14b337cb5289 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:55.098612 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-8d41c82f-d55b-4280-87d5-14b337cb5289 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 23 03:55:55.099979 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 527/1058] 10.222.0.54 () {56 vars in 1141 bytes} [Tue Nov 23 03:55:55 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:55.106220 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c98ffe-a6c7-42dd-acb3-56dc5c5a9f98 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:55.115546 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c98ffe-a6c7-42dd-acb3-56dc5c5a9f98 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:55.120039 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295aa935-88f1-4afb-bf3d-77bdb6dab469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:55.120700 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aa935-88f1-4afb-bf3d-77bdb6dab469 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:55.120986 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aa935-88f1-4afb-bf3d-77bdb6dab469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:55.121265 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aa935-88f1-4afb-bf3d-77bdb6dab469 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:55.122030 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295aa935-88f1-4afb-bf3d-77bdb6dab469 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:55.122339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295aa935-88f1-4afb-bf3d-77bdb6dab469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:55.123998 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295aa935-88f1-4afb-bf3d-77bdb6dab469 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:55.133101 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 532/1059] 10.222.0.54 () {56 vars in 1136 bytes} [Tue Nov 23 03:55:55 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:55.139260 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41c82f-d55b-4280-87d5-14b337cb5289 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:55.151625 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41c82f-d55b-4280-87d5-14b337cb5289 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:55.156394 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d6e9d-bbff-4928-a228-d0fad61cab8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:55.157806 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d6e9d-bbff-4928-a228-d0fad61cab8f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:55.158091 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d6e9d-bbff-4928-a228-d0fad61cab8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:55.158423 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d6e9d-bbff-4928-a228-d0fad61cab8f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:55.169056 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d6e9d-bbff-4928-a228-d0fad61cab8f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:55.170873 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d6e9d-bbff-4928-a228-d0fad61cab8f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:55.187310 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-b38d6e9d-bbff-4928-a228-d0fad61cab8f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:55.188659 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 528/1060] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:55.194979 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295aa935-88f1-4afb-bf3d-77bdb6dab469 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:55.205923 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295aa935-88f1-4afb-bf3d-77bdb6dab469 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:55.211226 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57b710-f075-4fc3-95bc-e36c18a1fc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:55.211974 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57b710-f075-4fc3-95bc-e36c18a1fc19 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:55.212333 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57b710-f075-4fc3-95bc-e36c18a1fc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:55.212682 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57b710-f075-4fc3-95bc-e36c18a1fc19 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:55.213607 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57b710-f075-4fc3-95bc-e36c18a1fc19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:55.213985 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57b710-f075-4fc3-95bc-e36c18a1fc19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:55.215677 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57b710-f075-4fc3-95bc-e36c18a1fc19 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:55.235036 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 533/1061] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:55.236378 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d6e9d-bbff-4928-a228-d0fad61cab8f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:55.246114 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d6e9d-bbff-4928-a228-d0fad61cab8f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:55.250587 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792148ca-4298-4ea5-af2e-4fad1ed4d4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:55.251434 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792148ca-4298-4ea5-af2e-4fad1ed4d4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:55.251721 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792148ca-4298-4ea5-af2e-4fad1ed4d4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:55.251997 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792148ca-4298-4ea5-af2e-4fad1ed4d4e1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:55.259138 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792148ca-4298-4ea5-af2e-4fad1ed4d4e1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:55.261158 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792148ca-4298-4ea5-af2e-4fad1ed4d4e1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:55.275048 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-792148ca-4298-4ea5-af2e-4fad1ed4d4e1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 03:55:55.276367 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 529/1062] 10.222.0.54 () {56 vars in 1114 bytes} [Tue Nov 23 03:55:55 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:55.282443 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57b710-f075-4fc3-95bc-e36c18a1fc19 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:55.292154 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57b710-f075-4fc3-95bc-e36c18a1fc19 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:55.296682 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8374c66-0c0f-4acb-997e-57be2827460c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:55.297918 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8374c66-0c0f-4acb-997e-57be2827460c admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:55.298253 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8374c66-0c0f-4acb-997e-57be2827460c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:55.298594 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8374c66-0c0f-4acb-997e-57be2827460c admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:55.299535 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8374c66-0c0f-4acb-997e-57be2827460c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:55.299910 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8374c66-0c0f-4acb-997e-57be2827460c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:55.301784 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8374c66-0c0f-4acb-997e-57be2827460c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:55.323289 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 534/1063] 10.222.0.54 () {56 vars in 1154 bytes} [Tue Nov 23 03:55:55 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:55.326633 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792148ca-4298-4ea5-af2e-4fad1ed4d4e1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:55.336411 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792148ca-4298-4ea5-af2e-4fad1ed4d4e1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:55.340880 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031fc5f-18f7-476e-9c91-bca41ceff629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:55.341506 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031fc5f-18f7-476e-9c91-bca41ceff629 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:55.341790 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031fc5f-18f7-476e-9c91-bca41ceff629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:55.342066 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031fc5f-18f7-476e-9c91-bca41ceff629 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:55.350586 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031fc5f-18f7-476e-9c91-bca41ceff629 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:55.352354 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031fc5f-18f7-476e-9c91-bca41ceff629 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:55.367588 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 530/1064] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:55 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 03:55:55.368856 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8374c66-0c0f-4acb-997e-57be2827460c admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:55.378550 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8374c66-0c0f-4acb-997e-57be2827460c admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:55.382995 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75aaf24-8145-4b34-8c17-1d7fcfb5f8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:55.383811 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75aaf24-8145-4b34-8c17-1d7fcfb5f8ee admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:55.384091 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75aaf24-8145-4b34-8c17-1d7fcfb5f8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:55.384364 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75aaf24-8145-4b34-8c17-1d7fcfb5f8ee admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:55.394581 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75aaf24-8145-4b34-8c17-1d7fcfb5f8ee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:55.396408 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75aaf24-8145-4b34-8c17-1d7fcfb5f8ee admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:55.413677 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-c75aaf24-8145-4b34-8c17-1d7fcfb5f8ee admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:55.415083 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 535/1065] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:55.420975 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031fc5f-18f7-476e-9c91-bca41ceff629 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:55.430671 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031fc5f-18f7-476e-9c91-bca41ceff629 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:55.435814 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e42543-03e4-4506-af45-08c60b5fa7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:55.436468 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e42543-03e4-4506-af45-08c60b5fa7ec admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:55.436746 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e42543-03e4-4506-af45-08c60b5fa7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:55.437015 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e42543-03e4-4506-af45-08c60b5fa7ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:55.437832 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e42543-03e4-4506-af45-08c60b5fa7ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:55.438147 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e42543-03e4-4506-af45-08c60b5fa7ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:55.439732 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e42543-03e4-4506-af45-08c60b5fa7ec admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:55.451958 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 531/1066] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:55.457854 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75aaf24-8145-4b34-8c17-1d7fcfb5f8ee admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:55.467768 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75aaf24-8145-4b34-8c17-1d7fcfb5f8ee admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:55.472789 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283ff76-fa51-4189-aa44-5cb0b956b228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:55.473564 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283ff76-fa51-4189-aa44-5cb0b956b228 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:55.473844 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283ff76-fa51-4189-aa44-5cb0b956b228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:55.474115 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283ff76-fa51-4189-aa44-5cb0b956b228 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:55.480888 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283ff76-fa51-4189-aa44-5cb0b956b228 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:55.482803 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283ff76-fa51-4189-aa44-5cb0b956b228 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:55.495926 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-f283ff76-fa51-4189-aa44-5cb0b956b228 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:55.497250 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 536/1067] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:55.503685 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e42543-03e4-4506-af45-08c60b5fa7ec admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:55.513107 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e42543-03e4-4506-af45-08c60b5fa7ec admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:55.517696 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c2de3-e4a4-450f-b047-4548e027898f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:55.518323 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c2de3-e4a4-450f-b047-4548e027898f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:55.518603 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c2de3-e4a4-450f-b047-4548e027898f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:55.518871 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c2de3-e4a4-450f-b047-4548e027898f admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:55.519682 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c2de3-e4a4-450f-b047-4548e027898f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:55.519986 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c2de3-e4a4-450f-b047-4548e027898f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:55.521795 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c2de3-e4a4-450f-b047-4548e027898f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:55.534599 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 532/1068] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:55.541185 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283ff76-fa51-4189-aa44-5cb0b956b228 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:55.552143 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283ff76-fa51-4189-aa44-5cb0b956b228 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:55.556681 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb1127-4707-4516-a979-f1058c736394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:55.557311 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb1127-4707-4516-a979-f1058c736394 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:55.557593 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb1127-4707-4516-a979-f1058c736394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:55.557933 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb1127-4707-4516-a979-f1058c736394 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:55.558773 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb1127-4707-4516-a979-f1058c736394 admin admin] RBAC: Adding query filter params (role.id=6132be24a4fd4b2898805fc917e8da2a, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=35e14131fb22470cba63cd5e8db359e2) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:55.559130 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb1127-4707-4516-a979-f1058c736394 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:55.560974 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb1127-4707-4516-a979-f1058c736394 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:55.566633 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 537/1069] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:55:55 2021] GET /identity/v3/role_assignments?user.id=35e14131fb22470cba63cd5e8db359e2&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=6132be24a4fd4b2898805fc917e8da2a => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:56.353550 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b333219-8d0d-4d50-bfd7-841a9609c94b None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:56.354102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b333219-8d0d-4d50-bfd7-841a9609c94b None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:56.354102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b333219-8d0d-4d50-bfd7-841a9609c94b None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:56.356026 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 533/1070] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:56.361829 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7aa62-0985-4829-a1b6-fcf8a4e081b1 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:56.362245 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7aa62-0985-4829-a1b6-fcf8a4e081b1 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:56.362457 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7aa62-0985-4829-a1b6-fcf8a4e081b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:56.380750 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-b1f7aa62-0985-4829-a1b6-fcf8a4e081b1 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:56.381947 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-b1f7aa62-0985-4829-a1b6-fcf8a4e081b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:56.389946 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 538/1071] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:56 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:56.415785 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b333219-8d0d-4d50-bfd7-841a9609c94b None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:56.428004 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b333219-8d0d-4d50-bfd7-841a9609c94b None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:56.432275 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baf54c-9edd-4e6a-ad59-2a4a0063cdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:56.433045 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baf54c-9edd-4e6a-ad59-2a4a0063cdc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:56.433321 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baf54c-9edd-4e6a-ad59-2a4a0063cdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:56.433591 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baf54c-9edd-4e6a-ad59-2a4a0063cdc6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:56.434758 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21baf54c-9edd-4e6a-ad59-2a4a0063cdc6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:56.436442 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21baf54c-9edd-4e6a-ad59-2a4a0063cdc6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:56.438864 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 534/1072] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:56.445169 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7aa62-0985-4829-a1b6-fcf8a4e081b1 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:56.454847 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7aa62-0985-4829-a1b6-fcf8a4e081b1 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:56.459467 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53063847-4da2-457b-84dc-cc22a9ad38b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:56.460122 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53063847-4da2-457b-84dc-cc22a9ad38b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:56.460571 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53063847-4da2-457b-84dc-cc22a9ad38b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:56.460847 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53063847-4da2-457b-84dc-cc22a9ad38b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:56.461577 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53063847-4da2-457b-84dc-cc22a9ad38b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:56.464304 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53063847-4da2-457b-84dc-cc22a9ad38b9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:56.550589 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 539/1073] 10.222.0.54 () {60 vars in 1153 bytes} [Tue Nov 23 03:55:56 2021] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 03:55:56.878587 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e962f6-c641-4431-b6ce-978d7b3d6beb None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:56.878952 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e962f6-c641-4431-b6ce-978d7b3d6beb None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:56.879133 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e962f6-c641-4431-b6ce-978d7b3d6beb None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:56.880988 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 535/1074] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:56.886829 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75474bf7-775d-465c-8560-b87c7728fa29 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:56.887124 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75474bf7-775d-465c-8560-b87c7728fa29 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:56.887431 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75474bf7-775d-465c-8560-b87c7728fa29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:56.905382 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-75474bf7-775d-465c-8560-b87c7728fa29 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:56.906702 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-75474bf7-775d-465c-8560-b87c7728fa29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:56.914306 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 540/1075] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:56 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:56.938424 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e962f6-c641-4431-b6ce-978d7b3d6beb None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:56.950516 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e962f6-c641-4431-b6ce-978d7b3d6beb None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:56.955270 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a570d84-c798-43c0-8a14-742030760ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:56.955900 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a570d84-c798-43c0-8a14-742030760ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:56.956183 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a570d84-c798-43c0-8a14-742030760ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:56.956478 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a570d84-c798-43c0-8a14-742030760ce9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:56.964083 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a570d84-c798-43c0-8a14-742030760ce9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:56.965794 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a570d84-c798-43c0-8a14-742030760ce9 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:56.975182 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 536/1076] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:56 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 03:55:56.981831 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75474bf7-775d-465c-8560-b87c7728fa29 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:56.991480 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75474bf7-775d-465c-8560-b87c7728fa29 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:56.996003 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ff2f8-0a10-4ad9-bb15-e8d9bea97350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:56.996834 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff2f8-0a10-4ad9-bb15-e8d9bea97350 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:56.997183 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff2f8-0a10-4ad9-bb15-e8d9bea97350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:56.997526 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff2f8-0a10-4ad9-bb15-e8d9bea97350 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:56.998749 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ff2f8-0a10-4ad9-bb15-e8d9bea97350 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:57.000680 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ff2f8-0a10-4ad9-bb15-e8d9bea97350 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:57.002499 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 541/1077] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:57.829118 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a7a30-e99f-43a4-a5fa-119a9d507024 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:57.829839 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a7a30-e99f-43a4-a5fa-119a9d507024 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:57.829839 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a7a30-e99f-43a4-a5fa-119a9d507024 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:57.832085 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 537/1078] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:57.838925 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7aad7-a8ef-4aff-aa32-ab086501ec9c None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:57.839425 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7aad7-a8ef-4aff-aa32-ab086501ec9c None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:57.839542 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7aad7-a8ef-4aff-aa32-ab086501ec9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:57.858862 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-58a7aad7-a8ef-4aff-aa32-ab086501ec9c None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:57.860794 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-58a7aad7-a8ef-4aff-aa32-ab086501ec9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:57.868559 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 542/1079] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:57 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:55:57.892075 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a7a30-e99f-43a4-a5fa-119a9d507024 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:57.904057 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a7a30-e99f-43a4-a5fa-119a9d507024 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:57.909048 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520426d-ae77-4edb-9846-45b7ff01e4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:57.909834 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520426d-ae77-4edb-9846-45b7ff01e4ab admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:57.910115 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520426d-ae77-4edb-9846-45b7ff01e4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:57.910390 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520426d-ae77-4edb-9846-45b7ff01e4ab admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:57.920530 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520426d-ae77-4edb-9846-45b7ff01e4ab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:57.928415 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-e520426d-ae77-4edb-9846-45b7ff01e4ab admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 23 03:55:57.929620 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 538/1080] 10.222.0.54 () {56 vars in 1141 bytes} [Tue Nov 23 03:55:57 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:57.936123 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7aad7-a8ef-4aff-aa32-ab086501ec9c None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:57.945137 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7aad7-a8ef-4aff-aa32-ab086501ec9c None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:57.949517 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a17bb6-5635-4976-8aff-1fb51e17b0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:57.950169 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a17bb6-5635-4976-8aff-1fb51e17b0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:57.950449 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a17bb6-5635-4976-8aff-1fb51e17b0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:57.950721 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a17bb6-5635-4976-8aff-1fb51e17b0c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:57.951496 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a17bb6-5635-4976-8aff-1fb51e17b0c0 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:57.951798 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a17bb6-5635-4976-8aff-1fb51e17b0c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:57.953850 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a17bb6-5635-4976-8aff-1fb51e17b0c0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:57.961941 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 543/1081] 10.222.0.54 () {56 vars in 1136 bytes} [Tue Nov 23 03:55:57 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:57.968234 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520426d-ae77-4edb-9846-45b7ff01e4ab admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:57.978776 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520426d-ae77-4edb-9846-45b7ff01e4ab admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:57.983293 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe895b-5a50-4235-b26c-a6643db6d12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:57.984044 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe895b-5a50-4235-b26c-a6643db6d12a admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:57.984321 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe895b-5a50-4235-b26c-a6643db6d12a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:57.984591 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe895b-5a50-4235-b26c-a6643db6d12a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:57.994456 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe895b-5a50-4235-b26c-a6643db6d12a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:57.996287 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe895b-5a50-4235-b26c-a6643db6d12a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:58.012436 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-f3fe895b-5a50-4235-b26c-a6643db6d12a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:58.013567 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 539/1082] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:58.020505 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a17bb6-5635-4976-8aff-1fb51e17b0c0 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:58.030191 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a17bb6-5635-4976-8aff-1fb51e17b0c0 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:58.035700 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd4ca0-b71a-4f75-b531-8dab699450e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:58.036348 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd4ca0-b71a-4f75-b531-8dab699450e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:58.036630 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd4ca0-b71a-4f75-b531-8dab699450e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:58.036927 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd4ca0-b71a-4f75-b531-8dab699450e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:58.037687 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd4ca0-b71a-4f75-b531-8dab699450e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:58.037997 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd4ca0-b71a-4f75-b531-8dab699450e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:58.039668 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd4ca0-b71a-4f75-b531-8dab699450e7 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:58.051488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 544/1083] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:58.057643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe895b-5a50-4235-b26c-a6643db6d12a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:58.069673 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe895b-5a50-4235-b26c-a6643db6d12a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:58.074380 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d08382-53d8-420d-873c-44a019776b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:58.076643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d08382-53d8-420d-873c-44a019776b39 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:58.076643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d08382-53d8-420d-873c-44a019776b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:58.076643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d08382-53d8-420d-873c-44a019776b39 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:58.084199 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d08382-53d8-420d-873c-44a019776b39 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:58.086186 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d08382-53d8-420d-873c-44a019776b39 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:58.100195 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-b9d08382-53d8-420d-873c-44a019776b39 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 03:55:58.101325 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 540/1084] 10.222.0.54 () {56 vars in 1114 bytes} [Tue Nov 23 03:55:58 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:58.107535 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd4ca0-b71a-4f75-b531-8dab699450e7 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:58.117075 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd4ca0-b71a-4f75-b531-8dab699450e7 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:58.125726 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a0b88-260f-449e-9ca1-e4ccf1564b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:58.127250 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a0b88-260f-449e-9ca1-e4ccf1564b13 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:58.127529 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a0b88-260f-449e-9ca1-e4ccf1564b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:58.127796 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a0b88-260f-449e-9ca1-e4ccf1564b13 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:58.128624 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a0b88-260f-449e-9ca1-e4ccf1564b13 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:58.128924 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a0b88-260f-449e-9ca1-e4ccf1564b13 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:58.130852 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a0b88-260f-449e-9ca1-e4ccf1564b13 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:58.148542 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 545/1085] 10.222.0.54 () {56 vars in 1154 bytes} [Tue Nov 23 03:55:58 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:58.154531 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d08382-53d8-420d-873c-44a019776b39 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:58.165172 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d08382-53d8-420d-873c-44a019776b39 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:58.169713 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35c5a8-52d1-471c-94f6-fd254d0857f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:58.170474 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35c5a8-52d1-471c-94f6-fd254d0857f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:58.170757 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35c5a8-52d1-471c-94f6-fd254d0857f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:58.171034 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35c5a8-52d1-471c-94f6-fd254d0857f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:58.181371 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35c5a8-52d1-471c-94f6-fd254d0857f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:58.183154 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35c5a8-52d1-471c-94f6-fd254d0857f0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:58.199764 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-ea35c5a8-52d1-471c-94f6-fd254d0857f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:55:58.200895 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 541/1086] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:55:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:58.207430 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a0b88-260f-449e-9ca1-e4ccf1564b13 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:58.216899 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a0b88-260f-449e-9ca1-e4ccf1564b13 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:58.222255 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da748d11-d557-4658-b08c-71a900b1141c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:58.222901 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da748d11-d557-4658-b08c-71a900b1141c admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:58.223184 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da748d11-d557-4658-b08c-71a900b1141c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:58.223493 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da748d11-d557-4658-b08c-71a900b1141c admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:58.224226 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da748d11-d557-4658-b08c-71a900b1141c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:58.224532 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da748d11-d557-4658-b08c-71a900b1141c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:58.226090 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da748d11-d557-4658-b08c-71a900b1141c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:58.238084 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 546/1087] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:55:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:58.244075 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35c5a8-52d1-471c-94f6-fd254d0857f0 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:58.253657 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35c5a8-52d1-471c-94f6-fd254d0857f0 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:58.258096 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc2e61-667d-42ce-80fe-6bc608559535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:58.258857 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc2e61-667d-42ce-80fe-6bc608559535 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:58.259134 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc2e61-667d-42ce-80fe-6bc608559535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:58.259437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc2e61-667d-42ce-80fe-6bc608559535 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:58.266558 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc2e61-667d-42ce-80fe-6bc608559535 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:58.268493 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc2e61-667d-42ce-80fe-6bc608559535 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:58.280845 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-d7cc2e61-667d-42ce-80fe-6bc608559535 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:55:58.282850 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 542/1088] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:55:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:58.288829 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da748d11-d557-4658-b08c-71a900b1141c admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:58.298311 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da748d11-d557-4658-b08c-71a900b1141c admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:58.302778 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ceb135-b60c-441d-8a82-3d5330cd7723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:58.303444 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ceb135-b60c-441d-8a82-3d5330cd7723 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:58.303732 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ceb135-b60c-441d-8a82-3d5330cd7723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:58.304011 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ceb135-b60c-441d-8a82-3d5330cd7723 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:58.304858 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ceb135-b60c-441d-8a82-3d5330cd7723 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:58.305171 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ceb135-b60c-441d-8a82-3d5330cd7723 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:58.307000 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ceb135-b60c-441d-8a82-3d5330cd7723 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:58.319505 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 547/1089] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:55:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:55:58.325418 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc2e61-667d-42ce-80fe-6bc608559535 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:58.336104 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc2e61-667d-42ce-80fe-6bc608559535 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:58.340582 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787d404-a50c-457f-9591-57d55c3b4350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:58.341436 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787d404-a50c-457f-9591-57d55c3b4350 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:58.341718 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787d404-a50c-457f-9591-57d55c3b4350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:58.341995 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787d404-a50c-457f-9591-57d55c3b4350 admin admin] PATH_INFO: `/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/35e14131fb22470cba63cd5e8db359e2/roles/6132be24a4fd4b2898805fc917e8da2a` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:58.344833 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787d404-a50c-457f-9591-57d55c3b4350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa78bb05b3e48f3a9c973567c781357, user_id=35e14131fb22470cba63cd5e8db359e2, role_id=6132be24a4fd4b2898805fc917e8da2a)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:58.347457 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787d404-a50c-457f-9591-57d55c3b4350 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:58.417272 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 543/1090] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:55:58 2021] PUT /identity/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/35e14131fb22470cba63cd5e8db359e2/roles/6132be24a4fd4b2898805fc917e8da2a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:55:58.953748 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9108f-b773-417b-b041-8b384fd40938 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:58.954274 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9108f-b773-417b-b041-8b384fd40938 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:58.954274 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9108f-b773-417b-b041-8b384fd40938 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:58.956068 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 548/1091] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:55:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:55:58.962251 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa6351-a227-4b2c-a240-da47d4b809b8 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:58.962660 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa6351-a227-4b2c-a240-da47d4b809b8 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:58.962805 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa6351-a227-4b2c-a240-da47d4b809b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:58.980337 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-dafa6351-a227-4b2c-a240-da47d4b809b8 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:55:58.981507 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-dafa6351-a227-4b2c-a240-da47d4b809b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:55:59.036000 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 544/1092] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:55:58 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:55:59.060909 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9108f-b773-417b-b041-8b384fd40938 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:59.073738 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9108f-b773-417b-b041-8b384fd40938 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:59.077999 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c0037-9f97-4b01-8238-713bd5c0deff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:59.078816 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c0037-9f97-4b01-8238-713bd5c0deff admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:59.079093 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c0037-9f97-4b01-8238-713bd5c0deff admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:59.079400 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c0037-9f97-4b01-8238-713bd5c0deff admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:59.089281 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c0037-9f97-4b01-8238-713bd5c0deff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:55:59.096688 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-3e0c0037-9f97-4b01-8238-713bd5c0deff admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:55:59.098016 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 549/1093] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:55:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:55:59.104645 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa6351-a227-4b2c-a240-da47d4b809b8 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:59.114450 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa6351-a227-4b2c-a240-da47d4b809b8 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:59.118874 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ac8ac-b641-4731-b493-b8acaa29ec9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:59.119571 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ac8ac-b641-4731-b493-b8acaa29ec9b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:59.119855 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ac8ac-b641-4731-b493-b8acaa29ec9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:59.120130 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ac8ac-b641-4731-b493-b8acaa29ec9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:59.120885 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ac8ac-b641-4731-b493-b8acaa29ec9b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:59.121189 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ac8ac-b641-4731-b493-b8acaa29ec9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:59.122777 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ac8ac-b641-4731-b493-b8acaa29ec9b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:59.131260 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 545/1094] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:55:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:59.137624 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c0037-9f97-4b01-8238-713bd5c0deff admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:59.148236 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c0037-9f97-4b01-8238-713bd5c0deff admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:59.152683 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0717415-0879-48fc-94b8-20940fc33427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:59.153525 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0717415-0879-48fc-94b8-20940fc33427 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:59.153807 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0717415-0879-48fc-94b8-20940fc33427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:59.154085 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0717415-0879-48fc-94b8-20940fc33427 admin admin] PATH_INFO: `/v3/users/34119e9dbc044a8f86a3a04aedcb284f` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:59.167799 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0717415-0879-48fc-94b8-20940fc33427 admin admin] RBAC: Authorizing `identity:get_user(user_id=34119e9dbc044a8f86a3a04aedcb284f)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:59.169907 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0717415-0879-48fc-94b8-20940fc33427 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:59.171573 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 550/1095] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:55:59 2021] GET /identity/v3/users/34119e9dbc044a8f86a3a04aedcb284f => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:59.178429 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ac8ac-b641-4731-b493-b8acaa29ec9b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:59.187895 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ac8ac-b641-4731-b493-b8acaa29ec9b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:59.192588 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77042d13-fb41-4dff-b19c-e9e7c96ecf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:59.193215 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77042d13-fb41-4dff-b19c-e9e7c96ecf90 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:59.193496 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77042d13-fb41-4dff-b19c-e9e7c96ecf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:59.193769 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77042d13-fb41-4dff-b19c-e9e7c96ecf90 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:59.201324 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77042d13-fb41-4dff-b19c-e9e7c96ecf90 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:59.203109 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77042d13-fb41-4dff-b19c-e9e7c96ecf90 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:59.211935 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 546/1096] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:55:59 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 03:55:59.218295 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0717415-0879-48fc-94b8-20940fc33427 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:59.228214 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0717415-0879-48fc-94b8-20940fc33427 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:59.232632 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e93264-571d-4c3d-a3e8-ed73b2284285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:59.233466 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e93264-571d-4c3d-a3e8-ed73b2284285 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:59.233748 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e93264-571d-4c3d-a3e8-ed73b2284285 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:59.234024 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e93264-571d-4c3d-a3e8-ed73b2284285 admin admin] PATH_INFO: `/v3/projects/3d3a7d96109e44bcb60d3af05bb090ad` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:59.235786 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e93264-571d-4c3d-a3e8-ed73b2284285 admin admin] RBAC: Authorizing `identity:get_project(project_id=3d3a7d96109e44bcb60d3af05bb090ad)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:59.237870 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e93264-571d-4c3d-a3e8-ed73b2284285 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:59.240194 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 551/1097] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:55:59 2021] GET /identity/v3/projects/3d3a7d96109e44bcb60d3af05bb090ad => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:55:59.246723 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77042d13-fb41-4dff-b19c-e9e7c96ecf90 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:55:59.255557 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77042d13-fb41-4dff-b19c-e9e7c96ecf90 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:55:59.260046 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdfdab-9ed4-4180-86c1-33308852beed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:55:59.260679 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdfdab-9ed4-4180-86c1-33308852beed admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:55:59.260962 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdfdab-9ed4-4180-86c1-33308852beed admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:55:59.261239 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdfdab-9ed4-4180-86c1-33308852beed admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:55:59.262076 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdfdab-9ed4-4180-86c1-33308852beed admin admin] RBAC: Adding query filter params (role.id=3db7012b41944542a50049819500eadd, scope.project.id=3d3a7d96109e44bcb60d3af05bb090ad, user.id=34119e9dbc044a8f86a3a04aedcb284f) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:55:59.262388 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdfdab-9ed4-4180-86c1-33308852beed admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:55:59.264243 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdfdab-9ed4-4180-86c1-33308852beed admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:55:59.269891 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 547/1098] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:55:59 2021] GET /identity/v3/role_assignments?user.id=34119e9dbc044a8f86a3a04aedcb284f&scope.project.id=3d3a7d96109e44bcb60d3af05bb090ad&role.id=3db7012b41944542a50049819500eadd => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:00.682330 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3d86f-4c39-4739-8625-105c2a7e2def None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:00.682772 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3d86f-4c39-4739-8625-105c2a7e2def None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:00.682865 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3d86f-4c39-4739-8625-105c2a7e2def None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:00.684670 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 552/1099] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:56:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:56:00.690627 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52341963-2d37-4613-b112-51ad6759aad9 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:00.691026 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52341963-2d37-4613-b112-51ad6759aad9 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:00.691184 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52341963-2d37-4613-b112-51ad6759aad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:00.708670 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-52341963-2d37-4613-b112-51ad6759aad9 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:56:00.709857 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-52341963-2d37-4613-b112-51ad6759aad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:56:00.717351 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 548/1100] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:56:00 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:56:00.741960 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3d86f-4c39-4739-8625-105c2a7e2def None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:00.754254 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3d86f-4c39-4739-8625-105c2a7e2def None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:00.758609 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9931dae-1ee9-4fed-853f-156935a623cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:00.759425 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9931dae-1ee9-4fed-853f-156935a623cc admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:00.759708 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9931dae-1ee9-4fed-853f-156935a623cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:00.759983 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9931dae-1ee9-4fed-853f-156935a623cc admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:00.770523 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9931dae-1ee9-4fed-853f-156935a623cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:56:00.777759 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-a9931dae-1ee9-4fed-853f-156935a623cc admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 23 03:56:00.778911 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 553/1101] 10.222.0.54 () {56 vars in 1141 bytes} [Tue Nov 23 03:56:00 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:56:00.785601 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52341963-2d37-4613-b112-51ad6759aad9 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:00.794404 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52341963-2d37-4613-b112-51ad6759aad9 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:00.799229 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae445c-072a-464d-9b1d-7d04fa0ae382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:00.799880 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae445c-072a-464d-9b1d-7d04fa0ae382 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:00.800163 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae445c-072a-464d-9b1d-7d04fa0ae382 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:00.800443 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae445c-072a-464d-9b1d-7d04fa0ae382 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:00.801197 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae445c-072a-464d-9b1d-7d04fa0ae382 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:56:00.801500 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae445c-072a-464d-9b1d-7d04fa0ae382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:00.803076 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae445c-072a-464d-9b1d-7d04fa0ae382 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:00.810949 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 549/1102] 10.222.0.54 () {56 vars in 1136 bytes} [Tue Nov 23 03:56:00 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:00.817890 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9931dae-1ee9-4fed-853f-156935a623cc admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:00.827829 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9931dae-1ee9-4fed-853f-156935a623cc admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:00.832883 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0859e69-3cec-4031-8372-d2bec5c10916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:00.833639 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0859e69-3cec-4031-8372-d2bec5c10916 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:00.833922 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0859e69-3cec-4031-8372-d2bec5c10916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:00.834196 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0859e69-3cec-4031-8372-d2bec5c10916 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:00.844045 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0859e69-3cec-4031-8372-d2bec5c10916 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:00.845914 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0859e69-3cec-4031-8372-d2bec5c10916 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:00.863058 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-d0859e69-3cec-4031-8372-d2bec5c10916 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:56:00.864218 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 554/1103] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:56:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:56:00.870313 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae445c-072a-464d-9b1d-7d04fa0ae382 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:00.880839 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae445c-072a-464d-9b1d-7d04fa0ae382 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:00.885263 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c138a-e477-46a1-bfc6-0f1ad287d218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:00.885904 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c138a-e477-46a1-bfc6-0f1ad287d218 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:00.886187 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c138a-e477-46a1-bfc6-0f1ad287d218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:00.886461 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c138a-e477-46a1-bfc6-0f1ad287d218 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:00.887197 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c138a-e477-46a1-bfc6-0f1ad287d218 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:56:00.887525 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c138a-e477-46a1-bfc6-0f1ad287d218 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:00.889095 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c138a-e477-46a1-bfc6-0f1ad287d218 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:00.901356 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 550/1104] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:56:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:00.907477 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0859e69-3cec-4031-8372-d2bec5c10916 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:00.916848 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0859e69-3cec-4031-8372-d2bec5c10916 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:00.921245 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dc068-83e6-4baa-b74d-ea502a59a5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:00.922004 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dc068-83e6-4baa-b74d-ea502a59a5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:00.922384 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dc068-83e6-4baa-b74d-ea502a59a5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:00.922659 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dc068-83e6-4baa-b74d-ea502a59a5b6 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:00.929761 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dc068-83e6-4baa-b74d-ea502a59a5b6 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:00.931705 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dc068-83e6-4baa-b74d-ea502a59a5b6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:00.945791 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-ed0dc068-83e6-4baa-b74d-ea502a59a5b6 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 03:56:00.946896 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 555/1105] 10.222.0.54 () {56 vars in 1114 bytes} [Tue Nov 23 03:56:00 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:56:00.953616 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c138a-e477-46a1-bfc6-0f1ad287d218 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:00.963195 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c138a-e477-46a1-bfc6-0f1ad287d218 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:00.967598 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401969e-700a-4466-b8f2-69cd204b35f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:00.968238 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401969e-700a-4466-b8f2-69cd204b35f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:00.968518 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401969e-700a-4466-b8f2-69cd204b35f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:00.968864 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401969e-700a-4466-b8f2-69cd204b35f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:00.969804 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401969e-700a-4466-b8f2-69cd204b35f3 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:56:00.970106 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401969e-700a-4466-b8f2-69cd204b35f3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:00.971937 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401969e-700a-4466-b8f2-69cd204b35f3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:00.990206 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 551/1106] 10.222.0.54 () {56 vars in 1154 bytes} [Tue Nov 23 03:56:00 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:56:00.996549 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dc068-83e6-4baa-b74d-ea502a59a5b6 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:01.006555 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dc068-83e6-4baa-b74d-ea502a59a5b6 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:01.010931 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c624b7-4994-4e58-898d-d6817781b2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:01.011594 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c624b7-4994-4e58-898d-d6817781b2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:01.011874 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c624b7-4994-4e58-898d-d6817781b2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:01.012145 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c624b7-4994-4e58-898d-d6817781b2d2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:01.019810 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c624b7-4994-4e58-898d-d6817781b2d2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:01.021516 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c624b7-4994-4e58-898d-d6817781b2d2 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:01.029941 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 556/1107] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:56:00 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 03:56:01.036292 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401969e-700a-4466-b8f2-69cd204b35f3 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:01.045707 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401969e-700a-4466-b8f2-69cd204b35f3 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:01.050631 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53d4e9-3c66-4ce8-a1f6-3257c247b6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:01.051434 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53d4e9-3c66-4ce8-a1f6-3257c247b6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:01.051718 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53d4e9-3c66-4ce8-a1f6-3257c247b6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:01.051992 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53d4e9-3c66-4ce8-a1f6-3257c247b6d7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:01.061937 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53d4e9-3c66-4ce8-a1f6-3257c247b6d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:01.064418 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53d4e9-3c66-4ce8-a1f6-3257c247b6d7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:01.080933 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-1d53d4e9-3c66-4ce8-a1f6-3257c247b6d7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:56:01.082080 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 552/1108] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:56:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:56:01.088305 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c624b7-4994-4e58-898d-d6817781b2d2 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:01.097120 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c624b7-4994-4e58-898d-d6817781b2d2 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:01.101540 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8ff9a-b5aa-4b01-9dce-245710a57b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:01.102175 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8ff9a-b5aa-4b01-9dce-245710a57b48 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:01.104188 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8ff9a-b5aa-4b01-9dce-245710a57b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:01.104188 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8ff9a-b5aa-4b01-9dce-245710a57b48 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:01.104188 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8ff9a-b5aa-4b01-9dce-245710a57b48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:56:01.104188 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8ff9a-b5aa-4b01-9dce-245710a57b48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:01.105399 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8ff9a-b5aa-4b01-9dce-245710a57b48 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:01.122204 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 557/1109] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:56:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:56:01.123700 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53d4e9-3c66-4ce8-a1f6-3257c247b6d7 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:01.133360 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53d4e9-3c66-4ce8-a1f6-3257c247b6d7 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:01.137820 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dcda0-769e-4042-8077-ed7fb6de5cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:01.138580 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dcda0-769e-4042-8077-ed7fb6de5cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:01.138861 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dcda0-769e-4042-8077-ed7fb6de5cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:01.139131 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dcda0-769e-4042-8077-ed7fb6de5cfe admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:01.146648 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dcda0-769e-4042-8077-ed7fb6de5cfe admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:01.148697 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dcda0-769e-4042-8077-ed7fb6de5cfe admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:01.161912 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-7d2dcda0-769e-4042-8077-ed7fb6de5cfe admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:56:01.163079 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 553/1110] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:56:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:56:01.169420 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8ff9a-b5aa-4b01-9dce-245710a57b48 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:01.179049 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8ff9a-b5aa-4b01-9dce-245710a57b48 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:01.183591 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ec9c6-4ea3-4a0b-b4d3-beb7be8362ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:01.184177 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ec9c6-4ea3-4a0b-b4d3-beb7be8362ca admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:01.184458 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ec9c6-4ea3-4a0b-b4d3-beb7be8362ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:01.184737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ec9c6-4ea3-4a0b-b4d3-beb7be8362ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:01.185516 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ec9c6-4ea3-4a0b-b4d3-beb7be8362ca admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:56:01.185824 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ec9c6-4ea3-4a0b-b4d3-beb7be8362ca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:01.187887 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ec9c6-4ea3-4a0b-b4d3-beb7be8362ca admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:01.205736 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 558/1111] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:56:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:56:01.207176 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dcda0-769e-4042-8077-ed7fb6de5cfe admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:01.217329 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dcda0-769e-4042-8077-ed7fb6de5cfe admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:01.222490 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50017ab7-b5db-4b91-b8b3-e758ed5920a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:01.223115 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50017ab7-b5db-4b91-b8b3-e758ed5920a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:01.223435 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50017ab7-b5db-4b91-b8b3-e758ed5920a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:01.223713 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50017ab7-b5db-4b91-b8b3-e758ed5920a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:01.224549 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50017ab7-b5db-4b91-b8b3-e758ed5920a9 admin admin] RBAC: Adding query filter params (role.id=6132be24a4fd4b2898805fc917e8da2a, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=35e14131fb22470cba63cd5e8db359e2) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:56:01.224860 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50017ab7-b5db-4b91-b8b3-e758ed5920a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:01.226686 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50017ab7-b5db-4b91-b8b3-e758ed5920a9 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:01.232482 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 554/1112] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:56:01 2021] GET /identity/v3/role_assignments?user.id=35e14131fb22470cba63cd5e8db359e2&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=6132be24a4fd4b2898805fc917e8da2a => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:01.495733 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985b91c-2d62-42c8-91b2-546bdf123695 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:01.496014 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985b91c-2d62-42c8-91b2-546bdf123695 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:01.496283 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985b91c-2d62-42c8-91b2-546bdf123695 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:01.498068 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 559/1113] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:56:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:56:01.504019 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8772a-f21e-4b44-9504-634e044c0e1a None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:01.504311 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8772a-f21e-4b44-9504-634e044c0e1a None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:01.504591 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8772a-f21e-4b44-9504-634e044c0e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:01.522308 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-bec8772a-f21e-4b44-9504-634e044c0e1a None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:56:01.523582 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-bec8772a-f21e-4b44-9504-634e044c0e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:56:01.532161 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 555/1114] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:56:01 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:56:01.556304 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985b91c-2d62-42c8-91b2-546bdf123695 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:01.568813 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985b91c-2d62-42c8-91b2-546bdf123695 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:01.573234 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8f763-3303-4432-b8bf-fb6345227db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:01.574003 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8f763-3303-4432-b8bf-fb6345227db2 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:01.574395 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8f763-3303-4432-b8bf-fb6345227db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:01.574667 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8f763-3303-4432-b8bf-fb6345227db2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:01.585097 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8f763-3303-4432-b8bf-fb6345227db2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:56:01.591830 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-42b8f763-3303-4432-b8bf-fb6345227db2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:56:01.592999 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 560/1115] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:56:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:56:01.600755 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8772a-f21e-4b44-9504-634e044c0e1a None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:01.609940 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8772a-f21e-4b44-9504-634e044c0e1a None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:01.614572 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6157b4-8f98-44be-a63a-5c2a7e4b2423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:01.615260 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6157b4-8f98-44be-a63a-5c2a7e4b2423 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:01.615548 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6157b4-8f98-44be-a63a-5c2a7e4b2423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:01.615826 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6157b4-8f98-44be-a63a-5c2a7e4b2423 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:01.616590 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6157b4-8f98-44be-a63a-5c2a7e4b2423 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:56:01.616889 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6157b4-8f98-44be-a63a-5c2a7e4b2423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:01.618463 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6157b4-8f98-44be-a63a-5c2a7e4b2423 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:01.627640 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 556/1116] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:56:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:01.634061 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8f763-3303-4432-b8bf-fb6345227db2 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:01.643985 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8f763-3303-4432-b8bf-fb6345227db2 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:01.648598 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bbe71-e15b-4d97-bcfd-947eda40c1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:01.649451 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bbe71-e15b-4d97-bcfd-947eda40c1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:01.649737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bbe71-e15b-4d97-bcfd-947eda40c1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:01.650015 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bbe71-e15b-4d97-bcfd-947eda40c1b1 admin admin] PATH_INFO: `/v3/users/34119e9dbc044a8f86a3a04aedcb284f` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:01.651360 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79bbe71-e15b-4d97-bcfd-947eda40c1b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=34119e9dbc044a8f86a3a04aedcb284f)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:01.653761 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79bbe71-e15b-4d97-bcfd-947eda40c1b1 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:01.655394 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 561/1117] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:56:01 2021] GET /identity/v3/users/34119e9dbc044a8f86a3a04aedcb284f => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:01.662853 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6157b4-8f98-44be-a63a-5c2a7e4b2423 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:01.673695 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6157b4-8f98-44be-a63a-5c2a7e4b2423 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:01.678372 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138ae6c-06c3-4086-8f91-e3c24cdc2d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:01.679305 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138ae6c-06c3-4086-8f91-e3c24cdc2d94 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:01.679891 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138ae6c-06c3-4086-8f91-e3c24cdc2d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:01.679891 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138ae6c-06c3-4086-8f91-e3c24cdc2d94 admin admin] PATH_INFO: `/v3/projects/3d3a7d96109e44bcb60d3af05bb090ad` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:01.681017 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138ae6c-06c3-4086-8f91-e3c24cdc2d94 admin admin] RBAC: Authorizing `identity:get_project(project_id=3d3a7d96109e44bcb60d3af05bb090ad)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:01.683050 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138ae6c-06c3-4086-8f91-e3c24cdc2d94 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:01.684749 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 557/1118] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:56:01 2021] GET /identity/v3/projects/3d3a7d96109e44bcb60d3af05bb090ad => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:01.691623 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bbe71-e15b-4d97-bcfd-947eda40c1b1 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:01.703542 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bbe71-e15b-4d97-bcfd-947eda40c1b1 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:01.708224 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc38a9-88a4-421e-a87c-0f59002abeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:01.709093 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc38a9-88a4-421e-a87c-0f59002abeaa admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:01.709381 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc38a9-88a4-421e-a87c-0f59002abeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:01.709654 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc38a9-88a4-421e-a87c-0f59002abeaa admin admin] PATH_INFO: `/v3/projects/3d3a7d96109e44bcb60d3af05bb090ad/users/34119e9dbc044a8f86a3a04aedcb284f/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:01.711768 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc38a9-88a4-421e-a87c-0f59002abeaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d3a7d96109e44bcb60d3af05bb090ad, user_id=34119e9dbc044a8f86a3a04aedcb284f, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:01.714404 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc38a9-88a4-421e-a87c-0f59002abeaa admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:01.812057 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 562/1119] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:56:01 2021] PUT /identity/v3/projects/3d3a7d96109e44bcb60d3af05bb090ad/users/34119e9dbc044a8f86a3a04aedcb284f/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:56:04.116504 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6aae5-8dc0-48a9-a7e3-de5c531d03b4 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:04.117049 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6aae5-8dc0-48a9-a7e3-de5c531d03b4 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:04.117049 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6aae5-8dc0-48a9-a7e3-de5c531d03b4 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:04.118815 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 558/1120] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:56:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:56:04.124764 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa108f-c52e-4a34-a879-aff6fdea3eda None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:04.128975 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa108f-c52e-4a34-a879-aff6fdea3eda None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:04.129290 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa108f-c52e-4a34-a879-aff6fdea3eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:04.146825 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-1daa108f-c52e-4a34-a879-aff6fdea3eda None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:56:04.148080 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-1daa108f-c52e-4a34-a879-aff6fdea3eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:56:04.256711 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 563/1121] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:56:04 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:56:04.282076 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6aae5-8dc0-48a9-a7e3-de5c531d03b4 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:04.294064 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6aae5-8dc0-48a9-a7e3-de5c531d03b4 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:04.298941 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25d8ab-8cf3-4806-bfb7-537a678a432f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:04.299884 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25d8ab-8cf3-4806-bfb7-537a678a432f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:04.300207 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25d8ab-8cf3-4806-bfb7-537a678a432f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:04.300479 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25d8ab-8cf3-4806-bfb7-537a678a432f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:04.316300 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25d8ab-8cf3-4806-bfb7-537a678a432f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:56:04.323030 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-7e25d8ab-8cf3-4806-bfb7-537a678a432f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:56:04.324204 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 559/1122] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:56:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:56:04.330765 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa108f-c52e-4a34-a879-aff6fdea3eda None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:04.339630 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa108f-c52e-4a34-a879-aff6fdea3eda None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:04.344802 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7ce5c-c1d4-4683-90c8-096473583480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:04.345449 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7ce5c-c1d4-4683-90c8-096473583480 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:04.345732 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7ce5c-c1d4-4683-90c8-096473583480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:04.346008 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7ce5c-c1d4-4683-90c8-096473583480 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:04.346759 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7ce5c-c1d4-4683-90c8-096473583480 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:56:04.347064 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7ce5c-c1d4-4683-90c8-096473583480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:04.348657 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7ce5c-c1d4-4683-90c8-096473583480 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:04.356622 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 564/1123] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:56:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:04.363491 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25d8ab-8cf3-4806-bfb7-537a678a432f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:04.372933 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25d8ab-8cf3-4806-bfb7-537a678a432f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:04.377503 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fdeef7-d491-46cb-87ca-48cb5416dbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:04.378331 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdeef7-d491-46cb-87ca-48cb5416dbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:04.378611 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdeef7-d491-46cb-87ca-48cb5416dbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:04.378888 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdeef7-d491-46cb-87ca-48cb5416dbe2 admin admin] PATH_INFO: `/v3/users/34119e9dbc044a8f86a3a04aedcb284f` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:04.380125 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fdeef7-d491-46cb-87ca-48cb5416dbe2 admin admin] RBAC: Authorizing `identity:get_user(user_id=34119e9dbc044a8f86a3a04aedcb284f)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:04.382203 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fdeef7-d491-46cb-87ca-48cb5416dbe2 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:04.383780 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 560/1124] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:56:04 2021] GET /identity/v3/users/34119e9dbc044a8f86a3a04aedcb284f => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:04.389681 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7ce5c-c1d4-4683-90c8-096473583480 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:04.398727 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7ce5c-c1d4-4683-90c8-096473583480 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:04.403124 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcff827-9a23-446e-b9f4-b810cb57bb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:04.403759 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcff827-9a23-446e-b9f4-b810cb57bb39 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:04.404043 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcff827-9a23-446e-b9f4-b810cb57bb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:04.404321 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcff827-9a23-446e-b9f4-b810cb57bb39 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:04.412259 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcff827-9a23-446e-b9f4-b810cb57bb39 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:04.413942 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcff827-9a23-446e-b9f4-b810cb57bb39 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:04.423073 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 565/1125] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:56:04 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 03:56:04.428983 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fdeef7-d491-46cb-87ca-48cb5416dbe2 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:04.438332 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fdeef7-d491-46cb-87ca-48cb5416dbe2 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:04.443079 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0b040-1bcd-4c55-882c-a486dadba4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:04.443915 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0b040-1bcd-4c55-882c-a486dadba4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:04.444199 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0b040-1bcd-4c55-882c-a486dadba4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:04.444472 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0b040-1bcd-4c55-882c-a486dadba4e9 admin admin] PATH_INFO: `/v3/projects/3d3a7d96109e44bcb60d3af05bb090ad` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:04.445641 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0b040-1bcd-4c55-882c-a486dadba4e9 admin admin] RBAC: Authorizing `identity:get_project(project_id=3d3a7d96109e44bcb60d3af05bb090ad)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:04.447671 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0b040-1bcd-4c55-882c-a486dadba4e9 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:04.449268 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 561/1126] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:56:04 2021] GET /identity/v3/projects/3d3a7d96109e44bcb60d3af05bb090ad => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:04.455275 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcff827-9a23-446e-b9f4-b810cb57bb39 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:04.463712 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcff827-9a23-446e-b9f4-b810cb57bb39 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:04.468138 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cebc9b-04c9-4cf8-9aa6-007dccb16bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:04.469241 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cebc9b-04c9-4cf8-9aa6-007dccb16bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:04.469693 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cebc9b-04c9-4cf8-9aa6-007dccb16bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:04.469967 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cebc9b-04c9-4cf8-9aa6-007dccb16bd1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:04.470779 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cebc9b-04c9-4cf8-9aa6-007dccb16bd1 admin admin] RBAC: Adding query filter params (role.id=3db7012b41944542a50049819500eadd, scope.project.id=3d3a7d96109e44bcb60d3af05bb090ad, user.id=34119e9dbc044a8f86a3a04aedcb284f) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:56:04.471084 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cebc9b-04c9-4cf8-9aa6-007dccb16bd1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:04.473514 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cebc9b-04c9-4cf8-9aa6-007dccb16bd1 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:04.479348 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 566/1127] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:56:04 2021] GET /identity/v3/role_assignments?user.id=34119e9dbc044a8f86a3a04aedcb284f&scope.project.id=3d3a7d96109e44bcb60d3af05bb090ad&role.id=3db7012b41944542a50049819500eadd => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:06.727811 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bf6b3-3c8c-4c8b-b926-7fd27215463b None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:06.728309 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bf6b3-3c8c-4c8b-b926-7fd27215463b None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:06.728399 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bf6b3-3c8c-4c8b-b926-7fd27215463b None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:06.730140 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 562/1128] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:56:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:56:06.736223 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a7d33-7987-4259-8099-09be26da9cac None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:06.736599 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a7d33-7987-4259-8099-09be26da9cac None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:06.736786 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a7d33-7987-4259-8099-09be26da9cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:06.754684 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-518a7d33-7987-4259-8099-09be26da9cac None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:56:06.755902 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-518a7d33-7987-4259-8099-09be26da9cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:56:06.763432 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 567/1129] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:56:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:56:06.789137 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7bf6b3-3c8c-4c8b-b926-7fd27215463b None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:06.801037 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7bf6b3-3c8c-4c8b-b926-7fd27215463b None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:06.805302 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93282307-0f2e-4d1b-bc14-80bd035b8ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:06.806053 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93282307-0f2e-4d1b-bc14-80bd035b8ced admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:06.806330 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93282307-0f2e-4d1b-bc14-80bd035b8ced admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:06.806600 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93282307-0f2e-4d1b-bc14-80bd035b8ced admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:06.807778 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93282307-0f2e-4d1b-bc14-80bd035b8ced admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:06.809421 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93282307-0f2e-4d1b-bc14-80bd035b8ced admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:06.810938 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 563/1130] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:56:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:06.817404 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a7d33-7987-4259-8099-09be26da9cac None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:06.826006 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a7d33-7987-4259-8099-09be26da9cac None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:06.831237 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425075cf-f5ad-4897-83c3-31b542ccff38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:06.831881 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425075cf-f5ad-4897-83c3-31b542ccff38 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:06.832168 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425075cf-f5ad-4897-83c3-31b542ccff38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:06.832446 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425075cf-f5ad-4897-83c3-31b542ccff38 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:06.833168 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425075cf-f5ad-4897-83c3-31b542ccff38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:06.835029 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425075cf-f5ad-4897-83c3-31b542ccff38 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:06.920419 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 568/1131] 10.222.0.54 () {60 vars in 1153 bytes} [Tue Nov 23 03:56:06 2021] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 03:56:09.217146 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20089d-563d-4477-bead-d60e23eeeaa2 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:09.217706 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20089d-563d-4477-bead-d60e23eeeaa2 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:09.217706 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20089d-563d-4477-bead-d60e23eeeaa2 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:09.220766 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 564/1132] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:56:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:56:09.227465 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6955585-014a-4956-92f9-259a14ac0228 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:09.227862 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6955585-014a-4956-92f9-259a14ac0228 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:09.228354 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6955585-014a-4956-92f9-259a14ac0228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:09.245457 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-b6955585-014a-4956-92f9-259a14ac0228 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:56:09.246649 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-b6955585-014a-4956-92f9-259a14ac0228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:56:09.254854 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 569/1133] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:56:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:56:09.280104 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20089d-563d-4477-bead-d60e23eeeaa2 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:09.292571 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20089d-563d-4477-bead-d60e23eeeaa2 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:09.297016 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33003eb2-cc18-42e7-afee-514f91b108e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:09.297831 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33003eb2-cc18-42e7-afee-514f91b108e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:09.298107 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33003eb2-cc18-42e7-afee-514f91b108e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:09.298377 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33003eb2-cc18-42e7-afee-514f91b108e6 admin admin] PATH_INFO: `/v3/roles/e8e5c21f4bea46318bef0c9784214ce6` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:09.299875 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33003eb2-cc18-42e7-afee-514f91b108e6 admin admin] RBAC: Authorizing `identity:get_role(role_id=e8e5c21f4bea46318bef0c9784214ce6)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:09.300868 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING py.warnings [None req-33003eb2-cc18-42e7-afee-514f91b108e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:56:09.300868 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: warnings.warn(msg) Nov 23 03:56:09.300868 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: Nov 23 03:56:09.301712 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33003eb2-cc18-42e7-afee-514f91b108e6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:09.302992 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 565/1134] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:56:09 2021] GET /identity/v3/roles/e8e5c21f4bea46318bef0c9784214ce6 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:09.308928 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6955585-014a-4956-92f9-259a14ac0228 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:09.318130 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6955585-014a-4956-92f9-259a14ac0228 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:09.322580 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f217cd-df0d-49ff-a23c-6bc1ddecda9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:09.323462 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f217cd-df0d-49ff-a23c-6bc1ddecda9c admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:09.323746 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f217cd-df0d-49ff-a23c-6bc1ddecda9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:09.324022 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f217cd-df0d-49ff-a23c-6bc1ddecda9c admin admin] PATH_INFO: `/v3/users/098dbf3f30a84a719575aba117c18f15` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:09.338665 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f217cd-df0d-49ff-a23c-6bc1ddecda9c admin admin] RBAC: Authorizing `identity:get_user(user_id=098dbf3f30a84a719575aba117c18f15)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:09.340798 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f217cd-df0d-49ff-a23c-6bc1ddecda9c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:09.342379 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 570/1135] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:56:09 2021] GET /identity/v3/users/098dbf3f30a84a719575aba117c18f15 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:09.349108 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33003eb2-cc18-42e7-afee-514f91b108e6 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:09.358285 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33003eb2-cc18-42e7-afee-514f91b108e6 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:09.363499 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fbda5-ecf7-4125-a2aa-a347cf4a798c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:09.364108 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fbda5-ecf7-4125-a2aa-a347cf4a798c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:09.364385 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fbda5-ecf7-4125-a2aa-a347cf4a798c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:09.364660 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fbda5-ecf7-4125-a2aa-a347cf4a798c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:09.372076 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fbda5-ecf7-4125-a2aa-a347cf4a798c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:09.373757 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fbda5-ecf7-4125-a2aa-a347cf4a798c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:09.382308 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 566/1136] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:56:09 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 03:56:09.388202 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f217cd-df0d-49ff-a23c-6bc1ddecda9c admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:09.397834 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f217cd-df0d-49ff-a23c-6bc1ddecda9c admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:09.402308 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560bed8-79af-46f8-bed8-9cf39b658847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:09.403123 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560bed8-79af-46f8-bed8-9cf39b658847 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:09.403438 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560bed8-79af-46f8-bed8-9cf39b658847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:09.403716 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560bed8-79af-46f8-bed8-9cf39b658847 admin admin] PATH_INFO: `/v3/projects/3d3a7d96109e44bcb60d3af05bb090ad` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:09.404873 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560bed8-79af-46f8-bed8-9cf39b658847 admin admin] RBAC: Authorizing `identity:get_project(project_id=3d3a7d96109e44bcb60d3af05bb090ad)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:09.407487 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560bed8-79af-46f8-bed8-9cf39b658847 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:09.409091 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 571/1137] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:56:09 2021] GET /identity/v3/projects/3d3a7d96109e44bcb60d3af05bb090ad => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:09.415048 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fbda5-ecf7-4125-a2aa-a347cf4a798c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:09.423533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fbda5-ecf7-4125-a2aa-a347cf4a798c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:09.428008 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e02f7-bd85-4cab-ba50-5b08865cc732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:09.428606 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e02f7-bd85-4cab-ba50-5b08865cc732 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:09.428884 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e02f7-bd85-4cab-ba50-5b08865cc732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:09.429155 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e02f7-bd85-4cab-ba50-5b08865cc732 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:09.429966 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e02f7-bd85-4cab-ba50-5b08865cc732 admin admin] RBAC: Adding query filter params (role.id=e8e5c21f4bea46318bef0c9784214ce6, scope.project.id=3d3a7d96109e44bcb60d3af05bb090ad, user.id=098dbf3f30a84a719575aba117c18f15) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:56:09.430267 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e02f7-bd85-4cab-ba50-5b08865cc732 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:09.432060 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e02f7-bd85-4cab-ba50-5b08865cc732 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:09.437163 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 567/1138] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:56:09 2021] GET /identity/v3/role_assignments?user.id=098dbf3f30a84a719575aba117c18f15&scope.project.id=3d3a7d96109e44bcb60d3af05bb090ad&role.id=e8e5c21f4bea46318bef0c9784214ce6 => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:11.648120 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7aa61-d516-47ca-b2f0-a6cafae882fd None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:11.648675 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7aa61-d516-47ca-b2f0-a6cafae882fd None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:11.648675 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7aa61-d516-47ca-b2f0-a6cafae882fd None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:11.650448 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 572/1139] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:56:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:56:11.656371 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39254994-9f34-4bd7-99c2-623269bcc031 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:11.656784 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39254994-9f34-4bd7-99c2-623269bcc031 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:11.656931 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39254994-9f34-4bd7-99c2-623269bcc031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:11.674781 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-39254994-9f34-4bd7-99c2-623269bcc031 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:56:11.675997 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-39254994-9f34-4bd7-99c2-623269bcc031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:56:11.683625 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 568/1140] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:56:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:56:11.708513 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7aa61-d516-47ca-b2f0-a6cafae882fd None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:11.720479 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7aa61-d516-47ca-b2f0-a6cafae882fd None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:11.724882 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a5239-670c-4d30-82c3-371b349f386a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:11.725701 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a5239-670c-4d30-82c3-371b349f386a admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:11.725981 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a5239-670c-4d30-82c3-371b349f386a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:11.726252 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a5239-670c-4d30-82c3-371b349f386a admin admin] PATH_INFO: `/v3/roles/e8e5c21f4bea46318bef0c9784214ce6` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:11.727719 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a5239-670c-4d30-82c3-371b349f386a admin admin] RBAC: Authorizing `identity:get_role(role_id=e8e5c21f4bea46318bef0c9784214ce6)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:11.728707 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING py.warnings [None req-952a5239-670c-4d30-82c3-371b349f386a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:56:11.728707 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: warnings.warn(msg) Nov 23 03:56:11.728707 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: Nov 23 03:56:11.729563 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a5239-670c-4d30-82c3-371b349f386a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:11.730861 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 573/1141] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:56:11 2021] GET /identity/v3/roles/e8e5c21f4bea46318bef0c9784214ce6 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:11.737429 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39254994-9f34-4bd7-99c2-623269bcc031 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:11.746045 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39254994-9f34-4bd7-99c2-623269bcc031 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:11.751051 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275a691-4487-434f-958f-43c93465d687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:11.751920 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275a691-4487-434f-958f-43c93465d687 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:11.752198 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275a691-4487-434f-958f-43c93465d687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:11.752466 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275a691-4487-434f-958f-43c93465d687 admin admin] PATH_INFO: `/v3/users/098dbf3f30a84a719575aba117c18f15` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:11.753651 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275a691-4487-434f-958f-43c93465d687 admin admin] RBAC: Authorizing `identity:get_user(user_id=098dbf3f30a84a719575aba117c18f15)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:11.755747 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275a691-4487-434f-958f-43c93465d687 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:11.757272 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 569/1142] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:56:11 2021] GET /identity/v3/users/098dbf3f30a84a719575aba117c18f15 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:11.763013 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a5239-670c-4d30-82c3-371b349f386a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:11.772449 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a5239-670c-4d30-82c3-371b349f386a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:11.776834 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c3619-768c-46a5-834c-a6bc11d750f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:11.777623 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c3619-768c-46a5-834c-a6bc11d750f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:11.777900 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c3619-768c-46a5-834c-a6bc11d750f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:11.778168 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c3619-768c-46a5-834c-a6bc11d750f3 admin admin] PATH_INFO: `/v3/projects/3d3a7d96109e44bcb60d3af05bb090ad` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:11.779341 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c3619-768c-46a5-834c-a6bc11d750f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=3d3a7d96109e44bcb60d3af05bb090ad)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:11.781297 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c3619-768c-46a5-834c-a6bc11d750f3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:11.782880 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 574/1143] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:56:11 2021] GET /identity/v3/projects/3d3a7d96109e44bcb60d3af05bb090ad => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:11.788799 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275a691-4487-434f-958f-43c93465d687 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:11.798568 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275a691-4487-434f-958f-43c93465d687 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:11.803066 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa9799-e8d9-4847-a36f-460df80af4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:11.803934 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa9799-e8d9-4847-a36f-460df80af4dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:11.804217 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa9799-e8d9-4847-a36f-460df80af4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:11.804493 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa9799-e8d9-4847-a36f-460df80af4dc admin admin] PATH_INFO: `/v3/projects/3d3a7d96109e44bcb60d3af05bb090ad/users/098dbf3f30a84a719575aba117c18f15/roles/e8e5c21f4bea46318bef0c9784214ce6` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:11.806659 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa9799-e8d9-4847-a36f-460df80af4dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d3a7d96109e44bcb60d3af05bb090ad, user_id=098dbf3f30a84a719575aba117c18f15, role_id=e8e5c21f4bea46318bef0c9784214ce6)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:11.809219 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa9799-e8d9-4847-a36f-460df80af4dc admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:11.872928 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 570/1144] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:56:11 2021] PUT /identity/v3/projects/3d3a7d96109e44bcb60d3af05bb090ad/users/098dbf3f30a84a719575aba117c18f15/roles/e8e5c21f4bea46318bef0c9784214ce6 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 03:56:14.059431 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1a322-a5cb-44a5-98e1-af862fb2c950 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:14.059947 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1a322-a5cb-44a5-98e1-af862fb2c950 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:14.060037 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1a322-a5cb-44a5-98e1-af862fb2c950 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:14.061793 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 575/1145] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:56:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:56:14.068457 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec1b4b-6a3f-4feb-b333-b9ae0bfc68c2 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:14.068847 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec1b4b-6a3f-4feb-b333-b9ae0bfc68c2 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:14.069011 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec1b4b-6a3f-4feb-b333-b9ae0bfc68c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:14.086060 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-28ec1b4b-6a3f-4feb-b333-b9ae0bfc68c2 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:56:14.087269 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-28ec1b4b-6a3f-4feb-b333-b9ae0bfc68c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:56:14.143013 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 571/1146] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:56:14 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:56:14.167385 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1a322-a5cb-44a5-98e1-af862fb2c950 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:14.179623 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1a322-a5cb-44a5-98e1-af862fb2c950 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:14.183875 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f1eb4-a0c4-48b8-9683-eee1466c3bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:14.184695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f1eb4-a0c4-48b8-9683-eee1466c3bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:14.184973 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f1eb4-a0c4-48b8-9683-eee1466c3bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:14.185245 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f1eb4-a0c4-48b8-9683-eee1466c3bb4 admin admin] PATH_INFO: `/v3/roles/e8e5c21f4bea46318bef0c9784214ce6` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:14.186907 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f1eb4-a0c4-48b8-9683-eee1466c3bb4 admin admin] RBAC: Authorizing `identity:get_role(role_id=e8e5c21f4bea46318bef0c9784214ce6)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:14.188677 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f1eb4-a0c4-48b8-9683-eee1466c3bb4 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:14.190275 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 576/1147] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:56:14 2021] GET /identity/v3/roles/e8e5c21f4bea46318bef0c9784214ce6 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:14.196067 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec1b4b-6a3f-4feb-b333-b9ae0bfc68c2 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:14.204853 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec1b4b-6a3f-4feb-b333-b9ae0bfc68c2 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:14.209316 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231c401-f063-4bf3-b9a0-c170df987b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:14.210153 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231c401-f063-4bf3-b9a0-c170df987b68 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:14.210435 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231c401-f063-4bf3-b9a0-c170df987b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:14.210710 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231c401-f063-4bf3-b9a0-c170df987b68 admin admin] PATH_INFO: `/v3/users/098dbf3f30a84a719575aba117c18f15` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:14.211935 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231c401-f063-4bf3-b9a0-c170df987b68 admin admin] RBAC: Authorizing `identity:get_user(user_id=098dbf3f30a84a719575aba117c18f15)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:14.214015 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231c401-f063-4bf3-b9a0-c170df987b68 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:14.215599 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 572/1148] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:56:14 2021] GET /identity/v3/users/098dbf3f30a84a719575aba117c18f15 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:56:14.222049 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f1eb4-a0c4-48b8-9683-eee1466c3bb4 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:14.231202 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f1eb4-a0c4-48b8-9683-eee1466c3bb4 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:14.236272 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09e8a5-9249-4367-81e7-64eb27b0ddbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:14.236879 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09e8a5-9249-4367-81e7-64eb27b0ddbd admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:14.237159 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09e8a5-9249-4367-81e7-64eb27b0ddbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:14.237437 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09e8a5-9249-4367-81e7-64eb27b0ddbd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:14.244833 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09e8a5-9249-4367-81e7-64eb27b0ddbd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:14.246508 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09e8a5-9249-4367-81e7-64eb27b0ddbd admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:14.255801 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 577/1149] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:56:14 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 03:56:14.261737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231c401-f063-4bf3-b9a0-c170df987b68 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:14.270944 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231c401-f063-4bf3-b9a0-c170df987b68 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:14.275347 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871d44c-bd0c-4d53-a9d5-8be551786a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:14.276148 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871d44c-bd0c-4d53-a9d5-8be551786a14 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:14.276429 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871d44c-bd0c-4d53-a9d5-8be551786a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:14.276707 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871d44c-bd0c-4d53-a9d5-8be551786a14 admin admin] PATH_INFO: `/v3/projects/3d3a7d96109e44bcb60d3af05bb090ad` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:14.277865 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871d44c-bd0c-4d53-a9d5-8be551786a14 admin admin] RBAC: Authorizing `identity:get_project(project_id=3d3a7d96109e44bcb60d3af05bb090ad)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:14.279891 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871d44c-bd0c-4d53-a9d5-8be551786a14 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:14.281997 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 573/1150] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:56:14 2021] GET /identity/v3/projects/3d3a7d96109e44bcb60d3af05bb090ad => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:56:14.287991 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09e8a5-9249-4367-81e7-64eb27b0ddbd admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:14.296921 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09e8a5-9249-4367-81e7-64eb27b0ddbd admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:14.301403 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ec5cf-3f3a-4582-acfb-5fd43cba2eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:14.302014 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ec5cf-3f3a-4582-acfb-5fd43cba2eba admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:14.302294 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ec5cf-3f3a-4582-acfb-5fd43cba2eba admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:14.302567 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ec5cf-3f3a-4582-acfb-5fd43cba2eba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:14.303415 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ec5cf-3f3a-4582-acfb-5fd43cba2eba admin admin] RBAC: Adding query filter params (role.id=e8e5c21f4bea46318bef0c9784214ce6, scope.project.id=3d3a7d96109e44bcb60d3af05bb090ad, user.id=098dbf3f30a84a719575aba117c18f15) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:56:14.303728 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ec5cf-3f3a-4582-acfb-5fd43cba2eba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:14.305496 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ec5cf-3f3a-4582-acfb-5fd43cba2eba admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:14.311185 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 578/1151] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:56:14 2021] GET /identity/v3/role_assignments?user.id=098dbf3f30a84a719575aba117c18f15&scope.project.id=3d3a7d96109e44bcb60d3af05bb090ad&role.id=e8e5c21f4bea46318bef0c9784214ce6 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:56:16.552583 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3c077-1f80-40b2-8df0-599012fc78fa None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:16.553109 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3c077-1f80-40b2-8df0-599012fc78fa None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:16.553109 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3c077-1f80-40b2-8df0-599012fc78fa None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:16.554878 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 574/1152] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:56:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:56:16.560572 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fbbb8-a69f-4123-a26c-dcef2e7dc340 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:16.560961 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fbbb8-a69f-4123-a26c-dcef2e7dc340 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:16.561132 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fbbb8-a69f-4123-a26c-dcef2e7dc340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:16.579578 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-e03fbbb8-a69f-4123-a26c-dcef2e7dc340 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:56:16.580753 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e03fbbb8-a69f-4123-a26c-dcef2e7dc340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:56:16.588225 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 579/1153] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:56:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:56:16.611548 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3c077-1f80-40b2-8df0-599012fc78fa None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:16.623185 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3c077-1f80-40b2-8df0-599012fc78fa None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:16.628028 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255cbb2-3061-469c-b032-7f258083d1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:16.628775 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255cbb2-3061-469c-b032-7f258083d1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:16.629053 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255cbb2-3061-469c-b032-7f258083d1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:16.629323 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255cbb2-3061-469c-b032-7f258083d1c3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:16.630469 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255cbb2-3061-469c-b032-7f258083d1c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:16.632169 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255cbb2-3061-469c-b032-7f258083d1c3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:16.633679 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 575/1154] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:56:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:16.639516 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fbbb8-a69f-4123-a26c-dcef2e7dc340 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:16.648849 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fbbb8-a69f-4123-a26c-dcef2e7dc340 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:16.653272 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b9287-3c73-4a6d-ac1e-d9461087159c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:16.653906 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b9287-3c73-4a6d-ac1e-d9461087159c admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:16.654187 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b9287-3c73-4a6d-ac1e-d9461087159c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:16.654459 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b9287-3c73-4a6d-ac1e-d9461087159c admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:16.655163 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b9287-3c73-4a6d-ac1e-d9461087159c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:16.657165 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b9287-3c73-4a6d-ac1e-d9461087159c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:16.771976 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 580/1155] 10.222.0.54 () {60 vars in 1162 bytes} [Tue Nov 23 03:56:16 2021] POST /identity/v3/projects => generated 311 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:56:19.046466 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f53f8b-d29e-420b-a9b7-3f01318e04e7 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:19.046990 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f53f8b-d29e-420b-a9b7-3f01318e04e7 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:19.047078 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f53f8b-d29e-420b-a9b7-3f01318e04e7 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:19.048903 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 576/1156] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:56:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:56:19.054769 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01199041-5044-4c63-8663-07a0b718a02f None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:19.055251 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01199041-5044-4c63-8663-07a0b718a02f None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:19.055355 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01199041-5044-4c63-8663-07a0b718a02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:19.073943 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-01199041-5044-4c63-8663-07a0b718a02f None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:56:19.075130 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-01199041-5044-4c63-8663-07a0b718a02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:56:19.131227 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 581/1157] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:56:19 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:56:19.158315 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f53f8b-d29e-420b-a9b7-3f01318e04e7 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:19.170124 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f53f8b-d29e-420b-a9b7-3f01318e04e7 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:19.174929 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53444389-a176-4274-8eea-16962d8b795d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:19.175729 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53444389-a176-4274-8eea-16962d8b795d admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:19.176013 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53444389-a176-4274-8eea-16962d8b795d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:19.176288 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53444389-a176-4274-8eea-16962d8b795d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:19.177453 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53444389-a176-4274-8eea-16962d8b795d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:19.179107 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53444389-a176-4274-8eea-16962d8b795d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:19.180677 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 577/1158] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:56:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:56:19.187112 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01199041-5044-4c63-8663-07a0b718a02f None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:19.195975 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01199041-5044-4c63-8663-07a0b718a02f None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:19.200393 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5e0a9-9e3d-4509-884e-9d8cdaa3af6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:19.201037 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5e0a9-9e3d-4509-884e-9d8cdaa3af6d admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:19.201321 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5e0a9-9e3d-4509-884e-9d8cdaa3af6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:19.201601 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5e0a9-9e3d-4509-884e-9d8cdaa3af6d admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:19.202360 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5e0a9-9e3d-4509-884e-9d8cdaa3af6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:19.204264 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5e0a9-9e3d-4509-884e-9d8cdaa3af6d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:19.286028 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 582/1159] 10.222.0.54 () {60 vars in 1153 bytes} [Tue Nov 23 03:56:19 2021] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:56:21.560825 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06188218-1918-4c51-90fb-9152263f2523 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:21.561393 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06188218-1918-4c51-90fb-9152263f2523 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:21.561486 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06188218-1918-4c51-90fb-9152263f2523 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:21.563233 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 578/1160] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:56:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:56:21.569482 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6e257-d904-455b-b453-73637a813b12 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:21.569916 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6e257-d904-455b-b453-73637a813b12 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:21.570056 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6e257-d904-455b-b453-73637a813b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:21.588349 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-69a6e257-d904-455b-b453-73637a813b12 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:56:21.589531 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-69a6e257-d904-455b-b453-73637a813b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:56:21.598058 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 583/1161] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:56:21 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:56:21.622282 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06188218-1918-4c51-90fb-9152263f2523 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:21.635521 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06188218-1918-4c51-90fb-9152263f2523 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:21.639896 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9e84f-a38b-4f1c-8be0-e061ea846b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:21.640794 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9e84f-a38b-4f1c-8be0-e061ea846b33 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:21.641075 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9e84f-a38b-4f1c-8be0-e061ea846b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:21.641354 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9e84f-a38b-4f1c-8be0-e061ea846b33 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:21.651310 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9e84f-a38b-4f1c-8be0-e061ea846b33 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:56:21.658686 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-1de9e84f-a38b-4f1c-8be0-e061ea846b33 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:56:21.659871 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 579/1162] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:56:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:56:21.666598 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6e257-d904-455b-b453-73637a813b12 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:21.676173 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6e257-d904-455b-b453-73637a813b12 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:21.681438 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a4b4d-4d6e-471d-9461-c707b760dbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:21.682106 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a4b4d-4d6e-471d-9461-c707b760dbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:21.682391 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a4b4d-4d6e-471d-9461-c707b760dbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:21.682662 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a4b4d-4d6e-471d-9461-c707b760dbb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:21.683460 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a4b4d-4d6e-471d-9461-c707b760dbb8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:56:21.683766 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a4b4d-4d6e-471d-9461-c707b760dbb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:21.685348 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a4b4d-4d6e-471d-9461-c707b760dbb8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:21.694403 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 584/1163] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:56:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:56:21.701004 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9e84f-a38b-4f1c-8be0-e061ea846b33 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:21.711186 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9e84f-a38b-4f1c-8be0-e061ea846b33 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:21.715756 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcc16b-9377-412c-bf9a-b79679a2721a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:21.716593 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcc16b-9377-412c-bf9a-b79679a2721a admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:21.716872 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcc16b-9377-412c-bf9a-b79679a2721a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:21.717143 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcc16b-9377-412c-bf9a-b79679a2721a admin admin] PATH_INFO: `/v3/users/02f87349bd3e47ebadb85997a21954aa` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:21.730797 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcc16b-9377-412c-bf9a-b79679a2721a admin admin] RBAC: Authorizing `identity:get_user(user_id=02f87349bd3e47ebadb85997a21954aa)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:21.732943 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcc16b-9377-412c-bf9a-b79679a2721a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:21.735442 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 580/1164] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:56:21 2021] GET /identity/v3/users/02f87349bd3e47ebadb85997a21954aa => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:21.741759 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a4b4d-4d6e-471d-9461-c707b760dbb8 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:21.752091 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a4b4d-4d6e-471d-9461-c707b760dbb8 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:21.756695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6d0d3-124f-444c-abe3-b5c55f6cea62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:21.757343 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6d0d3-124f-444c-abe3-b5c55f6cea62 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:21.757630 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6d0d3-124f-444c-abe3-b5c55f6cea62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:21.757912 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6d0d3-124f-444c-abe3-b5c55f6cea62 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:21.766555 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6d0d3-124f-444c-abe3-b5c55f6cea62 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:21.768340 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6d0d3-124f-444c-abe3-b5c55f6cea62 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:21.777314 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 585/1165] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:56:21 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 03:56:21.784882 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcc16b-9377-412c-bf9a-b79679a2721a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:21.794480 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcc16b-9377-412c-bf9a-b79679a2721a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:21.799721 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb37d38-b3e7-4f6a-9a53-2d9c494a6d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:21.800556 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb37d38-b3e7-4f6a-9a53-2d9c494a6d39 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:21.800837 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb37d38-b3e7-4f6a-9a53-2d9c494a6d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:21.801111 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb37d38-b3e7-4f6a-9a53-2d9c494a6d39 admin admin] PATH_INFO: `/v3/projects/178fb47a69d84c1c88d4c0489837ff28` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:21.802296 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb37d38-b3e7-4f6a-9a53-2d9c494a6d39 admin admin] RBAC: Authorizing `identity:get_project(project_id=178fb47a69d84c1c88d4c0489837ff28)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:21.804346 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb37d38-b3e7-4f6a-9a53-2d9c494a6d39 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:21.805998 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 581/1166] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:56:21 2021] GET /identity/v3/projects/178fb47a69d84c1c88d4c0489837ff28 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:21.813106 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6d0d3-124f-444c-abe3-b5c55f6cea62 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:21.822241 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6d0d3-124f-444c-abe3-b5c55f6cea62 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:21.826765 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57563e0e-36ef-40db-b633-202294e16e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:21.827988 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57563e0e-36ef-40db-b633-202294e16e07 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:21.828254 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57563e0e-36ef-40db-b633-202294e16e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:21.828531 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57563e0e-36ef-40db-b633-202294e16e07 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:21.829364 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57563e0e-36ef-40db-b633-202294e16e07 admin admin] RBAC: Adding query filter params (role.id=3db7012b41944542a50049819500eadd, scope.project.id=178fb47a69d84c1c88d4c0489837ff28, user.id=02f87349bd3e47ebadb85997a21954aa) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:56:21.829676 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57563e0e-36ef-40db-b633-202294e16e07 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:21.831519 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57563e0e-36ef-40db-b633-202294e16e07 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:21.836714 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 586/1167] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:56:21 2021] GET /identity/v3/role_assignments?user.id=02f87349bd3e47ebadb85997a21954aa&scope.project.id=178fb47a69d84c1c88d4c0489837ff28&role.id=3db7012b41944542a50049819500eadd => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:24.043439 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f7ae7-4374-4fe3-836e-df3afec82b7e None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:24.043985 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f7ae7-4374-4fe3-836e-df3afec82b7e None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:24.043985 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f7ae7-4374-4fe3-836e-df3afec82b7e None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:24.046476 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 582/1168] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:56:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:56:24.052477 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631f4a8-b5d3-4ba2-ba70-24db83b0ad75 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:24.052845 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631f4a8-b5d3-4ba2-ba70-24db83b0ad75 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:24.053030 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631f4a8-b5d3-4ba2-ba70-24db83b0ad75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:24.071383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-0631f4a8-b5d3-4ba2-ba70-24db83b0ad75 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:56:24.072547 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-0631f4a8-b5d3-4ba2-ba70-24db83b0ad75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:56:24.080250 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 587/1169] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:56:24 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:56:24.103866 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f7ae7-4374-4fe3-836e-df3afec82b7e None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:24.116500 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f7ae7-4374-4fe3-836e-df3afec82b7e None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:24.120863 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370ee6e-1996-49c8-a4f8-d7842a604607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:24.121621 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370ee6e-1996-49c8-a4f8-d7842a604607 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:24.121904 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370ee6e-1996-49c8-a4f8-d7842a604607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:24.122179 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370ee6e-1996-49c8-a4f8-d7842a604607 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:24.132375 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370ee6e-1996-49c8-a4f8-d7842a604607 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:56:24.139229 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-d370ee6e-1996-49c8-a4f8-d7842a604607 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:56:24.140634 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 583/1170] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:56:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:56:24.147266 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631f4a8-b5d3-4ba2-ba70-24db83b0ad75 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:24.156504 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631f4a8-b5d3-4ba2-ba70-24db83b0ad75 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:24.160873 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005aafa1-4d07-4c78-b282-ab7271555986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:24.161511 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005aafa1-4d07-4c78-b282-ab7271555986 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:24.161789 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005aafa1-4d07-4c78-b282-ab7271555986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:24.162061 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005aafa1-4d07-4c78-b282-ab7271555986 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:24.162807 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005aafa1-4d07-4c78-b282-ab7271555986 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:56:24.163110 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005aafa1-4d07-4c78-b282-ab7271555986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:24.164703 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005aafa1-4d07-4c78-b282-ab7271555986 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:24.173365 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 588/1171] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:56:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:56:24.179388 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370ee6e-1996-49c8-a4f8-d7842a604607 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:24.189854 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370ee6e-1996-49c8-a4f8-d7842a604607 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:24.194318 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389dc6e-dd1f-47c2-8da4-950493796128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:24.195147 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389dc6e-dd1f-47c2-8da4-950493796128 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:24.195456 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389dc6e-dd1f-47c2-8da4-950493796128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:24.195735 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389dc6e-dd1f-47c2-8da4-950493796128 admin admin] PATH_INFO: `/v3/users/02f87349bd3e47ebadb85997a21954aa` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:24.196927 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389dc6e-dd1f-47c2-8da4-950493796128 admin admin] RBAC: Authorizing `identity:get_user(user_id=02f87349bd3e47ebadb85997a21954aa)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:24.199007 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389dc6e-dd1f-47c2-8da4-950493796128 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:24.200709 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 584/1172] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:56:24 2021] GET /identity/v3/users/02f87349bd3e47ebadb85997a21954aa => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:24.206944 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005aafa1-4d07-4c78-b282-ab7271555986 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:24.216141 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005aafa1-4d07-4c78-b282-ab7271555986 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:24.221311 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db086c11-22a1-4449-827e-f1e615c8d05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:24.222135 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db086c11-22a1-4449-827e-f1e615c8d05a admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:24.222418 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db086c11-22a1-4449-827e-f1e615c8d05a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:24.222695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db086c11-22a1-4449-827e-f1e615c8d05a admin admin] PATH_INFO: `/v3/projects/178fb47a69d84c1c88d4c0489837ff28` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:24.223936 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db086c11-22a1-4449-827e-f1e615c8d05a admin admin] RBAC: Authorizing `identity:get_project(project_id=178fb47a69d84c1c88d4c0489837ff28)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:24.225923 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db086c11-22a1-4449-827e-f1e615c8d05a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:24.227587 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 589/1173] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:56:24 2021] GET /identity/v3/projects/178fb47a69d84c1c88d4c0489837ff28 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:56:24.233491 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389dc6e-dd1f-47c2-8da4-950493796128 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:24.242700 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389dc6e-dd1f-47c2-8da4-950493796128 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:24.247127 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba49913-1059-40f1-a5c6-b806e33f3276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:24.247991 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba49913-1059-40f1-a5c6-b806e33f3276 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:24.248274 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba49913-1059-40f1-a5c6-b806e33f3276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:24.248551 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba49913-1059-40f1-a5c6-b806e33f3276 admin admin] PATH_INFO: `/v3/projects/178fb47a69d84c1c88d4c0489837ff28/users/02f87349bd3e47ebadb85997a21954aa/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:24.250742 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba49913-1059-40f1-a5c6-b806e33f3276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=178fb47a69d84c1c88d4c0489837ff28, user_id=02f87349bd3e47ebadb85997a21954aa, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:24.253343 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba49913-1059-40f1-a5c6-b806e33f3276 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:24.318861 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 585/1174] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:56:24 2021] PUT /identity/v3/projects/178fb47a69d84c1c88d4c0489837ff28/users/02f87349bd3e47ebadb85997a21954aa/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 03:56:26.521050 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8021f-a980-44c1-a4c4-a7862db65a28 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:26.521569 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8021f-a980-44c1-a4c4-a7862db65a28 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:26.521658 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8021f-a980-44c1-a4c4-a7862db65a28 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:26.523412 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 590/1175] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:56:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:56:26.529281 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0c487-3b2c-4ab2-9c95-dfbb993a89ed None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:26.529678 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0c487-3b2c-4ab2-9c95-dfbb993a89ed None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:26.529863 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0c487-3b2c-4ab2-9c95-dfbb993a89ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:26.547502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-b7f0c487-3b2c-4ab2-9c95-dfbb993a89ed None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:56:26.548683 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-b7f0c487-3b2c-4ab2-9c95-dfbb993a89ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:56:26.603136 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 586/1176] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:56:26 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:56:26.628470 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8021f-a980-44c1-a4c4-a7862db65a28 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:26.640713 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8021f-a980-44c1-a4c4-a7862db65a28 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:26.645023 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0008b6b-99c4-4f02-9487-11ffcc832864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:26.645782 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0008b6b-99c4-4f02-9487-11ffcc832864 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:26.646063 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0008b6b-99c4-4f02-9487-11ffcc832864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:26.646335 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0008b6b-99c4-4f02-9487-11ffcc832864 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:26.656861 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0008b6b-99c4-4f02-9487-11ffcc832864 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:56:26.663639 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-f0008b6b-99c4-4f02-9487-11ffcc832864 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:56:26.664774 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 591/1177] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:56:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:56:26.671280 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0c487-3b2c-4ab2-9c95-dfbb993a89ed None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:26.680057 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0c487-3b2c-4ab2-9c95-dfbb993a89ed None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:26.684510 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820fe62-db21-44f5-a86f-8149df95c00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:26.685155 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820fe62-db21-44f5-a86f-8149df95c00f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:26.685436 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820fe62-db21-44f5-a86f-8149df95c00f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:26.685709 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820fe62-db21-44f5-a86f-8149df95c00f admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:26.686672 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820fe62-db21-44f5-a86f-8149df95c00f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:56:26.686978 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820fe62-db21-44f5-a86f-8149df95c00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:26.688590 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820fe62-db21-44f5-a86f-8149df95c00f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:26.696858 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 587/1178] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:56:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:26.703476 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0008b6b-99c4-4f02-9487-11ffcc832864 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:26.713331 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0008b6b-99c4-4f02-9487-11ffcc832864 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:26.718402 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9d8d2-5e11-4420-a45b-22a61badaa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:26.719246 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9d8d2-5e11-4420-a45b-22a61badaa2f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:26.719530 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9d8d2-5e11-4420-a45b-22a61badaa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:26.719802 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9d8d2-5e11-4420-a45b-22a61badaa2f admin admin] PATH_INFO: `/v3/users/02f87349bd3e47ebadb85997a21954aa` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:26.720979 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9d8d2-5e11-4420-a45b-22a61badaa2f admin admin] RBAC: Authorizing `identity:get_user(user_id=02f87349bd3e47ebadb85997a21954aa)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:26.723095 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9d8d2-5e11-4420-a45b-22a61badaa2f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:26.724700 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 592/1179] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:56:26 2021] GET /identity/v3/users/02f87349bd3e47ebadb85997a21954aa => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:26.730478 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820fe62-db21-44f5-a86f-8149df95c00f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:26.739726 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820fe62-db21-44f5-a86f-8149df95c00f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:26.744082 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03095301-9b59-4263-a530-470f9c15e2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:26.744685 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03095301-9b59-4263-a530-470f9c15e2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:26.744965 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03095301-9b59-4263-a530-470f9c15e2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:26.745236 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03095301-9b59-4263-a530-470f9c15e2b9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:26.752855 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03095301-9b59-4263-a530-470f9c15e2b9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:26.754541 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03095301-9b59-4263-a530-470f9c15e2b9 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:26.762962 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 588/1180] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:56:26 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 03:56:26.769536 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9d8d2-5e11-4420-a45b-22a61badaa2f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:26.778727 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9d8d2-5e11-4420-a45b-22a61badaa2f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:26.783767 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003cd43-1b09-4d6d-804b-7d275a802bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:26.784574 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003cd43-1b09-4d6d-804b-7d275a802bed admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:26.784855 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003cd43-1b09-4d6d-804b-7d275a802bed admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:26.785126 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003cd43-1b09-4d6d-804b-7d275a802bed admin admin] PATH_INFO: `/v3/projects/178fb47a69d84c1c88d4c0489837ff28` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:26.786277 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003cd43-1b09-4d6d-804b-7d275a802bed admin admin] RBAC: Authorizing `identity:get_project(project_id=178fb47a69d84c1c88d4c0489837ff28)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:26.788276 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003cd43-1b09-4d6d-804b-7d275a802bed admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:26.790007 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 593/1181] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:56:26 2021] GET /identity/v3/projects/178fb47a69d84c1c88d4c0489837ff28 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:26.796014 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03095301-9b59-4263-a530-470f9c15e2b9 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:26.804437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03095301-9b59-4263-a530-470f9c15e2b9 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:26.808910 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6e153-2355-4db2-a46a-e847b58cd80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:26.809517 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6e153-2355-4db2-a46a-e847b58cd80c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:26.809799 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6e153-2355-4db2-a46a-e847b58cd80c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:26.810072 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6e153-2355-4db2-a46a-e847b58cd80c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:26.810885 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6e153-2355-4db2-a46a-e847b58cd80c admin admin] RBAC: Adding query filter params (role.id=3db7012b41944542a50049819500eadd, scope.project.id=178fb47a69d84c1c88d4c0489837ff28, user.id=02f87349bd3e47ebadb85997a21954aa) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:56:26.811386 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6e153-2355-4db2-a46a-e847b58cd80c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:26.813153 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6e153-2355-4db2-a46a-e847b58cd80c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:26.818948 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 589/1182] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:56:26 2021] GET /identity/v3/role_assignments?user.id=02f87349bd3e47ebadb85997a21954aa&scope.project.id=178fb47a69d84c1c88d4c0489837ff28&role.id=3db7012b41944542a50049819500eadd => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:29.060656 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc7283-3366-47d3-8632-729a1c5aca61 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:29.061244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc7283-3366-47d3-8632-729a1c5aca61 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:29.061244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc7283-3366-47d3-8632-729a1c5aca61 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:29.063572 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 594/1183] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:56:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:56:29.069491 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716d049-4b6a-49ed-8f62-719cfbc4e4b1 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:29.069932 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716d049-4b6a-49ed-8f62-719cfbc4e4b1 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:29.070036 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716d049-4b6a-49ed-8f62-719cfbc4e4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:29.087611 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-2716d049-4b6a-49ed-8f62-719cfbc4e4b1 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:56:29.088790 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-2716d049-4b6a-49ed-8f62-719cfbc4e4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:56:29.097249 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 590/1184] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:56:29 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:56:29.121131 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc7283-3366-47d3-8632-729a1c5aca61 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:29.132999 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc7283-3366-47d3-8632-729a1c5aca61 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:29.137302 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e2704-56f2-4be6-ac52-55ba5ba0df8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:29.137919 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e2704-56f2-4be6-ac52-55ba5ba0df8e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:29.138201 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e2704-56f2-4be6-ac52-55ba5ba0df8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:29.138474 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e2704-56f2-4be6-ac52-55ba5ba0df8e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:29.146372 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e2704-56f2-4be6-ac52-55ba5ba0df8e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:29.148131 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e2704-56f2-4be6-ac52-55ba5ba0df8e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:29.157241 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 595/1185] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:56:29 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 03:56:29.163357 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716d049-4b6a-49ed-8f62-719cfbc4e4b1 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:29.173207 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716d049-4b6a-49ed-8f62-719cfbc4e4b1 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:29.177760 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c06ca9-619a-453c-9931-9fc0ed3d2e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:29.178529 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c06ca9-619a-453c-9931-9fc0ed3d2e8e admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:29.178814 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c06ca9-619a-453c-9931-9fc0ed3d2e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:29.179088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c06ca9-619a-453c-9931-9fc0ed3d2e8e admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:29.185844 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c06ca9-619a-453c-9931-9fc0ed3d2e8e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:29.188243 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c06ca9-619a-453c-9931-9fc0ed3d2e8e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:29.203881 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-23c06ca9-619a-453c-9931-9fc0ed3d2e8e admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Nov 23 03:56:29.204981 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 591/1186] 10.222.0.54 () {56 vars in 1138 bytes} [Tue Nov 23 03:56:29 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:56:29.211140 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e2704-56f2-4be6-ac52-55ba5ba0df8e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:29.220192 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e2704-56f2-4be6-ac52-55ba5ba0df8e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:29.224959 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05181e96-9ca6-4c77-98c9-f4c65832379f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:29.225586 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05181e96-9ca6-4c77-98c9-f4c65832379f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:29.225868 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05181e96-9ca6-4c77-98c9-f4c65832379f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:29.226151 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05181e96-9ca6-4c77-98c9-f4c65832379f admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:29.226860 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05181e96-9ca6-4c77-98c9-f4c65832379f admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:56:29.227161 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05181e96-9ca6-4c77-98c9-f4c65832379f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:29.228716 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05181e96-9ca6-4c77-98c9-f4c65832379f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:29.236330 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 596/1187] 10.222.0.54 () {56 vars in 1136 bytes} [Tue Nov 23 03:56:29 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:56:31.476824 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba50d0-824f-4666-9e9e-e02bfe264ea5 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:31.477376 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba50d0-824f-4666-9e9e-e02bfe264ea5 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:31.477376 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba50d0-824f-4666-9e9e-e02bfe264ea5 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:31.479132 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 592/1188] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:56:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:56:31.485521 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490dce0c-e0a9-49f4-8597-9d56f904365d None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:31.485938 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490dce0c-e0a9-49f4-8597-9d56f904365d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:31.486304 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490dce0c-e0a9-49f4-8597-9d56f904365d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:31.503649 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-490dce0c-e0a9-49f4-8597-9d56f904365d None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:56:31.504836 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-490dce0c-e0a9-49f4-8597-9d56f904365d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:56:31.512439 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 597/1189] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:56:31 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:56:31.537040 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba50d0-824f-4666-9e9e-e02bfe264ea5 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:31.549467 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba50d0-824f-4666-9e9e-e02bfe264ea5 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:31.553797 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca0354-a9f1-4e61-8c33-8bfc785ac475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:31.554425 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca0354-a9f1-4e61-8c33-8bfc785ac475 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:31.554705 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca0354-a9f1-4e61-8c33-8bfc785ac475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:31.554977 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca0354-a9f1-4e61-8c33-8bfc785ac475 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:31.555754 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca0354-a9f1-4e61-8c33-8bfc785ac475 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:31.556753 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING py.warnings [None req-73ca0354-a9f1-4e61-8c33-8bfc785ac475 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 03:56:31.556753 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: warnings.warn(msg) Nov 23 03:56:31.556753 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: Nov 23 03:56:31.557608 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca0354-a9f1-4e61-8c33-8bfc785ac475 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:31.663649 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 593/1190] 10.222.0.54 () {60 vars in 1159 bytes} [Tue Nov 23 03:56:31 2021] POST /identity/v3/domains => generated 267 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:56:33.919478 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f609b-bbde-4b9e-b8ff-d90c900d7dd4 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:33.920027 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f609b-bbde-4b9e-b8ff-d90c900d7dd4 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:33.920027 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f609b-bbde-4b9e-b8ff-d90c900d7dd4 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:33.922363 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 598/1191] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:56:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:56:33.928083 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff781bd-824f-4974-ba6d-a2b0e3b4f8cb None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:33.928485 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff781bd-824f-4974-ba6d-a2b0e3b4f8cb None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:33.928646 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff781bd-824f-4974-ba6d-a2b0e3b4f8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:33.946665 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-eff781bd-824f-4974-ba6d-a2b0e3b4f8cb None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:56:33.947802 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-eff781bd-824f-4974-ba6d-a2b0e3b4f8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:56:34.002796 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 594/1192] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:56:33 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:56:34.027496 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f609b-bbde-4b9e-b8ff-d90c900d7dd4 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:34.039423 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f609b-bbde-4b9e-b8ff-d90c900d7dd4 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:34.043650 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77169d-3105-4d52-b55d-daf272172495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:34.044470 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77169d-3105-4d52-b55d-daf272172495 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:34.044747 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77169d-3105-4d52-b55d-daf272172495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:34.045508 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77169d-3105-4d52-b55d-daf272172495 admin admin] PATH_INFO: `/v3/domains/fa5ca961db4745bcad03e6042c41aaa7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:34.055715 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77169d-3105-4d52-b55d-daf272172495 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=fa5ca961db4745bcad03e6042c41aaa7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:34.057634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77169d-3105-4d52-b55d-daf272172495 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:34.059199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 599/1193] 10.222.0.54 () {56 vars in 1204 bytes} [Tue Nov 23 03:56:34 2021] GET /identity/v3/domains/fa5ca961db4745bcad03e6042c41aaa7 => generated 267 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:34.066075 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff781bd-824f-4974-ba6d-a2b0e3b4f8cb None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:34.074702 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff781bd-824f-4974-ba6d-a2b0e3b4f8cb None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:34.079173 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31881de4-c18f-40da-a489-2fcfe49f53e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:34.079842 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31881de4-c18f-40da-a489-2fcfe49f53e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:34.080121 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31881de4-c18f-40da-a489-2fcfe49f53e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:34.080397 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31881de4-c18f-40da-a489-2fcfe49f53e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:34.081107 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31881de4-c18f-40da-a489-2fcfe49f53e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:34.082961 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31881de4-c18f-40da-a489-2fcfe49f53e0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:34.199938 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 595/1194] 10.222.0.54 () {60 vars in 1162 bytes} [Tue Nov 23 03:56:34 2021] POST /identity/v3/projects => generated 361 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:56:36.478656 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7cf1c-5b70-440e-94df-b776de60893b None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:36.479186 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7cf1c-5b70-440e-94df-b776de60893b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:36.479186 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7cf1c-5b70-440e-94df-b776de60893b None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:36.480997 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 600/1195] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:56:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:56:36.486819 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dc2f2-3b5e-4884-b835-83611ee7df92 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:36.487276 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dc2f2-3b5e-4884-b835-83611ee7df92 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:36.487468 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dc2f2-3b5e-4884-b835-83611ee7df92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:36.504993 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-5c7dc2f2-3b5e-4884-b835-83611ee7df92 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:56:36.506179 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-5c7dc2f2-3b5e-4884-b835-83611ee7df92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:56:36.562456 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 596/1196] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:56:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:56:36.588318 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7cf1c-5b70-440e-94df-b776de60893b None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:36.600752 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7cf1c-5b70-440e-94df-b776de60893b None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:36.604998 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff280d8-bdcc-4176-a969-b36aed88d3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:36.605818 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff280d8-bdcc-4176-a969-b36aed88d3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:36.606094 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff280d8-bdcc-4176-a969-b36aed88d3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:36.606366 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff280d8-bdcc-4176-a969-b36aed88d3d6 admin admin] PATH_INFO: `/v3/domains/fa5ca961db4745bcad03e6042c41aaa7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:36.607585 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff280d8-bdcc-4176-a969-b36aed88d3d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=fa5ca961db4745bcad03e6042c41aaa7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:36.609558 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff280d8-bdcc-4176-a969-b36aed88d3d6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:36.611097 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 601/1197] 10.222.0.54 () {56 vars in 1204 bytes} [Tue Nov 23 03:56:36 2021] GET /identity/v3/domains/fa5ca961db4745bcad03e6042c41aaa7 => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:36.616987 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dc2f2-3b5e-4884-b835-83611ee7df92 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:36.626271 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dc2f2-3b5e-4884-b835-83611ee7df92 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:36.630704 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d99f3d-2bf5-455e-b9de-d8a3a1632518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:36.631374 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d99f3d-2bf5-455e-b9de-d8a3a1632518 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:36.631659 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d99f3d-2bf5-455e-b9de-d8a3a1632518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:36.631938 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d99f3d-2bf5-455e-b9de-d8a3a1632518 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:36.632655 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d99f3d-2bf5-455e-b9de-d8a3a1632518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:36.634528 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d99f3d-2bf5-455e-b9de-d8a3a1632518 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:36.709139 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 597/1198] 10.222.0.54 () {60 vars in 1153 bytes} [Tue Nov 23 03:56:36 2021] POST /identity/v3/users => generated 311 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:56:38.969876 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d057f-6d9f-47ae-8ffd-cfb23b6e5158 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:38.970380 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d057f-6d9f-47ae-8ffd-cfb23b6e5158 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:38.970380 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d057f-6d9f-47ae-8ffd-cfb23b6e5158 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:38.972184 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 602/1199] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:56:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:56:38.977969 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9196229-2f46-4fcd-b650-c5c9437da66b None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:38.978412 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9196229-2f46-4fcd-b650-c5c9437da66b None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:38.978512 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9196229-2f46-4fcd-b650-c5c9437da66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:38.995595 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-c9196229-2f46-4fcd-b650-c5c9437da66b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:56:38.996764 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c9196229-2f46-4fcd-b650-c5c9437da66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:56:39.004781 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 598/1200] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:56:38 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:56:39.029289 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d057f-6d9f-47ae-8ffd-cfb23b6e5158 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:39.041080 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d057f-6d9f-47ae-8ffd-cfb23b6e5158 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:39.045379 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894dc50-9589-406f-b621-f81a2396c967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:39.046134 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894dc50-9589-406f-b621-f81a2396c967 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:39.046418 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894dc50-9589-406f-b621-f81a2396c967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:39.046695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894dc50-9589-406f-b621-f81a2396c967 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:39.057103 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894dc50-9589-406f-b621-f81a2396c967 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:56:39.064724 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-e894dc50-9589-406f-b621-f81a2396c967 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:56:39.065847 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 603/1201] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:56:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:56:39.071979 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9196229-2f46-4fcd-b650-c5c9437da66b None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:39.080802 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9196229-2f46-4fcd-b650-c5c9437da66b None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:39.085214 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952e18a-0fb7-4a79-a5db-933df9b83482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:39.085854 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952e18a-0fb7-4a79-a5db-933df9b83482 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:39.086135 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952e18a-0fb7-4a79-a5db-933df9b83482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:39.086410 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952e18a-0fb7-4a79-a5db-933df9b83482 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:39.087164 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952e18a-0fb7-4a79-a5db-933df9b83482 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:56:39.087508 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952e18a-0fb7-4a79-a5db-933df9b83482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:39.089079 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952e18a-0fb7-4a79-a5db-933df9b83482 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:39.097567 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 599/1202] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:56:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:39.103550 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894dc50-9589-406f-b621-f81a2396c967 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:39.113552 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894dc50-9589-406f-b621-f81a2396c967 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:39.117967 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c1f0a-6109-4c00-ba76-8152d26b8c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:39.118797 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c1f0a-6109-4c00-ba76-8152d26b8c0e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:39.119085 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c1f0a-6109-4c00-ba76-8152d26b8c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:39.119395 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c1f0a-6109-4c00-ba76-8152d26b8c0e admin admin] PATH_INFO: `/v3/users/a0f9803230fa4eccaf319fedb4a95f63` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:39.132440 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c1f0a-6109-4c00-ba76-8152d26b8c0e admin admin] RBAC: Authorizing `identity:get_user(user_id=a0f9803230fa4eccaf319fedb4a95f63)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:39.134534 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c1f0a-6109-4c00-ba76-8152d26b8c0e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:39.136157 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 604/1203] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:56:39 2021] GET /identity/v3/users/a0f9803230fa4eccaf319fedb4a95f63 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:39.142234 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952e18a-0fb7-4a79-a5db-933df9b83482 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:39.151563 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952e18a-0fb7-4a79-a5db-933df9b83482 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:39.156545 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d940c-50ce-420d-af41-7a7fcc2cd61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:39.157164 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d940c-50ce-420d-af41-7a7fcc2cd61d admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:39.157445 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d940c-50ce-420d-af41-7a7fcc2cd61d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:39.157717 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d940c-50ce-420d-af41-7a7fcc2cd61d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:39.165196 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d940c-50ce-420d-af41-7a7fcc2cd61d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:39.166914 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d940c-50ce-420d-af41-7a7fcc2cd61d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:39.176010 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 600/1204] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:56:39 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 03:56:39.182004 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c1f0a-6109-4c00-ba76-8152d26b8c0e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:39.191591 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c1f0a-6109-4c00-ba76-8152d26b8c0e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:39.195987 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86e785-25f7-4dcc-bac7-08c5e3f5132b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:39.196802 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86e785-25f7-4dcc-bac7-08c5e3f5132b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:39.197080 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86e785-25f7-4dcc-bac7-08c5e3f5132b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:39.197352 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86e785-25f7-4dcc-bac7-08c5e3f5132b admin admin] PATH_INFO: `/v3/projects/a50d8be7b3c44a01a0e8f44dccd2ddd8` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:39.198492 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86e785-25f7-4dcc-bac7-08c5e3f5132b admin admin] RBAC: Authorizing `identity:get_project(project_id=a50d8be7b3c44a01a0e8f44dccd2ddd8)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:39.200505 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86e785-25f7-4dcc-bac7-08c5e3f5132b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:39.202640 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 605/1205] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:56:39 2021] GET /identity/v3/projects/a50d8be7b3c44a01a0e8f44dccd2ddd8 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:39.208661 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d940c-50ce-420d-af41-7a7fcc2cd61d admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:39.217644 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d940c-50ce-420d-af41-7a7fcc2cd61d admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:39.222229 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af312f5f-ab25-46ea-9931-0f0a80bae633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:39.222788 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af312f5f-ab25-46ea-9931-0f0a80bae633 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:39.223070 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af312f5f-ab25-46ea-9931-0f0a80bae633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:39.223382 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af312f5f-ab25-46ea-9931-0f0a80bae633 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:39.224227 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af312f5f-ab25-46ea-9931-0f0a80bae633 admin admin] RBAC: Adding query filter params (role.id=3db7012b41944542a50049819500eadd, scope.project.id=a50d8be7b3c44a01a0e8f44dccd2ddd8, user.id=a0f9803230fa4eccaf319fedb4a95f63) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:56:39.224535 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af312f5f-ab25-46ea-9931-0f0a80bae633 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:39.226305 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af312f5f-ab25-46ea-9931-0f0a80bae633 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:39.231435 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 601/1206] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:56:39 2021] GET /identity/v3/role_assignments?user.id=a0f9803230fa4eccaf319fedb4a95f63&scope.project.id=a50d8be7b3c44a01a0e8f44dccd2ddd8&role.id=3db7012b41944542a50049819500eadd => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:41.416118 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d582ccd-4b2d-4d15-bced-d64267228383 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:41.416684 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d582ccd-4b2d-4d15-bced-d64267228383 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:41.416684 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d582ccd-4b2d-4d15-bced-d64267228383 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:41.418441 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 606/1207] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:56:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:56:41.424635 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3de218-ac43-462e-b2a3-0ef3dbc9118d None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:41.425071 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3de218-ac43-462e-b2a3-0ef3dbc9118d None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:41.425188 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3de218-ac43-462e-b2a3-0ef3dbc9118d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:41.442533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-3d3de218-ac43-462e-b2a3-0ef3dbc9118d None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:56:41.443731 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-3d3de218-ac43-462e-b2a3-0ef3dbc9118d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:56:41.451556 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 602/1208] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:56:41 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:56:41.474871 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d582ccd-4b2d-4d15-bced-d64267228383 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:41.486814 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d582ccd-4b2d-4d15-bced-d64267228383 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:41.491127 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68136d64-3b90-45a2-9f3c-bd41163b745f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:41.492008 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68136d64-3b90-45a2-9f3c-bd41163b745f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:41.492291 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68136d64-3b90-45a2-9f3c-bd41163b745f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:41.492566 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68136d64-3b90-45a2-9f3c-bd41163b745f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:41.502524 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68136d64-3b90-45a2-9f3c-bd41163b745f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:56:41.509641 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-68136d64-3b90-45a2-9f3c-bd41163b745f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:56:41.510757 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 607/1209] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:56:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:56:41.517515 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3de218-ac43-462e-b2a3-0ef3dbc9118d None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:41.526109 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3de218-ac43-462e-b2a3-0ef3dbc9118d None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:41.530963 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd648d-5400-4030-8689-13026c7a45e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:41.531628 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd648d-5400-4030-8689-13026c7a45e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:41.531909 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd648d-5400-4030-8689-13026c7a45e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:41.532250 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd648d-5400-4030-8689-13026c7a45e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:41.533007 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd648d-5400-4030-8689-13026c7a45e1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:56:41.533308 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd648d-5400-4030-8689-13026c7a45e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:41.534866 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd648d-5400-4030-8689-13026c7a45e1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:41.542878 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 603/1210] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:56:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:41.548881 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68136d64-3b90-45a2-9f3c-bd41163b745f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:41.558561 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68136d64-3b90-45a2-9f3c-bd41163b745f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:41.563013 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f14540-141d-4547-a56f-216826787ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:41.564130 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f14540-141d-4547-a56f-216826787ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:41.564414 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f14540-141d-4547-a56f-216826787ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:41.564689 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f14540-141d-4547-a56f-216826787ec6 admin admin] PATH_INFO: `/v3/users/a0f9803230fa4eccaf319fedb4a95f63` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:41.565864 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f14540-141d-4547-a56f-216826787ec6 admin admin] RBAC: Authorizing `identity:get_user(user_id=a0f9803230fa4eccaf319fedb4a95f63)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:41.567975 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f14540-141d-4547-a56f-216826787ec6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:41.569525 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 608/1211] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:56:41 2021] GET /identity/v3/users/a0f9803230fa4eccaf319fedb4a95f63 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:41.575231 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd648d-5400-4030-8689-13026c7a45e1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:41.584930 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd648d-5400-4030-8689-13026c7a45e1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:41.589272 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a56eb-b263-4cc6-b364-073dbdcd952f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:41.590078 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a56eb-b263-4cc6-b364-073dbdcd952f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:41.590358 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a56eb-b263-4cc6-b364-073dbdcd952f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:41.590627 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a56eb-b263-4cc6-b364-073dbdcd952f admin admin] PATH_INFO: `/v3/projects/a50d8be7b3c44a01a0e8f44dccd2ddd8` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:41.591953 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a56eb-b263-4cc6-b364-073dbdcd952f admin admin] RBAC: Authorizing `identity:get_project(project_id=a50d8be7b3c44a01a0e8f44dccd2ddd8)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:41.593928 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a56eb-b263-4cc6-b364-073dbdcd952f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:41.595632 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 604/1212] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:56:41 2021] GET /identity/v3/projects/a50d8be7b3c44a01a0e8f44dccd2ddd8 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:41.601384 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f14540-141d-4547-a56f-216826787ec6 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:41.611001 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f14540-141d-4547-a56f-216826787ec6 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:41.616684 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384859b-d4ac-4e62-86d7-da2dac7af212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:41.617519 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384859b-d4ac-4e62-86d7-da2dac7af212 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:41.617801 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384859b-d4ac-4e62-86d7-da2dac7af212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:41.618077 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384859b-d4ac-4e62-86d7-da2dac7af212 admin admin] PATH_INFO: `/v3/projects/a50d8be7b3c44a01a0e8f44dccd2ddd8/users/a0f9803230fa4eccaf319fedb4a95f63/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:41.620007 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384859b-d4ac-4e62-86d7-da2dac7af212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a50d8be7b3c44a01a0e8f44dccd2ddd8, user_id=a0f9803230fa4eccaf319fedb4a95f63, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:41.622545 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384859b-d4ac-4e62-86d7-da2dac7af212 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:41.712550 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 609/1213] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:56:41 2021] PUT /identity/v3/projects/a50d8be7b3c44a01a0e8f44dccd2ddd8/users/a0f9803230fa4eccaf319fedb4a95f63/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 03:56:43.904975 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e12f88-3ff2-4abe-a0eb-e148e74ddb03 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:43.905520 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e12f88-3ff2-4abe-a0eb-e148e74ddb03 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:43.905520 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e12f88-3ff2-4abe-a0eb-e148e74ddb03 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:43.907311 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 605/1214] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:56:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:56:43.913216 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8df85-4ce4-48fa-9484-0dc282bdcc0f None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:43.913606 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8df85-4ce4-48fa-9484-0dc282bdcc0f None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:43.913759 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8df85-4ce4-48fa-9484-0dc282bdcc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:43.931383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-01f8df85-4ce4-48fa-9484-0dc282bdcc0f None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:56:43.932488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-01f8df85-4ce4-48fa-9484-0dc282bdcc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:56:43.987149 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 610/1215] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:56:43 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:56:44.011843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e12f88-3ff2-4abe-a0eb-e148e74ddb03 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:44.024011 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e12f88-3ff2-4abe-a0eb-e148e74ddb03 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:44.028335 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a682e-5cc5-4bb6-836b-290be92b8be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:44.029207 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a682e-5cc5-4bb6-836b-290be92b8be4 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:44.029691 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a682e-5cc5-4bb6-836b-290be92b8be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:44.030131 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a682e-5cc5-4bb6-836b-290be92b8be4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:44.040192 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a682e-5cc5-4bb6-836b-290be92b8be4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:56:44.047519 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-970a682e-5cc5-4bb6-836b-290be92b8be4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:56:44.048638 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 606/1216] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:56:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:56:44.055055 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8df85-4ce4-48fa-9484-0dc282bdcc0f None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:44.064615 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8df85-4ce4-48fa-9484-0dc282bdcc0f None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:44.069065 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1950a-ec91-4511-903e-aa8326a232dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:44.069737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1950a-ec91-4511-903e-aa8326a232dc admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:44.070021 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1950a-ec91-4511-903e-aa8326a232dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:44.070298 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1950a-ec91-4511-903e-aa8326a232dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:44.071051 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1950a-ec91-4511-903e-aa8326a232dc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:56:44.071390 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1950a-ec91-4511-903e-aa8326a232dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:44.072956 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1950a-ec91-4511-903e-aa8326a232dc admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:44.081138 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 611/1217] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:56:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:44.087035 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a682e-5cc5-4bb6-836b-290be92b8be4 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:44.097449 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a682e-5cc5-4bb6-836b-290be92b8be4 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:44.101926 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56fdfb-3b19-4f6f-a228-7ec4d464016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:44.102746 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56fdfb-3b19-4f6f-a228-7ec4d464016d admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:44.103031 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56fdfb-3b19-4f6f-a228-7ec4d464016d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:44.103343 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56fdfb-3b19-4f6f-a228-7ec4d464016d admin admin] PATH_INFO: `/v3/users/a0f9803230fa4eccaf319fedb4a95f63` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:44.104535 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56fdfb-3b19-4f6f-a228-7ec4d464016d admin admin] RBAC: Authorizing `identity:get_user(user_id=a0f9803230fa4eccaf319fedb4a95f63)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:44.106614 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56fdfb-3b19-4f6f-a228-7ec4d464016d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:44.108775 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 607/1218] 10.222.0.54 () {56 vars in 1198 bytes} [Tue Nov 23 03:56:44 2021] GET /identity/v3/users/a0f9803230fa4eccaf319fedb4a95f63 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:44.114464 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1950a-ec91-4511-903e-aa8326a232dc admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:44.127337 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1950a-ec91-4511-903e-aa8326a232dc admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:44.131917 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1efba-5766-4422-9dd8-d10b1ac5de8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:44.132540 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1efba-5766-4422-9dd8-d10b1ac5de8d admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:44.132826 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1efba-5766-4422-9dd8-d10b1ac5de8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:44.133106 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1efba-5766-4422-9dd8-d10b1ac5de8d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:44.141236 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1efba-5766-4422-9dd8-d10b1ac5de8d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:44.142977 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1efba-5766-4422-9dd8-d10b1ac5de8d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:44.153367 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 612/1219] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:56:44 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 03:56:44.159973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56fdfb-3b19-4f6f-a228-7ec4d464016d admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:44.169303 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56fdfb-3b19-4f6f-a228-7ec4d464016d admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:44.174482 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267af780-dc91-4630-be36-a397c4293245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:44.175332 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267af780-dc91-4630-be36-a397c4293245 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:44.175616 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267af780-dc91-4630-be36-a397c4293245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:44.175892 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267af780-dc91-4630-be36-a397c4293245 admin admin] PATH_INFO: `/v3/projects/a50d8be7b3c44a01a0e8f44dccd2ddd8` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:44.177095 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267af780-dc91-4630-be36-a397c4293245 admin admin] RBAC: Authorizing `identity:get_project(project_id=a50d8be7b3c44a01a0e8f44dccd2ddd8)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:44.179094 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267af780-dc91-4630-be36-a397c4293245 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:44.180738 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 608/1220] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 03:56:44 2021] GET /identity/v3/projects/a50d8be7b3c44a01a0e8f44dccd2ddd8 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:56:44.187059 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1efba-5766-4422-9dd8-d10b1ac5de8d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:56:44.195543 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1efba-5766-4422-9dd8-d10b1ac5de8d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:56:44.199946 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782d007-d845-4c1b-ad0f-04c265243ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:56:44.200553 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782d007-d845-4c1b-ad0f-04c265243ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:56:44.200833 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782d007-d845-4c1b-ad0f-04c265243ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:56:44.201110 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782d007-d845-4c1b-ad0f-04c265243ab9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:56:44.201939 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782d007-d845-4c1b-ad0f-04c265243ab9 admin admin] RBAC: Adding query filter params (role.id=3db7012b41944542a50049819500eadd, scope.project.id=a50d8be7b3c44a01a0e8f44dccd2ddd8, user.id=a0f9803230fa4eccaf319fedb4a95f63) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:56:44.202244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782d007-d845-4c1b-ad0f-04c265243ab9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:56:44.204054 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782d007-d845-4c1b-ad0f-04c265243ab9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:56:44.209695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 613/1221] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:56:44 2021] GET /identity/v3/role_assignments?user.id=a0f9803230fa4eccaf319fedb4a95f63&scope.project.id=a50d8be7b3c44a01a0e8f44dccd2ddd8&role.id=3db7012b41944542a50049819500eadd => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:58:02.842458 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f3d4b-31d6-4dc3-9295-3e4baaeae51c None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:02.843037 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f3d4b-31d6-4dc3-9295-3e4baaeae51c None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:02.843139 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f3d4b-31d6-4dc3-9295-3e4baaeae51c None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:02.845463 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 609/1222] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:58:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:58:02.851249 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4698786-0c78-4bab-bd0c-8c53896d6d9d None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:02.851673 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4698786-0c78-4bab-bd0c-8c53896d6d9d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:02.851811 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4698786-0c78-4bab-bd0c-8c53896d6d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:02.869492 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-b4698786-0c78-4bab-bd0c-8c53896d6d9d None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:58:02.870665 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-b4698786-0c78-4bab-bd0c-8c53896d6d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:58:02.878380 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 614/1223] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:58:02 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:58:02.903247 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f3d4b-31d6-4dc3-9295-3e4baaeae51c None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:02.916365 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f3d4b-31d6-4dc3-9295-3e4baaeae51c None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:02.920712 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d532f-bdcc-4c64-aae9-08dfe20c043e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:02.921470 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d532f-bdcc-4c64-aae9-08dfe20c043e admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:02.921749 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d532f-bdcc-4c64-aae9-08dfe20c043e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:02.922022 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d532f-bdcc-4c64-aae9-08dfe20c043e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:02.932615 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d532f-bdcc-4c64-aae9-08dfe20c043e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:02.934391 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d532f-bdcc-4c64-aae9-08dfe20c043e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:02.950603 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-2c5d532f-bdcc-4c64-aae9-08dfe20c043e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:58:02.951741 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 610/1224] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:58:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:02.958331 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4698786-0c78-4bab-bd0c-8c53896d6d9d None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:02.967043 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4698786-0c78-4bab-bd0c-8c53896d6d9d None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:02.972168 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326de787-79c4-47f5-a48d-e8ac4cca00c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:02.974433 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326de787-79c4-47f5-a48d-e8ac4cca00c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:02.974433 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326de787-79c4-47f5-a48d-e8ac4cca00c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:02.974433 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326de787-79c4-47f5-a48d-e8ac4cca00c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:02.974433 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326de787-79c4-47f5-a48d-e8ac4cca00c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:02.974433 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326de787-79c4-47f5-a48d-e8ac4cca00c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:02.975958 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326de787-79c4-47f5-a48d-e8ac4cca00c4 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:02.987642 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 615/1225] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:58:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:02.993571 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d532f-bdcc-4c64-aae9-08dfe20c043e admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:03.003197 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d532f-bdcc-4c64-aae9-08dfe20c043e admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:03.007705 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dcdc2-5b95-4721-a3fa-d5806b14cb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:03.008813 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dcdc2-5b95-4721-a3fa-d5806b14cb9c admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:03.008813 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dcdc2-5b95-4721-a3fa-d5806b14cb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:03.008997 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dcdc2-5b95-4721-a3fa-d5806b14cb9c admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:03.009647 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25dcdc2-5b95-4721-a3fa-d5806b14cb9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:03.011575 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25dcdc2-5b95-4721-a3fa-d5806b14cb9c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:03.211904 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 611/1226] 10.222.0.54 () {60 vars in 1153 bytes} [Tue Nov 23 03:58:02 2021] POST /identity/v3/users => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 03:58:05.491475 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2dfa6b-7525-4a43-9413-0eec71f9d165 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:05.492027 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2dfa6b-7525-4a43-9413-0eec71f9d165 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:05.492027 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2dfa6b-7525-4a43-9413-0eec71f9d165 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:05.493805 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 616/1227] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:58:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:58:05.499423 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7b277-efcf-4b29-8377-174fc48c4fa3 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:05.499865 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7b277-efcf-4b29-8377-174fc48c4fa3 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:05.500006 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7b277-efcf-4b29-8377-174fc48c4fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:05.518055 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-86f7b277-efcf-4b29-8377-174fc48c4fa3 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:58:05.519234 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-86f7b277-efcf-4b29-8377-174fc48c4fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:58:05.526684 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 612/1228] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:58:05 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:58:05.551993 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2dfa6b-7525-4a43-9413-0eec71f9d165 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:05.564643 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2dfa6b-7525-4a43-9413-0eec71f9d165 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:05.568956 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3299f06-a800-402e-8808-5875b1d07d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:05.569713 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3299f06-a800-402e-8808-5875b1d07d96 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:05.569990 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3299f06-a800-402e-8808-5875b1d07d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:05.570259 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3299f06-a800-402e-8808-5875b1d07d96 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:05.580736 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3299f06-a800-402e-8808-5875b1d07d96 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:58:05.587788 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-a3299f06-a800-402e-8808-5875b1d07d96 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 03:58:05.588911 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 617/1229] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:58:05 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:05.595323 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7b277-efcf-4b29-8377-174fc48c4fa3 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:05.604028 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7b277-efcf-4b29-8377-174fc48c4fa3 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:05.608460 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c884363-d4ee-49cf-a775-eee7f4f67f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:05.609098 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c884363-d4ee-49cf-a775-eee7f4f67f15 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:05.609375 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c884363-d4ee-49cf-a775-eee7f4f67f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:05.609643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c884363-d4ee-49cf-a775-eee7f4f67f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:05.610907 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c884363-d4ee-49cf-a775-eee7f4f67f15 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:05.611362 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c884363-d4ee-49cf-a775-eee7f4f67f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:05.615485 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c884363-d4ee-49cf-a775-eee7f4f67f15 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:05.620522 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 613/1230] 10.222.0.54 () {56 vars in 1124 bytes} [Tue Nov 23 03:58:05 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:05.627885 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3299f06-a800-402e-8808-5875b1d07d96 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:05.637200 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3299f06-a800-402e-8808-5875b1d07d96 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:05.641739 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ef8df-6b9e-4ce7-ab82-3f778c957fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:05.644156 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ef8df-6b9e-4ce7-ab82-3f778c957fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:05.644156 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ef8df-6b9e-4ce7-ab82-3f778c957fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:05.644156 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ef8df-6b9e-4ce7-ab82-3f778c957fd7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:05.652882 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ef8df-6b9e-4ce7-ab82-3f778c957fd7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:05.654675 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ef8df-6b9e-4ce7-ab82-3f778c957fd7 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:05.671001 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-7b1ef8df-6b9e-4ce7-ab82-3f778c957fd7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:58:05.673342 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 618/1231] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:58:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:05.678877 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c884363-d4ee-49cf-a775-eee7f4f67f15 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:05.688362 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c884363-d4ee-49cf-a775-eee7f4f67f15 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:05.693604 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823cc1c-795f-4fd1-9761-dbd863862c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:05.694239 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823cc1c-795f-4fd1-9761-dbd863862c31 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:05.694518 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823cc1c-795f-4fd1-9761-dbd863862c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:05.694791 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823cc1c-795f-4fd1-9761-dbd863862c31 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:05.695543 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823cc1c-795f-4fd1-9761-dbd863862c31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:05.695871 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823cc1c-795f-4fd1-9761-dbd863862c31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:05.697435 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823cc1c-795f-4fd1-9761-dbd863862c31 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:05.708693 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 614/1232] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:58:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:05.719416 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ef8df-6b9e-4ce7-ab82-3f778c957fd7 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:05.725015 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ef8df-6b9e-4ce7-ab82-3f778c957fd7 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:05.729511 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed5173-b73e-4872-bca1-144928d1c374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:05.730277 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed5173-b73e-4872-bca1-144928d1c374 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:05.730556 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed5173-b73e-4872-bca1-144928d1c374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:05.730870 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed5173-b73e-4872-bca1-144928d1c374 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:05.738980 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed5173-b73e-4872-bca1-144928d1c374 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:05.740827 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed5173-b73e-4872-bca1-144928d1c374 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:05.754589 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-feed5173-b73e-4872-bca1-144928d1c374 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 23 03:58:05.755660 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 619/1233] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:58:05 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:05.761797 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823cc1c-795f-4fd1-9761-dbd863862c31 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:05.771635 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823cc1c-795f-4fd1-9761-dbd863862c31 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:05.776101 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba014c53-9cf6-43ab-aa36-d73831eefbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:05.779226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba014c53-9cf6-43ab-aa36-d73831eefbad admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:05.779226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba014c53-9cf6-43ab-aa36-d73831eefbad admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:05.779226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba014c53-9cf6-43ab-aa36-d73831eefbad admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:05.779226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba014c53-9cf6-43ab-aa36-d73831eefbad admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:05.779226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba014c53-9cf6-43ab-aa36-d73831eefbad admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:05.780259 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba014c53-9cf6-43ab-aa36-d73831eefbad admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:05.797650 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 615/1234] 10.222.0.54 () {56 vars in 1164 bytes} [Tue Nov 23 03:58:05 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:05.804312 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed5173-b73e-4872-bca1-144928d1c374 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:05.814330 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed5173-b73e-4872-bca1-144928d1c374 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:05.818764 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76c0a8-a885-46f6-a41c-39eed979a984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:05.819428 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76c0a8-a885-46f6-a41c-39eed979a984 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:05.819708 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76c0a8-a885-46f6-a41c-39eed979a984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:05.819981 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76c0a8-a885-46f6-a41c-39eed979a984 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:05.827553 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76c0a8-a885-46f6-a41c-39eed979a984 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:05.829534 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76c0a8-a885-46f6-a41c-39eed979a984 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:05.838108 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 620/1235] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:58:05 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 03:58:05.844498 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba014c53-9cf6-43ab-aa36-d73831eefbad admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:05.854766 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba014c53-9cf6-43ab-aa36-d73831eefbad admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:05.859232 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6b4ad-442f-41b3-b837-8b81f47e02c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:05.860003 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6b4ad-442f-41b3-b837-8b81f47e02c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:05.860285 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6b4ad-442f-41b3-b837-8b81f47e02c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:05.861140 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6b4ad-442f-41b3-b837-8b81f47e02c8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:05.871012 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6b4ad-442f-41b3-b837-8b81f47e02c8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:05.872871 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6b4ad-442f-41b3-b837-8b81f47e02c8 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:05.889811 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-1eb6b4ad-442f-41b3-b837-8b81f47e02c8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:58:05.890931 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 616/1236] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:58:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:05.896938 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76c0a8-a885-46f6-a41c-39eed979a984 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:05.905481 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76c0a8-a885-46f6-a41c-39eed979a984 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:05.910506 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf20e3-68dd-48b0-b632-7fd274b91eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:05.911312 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf20e3-68dd-48b0-b632-7fd274b91eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:05.911492 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf20e3-68dd-48b0-b632-7fd274b91eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:05.911769 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf20e3-68dd-48b0-b632-7fd274b91eb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:05.912491 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf20e3-68dd-48b0-b632-7fd274b91eb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:05.912793 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf20e3-68dd-48b0-b632-7fd274b91eb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:05.914338 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf20e3-68dd-48b0-b632-7fd274b91eb0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:05.925930 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 621/1237] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:58:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:05.932228 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6b4ad-442f-41b3-b837-8b81f47e02c8 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:05.942271 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6b4ad-442f-41b3-b837-8b81f47e02c8 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:05.946713 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289ab49-40fa-4c28-a105-f3a6497d00f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:05.947502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289ab49-40fa-4c28-a105-f3a6497d00f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:05.947784 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289ab49-40fa-4c28-a105-f3a6497d00f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:05.948054 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289ab49-40fa-4c28-a105-f3a6497d00f6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:05.955040 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289ab49-40fa-4c28-a105-f3a6497d00f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:05.956974 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289ab49-40fa-4c28-a105-f3a6497d00f6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:05.970383 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-3289ab49-40fa-4c28-a105-f3a6497d00f6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:58:05.971646 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 617/1238] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:58:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:05.977871 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf20e3-68dd-48b0-b632-7fd274b91eb0 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:05.987962 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf20e3-68dd-48b0-b632-7fd274b91eb0 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:05.992431 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa38b27-4aec-437e-8b92-a5c60dcffbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:05.993060 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa38b27-4aec-437e-8b92-a5c60dcffbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:05.993337 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa38b27-4aec-437e-8b92-a5c60dcffbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:05.993604 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa38b27-4aec-437e-8b92-a5c60dcffbc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:05.994375 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa38b27-4aec-437e-8b92-a5c60dcffbc8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:05.994675 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa38b27-4aec-437e-8b92-a5c60dcffbc8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:05.996499 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa38b27-4aec-437e-8b92-a5c60dcffbc8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:06.009533 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 622/1239] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:58:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:58:06.016072 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289ab49-40fa-4c28-a105-f3a6497d00f6 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:06.026377 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289ab49-40fa-4c28-a105-f3a6497d00f6 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:06.030841 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be326c-ad78-4e07-a006-0e050eef03eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:06.031519 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be326c-ad78-4e07-a006-0e050eef03eb admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:06.031804 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be326c-ad78-4e07-a006-0e050eef03eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:06.032077 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be326c-ad78-4e07-a006-0e050eef03eb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:06.033505 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be326c-ad78-4e07-a006-0e050eef03eb admin admin] RBAC: Adding query filter params (role.id=4dde72f5d769401aa566e1c65c1f40d5, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=b23c3a2a6cfd4492b7d8eaa62dacec94) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:06.033814 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be326c-ad78-4e07-a006-0e050eef03eb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:06.035684 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be326c-ad78-4e07-a006-0e050eef03eb admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:06.041222 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 618/1240] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:58:06 2021] GET /identity/v3/role_assignments?user.id=b23c3a2a6cfd4492b7d8eaa62dacec94&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=4dde72f5d769401aa566e1c65c1f40d5 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:08.250360 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f808b-6c69-430f-a7ce-65d75b64a96c None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:08.250933 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f808b-6c69-430f-a7ce-65d75b64a96c None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:08.251106 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f808b-6c69-430f-a7ce-65d75b64a96c None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:08.252931 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 623/1241] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:58:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:58:08.258716 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ad390-c904-4b78-ab7b-c934d1cc8d18 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:08.259129 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ad390-c904-4b78-ab7b-c934d1cc8d18 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:08.259293 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ad390-c904-4b78-ab7b-c934d1cc8d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:08.276447 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-602ad390-c904-4b78-ab7b-c934d1cc8d18 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:58:08.277607 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-602ad390-c904-4b78-ab7b-c934d1cc8d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:58:08.285749 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 619/1242] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:58:08 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:58:08.308556 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f808b-6c69-430f-a7ce-65d75b64a96c None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:08.320826 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f808b-6c69-430f-a7ce-65d75b64a96c None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:08.325211 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d72ea-4574-41b3-9d42-4025b3599ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:08.325974 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d72ea-4574-41b3-9d42-4025b3599ede admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:08.326254 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d72ea-4574-41b3-9d42-4025b3599ede admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:08.326525 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d72ea-4574-41b3-9d42-4025b3599ede admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:08.338629 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d72ea-4574-41b3-9d42-4025b3599ede admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:58:08.346668 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-a16d72ea-4574-41b3-9d42-4025b3599ede admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 03:58:08.348056 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 624/1243] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:58:08 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:08.354639 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ad390-c904-4b78-ab7b-c934d1cc8d18 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:08.363792 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ad390-c904-4b78-ab7b-c934d1cc8d18 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:08.368174 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d2eb2-1959-4f10-864d-931101c6a422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:08.368810 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d2eb2-1959-4f10-864d-931101c6a422 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:08.369087 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d2eb2-1959-4f10-864d-931101c6a422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:08.369359 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d2eb2-1959-4f10-864d-931101c6a422 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:08.370106 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d2eb2-1959-4f10-864d-931101c6a422 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:08.370405 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d2eb2-1959-4f10-864d-931101c6a422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:08.371999 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d2eb2-1959-4f10-864d-931101c6a422 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:08.380459 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 620/1244] 10.222.0.54 () {56 vars in 1124 bytes} [Tue Nov 23 03:58:08 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:08.386395 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d72ea-4574-41b3-9d42-4025b3599ede admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:08.396802 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d72ea-4574-41b3-9d42-4025b3599ede admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:08.401385 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d53ab4-9af8-45fc-8af2-600e4ced139d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:08.402150 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d53ab4-9af8-45fc-8af2-600e4ced139d admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:08.402430 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d53ab4-9af8-45fc-8af2-600e4ced139d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:08.402701 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d53ab4-9af8-45fc-8af2-600e4ced139d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:08.413563 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d53ab4-9af8-45fc-8af2-600e4ced139d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:08.415442 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d53ab4-9af8-45fc-8af2-600e4ced139d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:08.431802 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-f3d53ab4-9af8-45fc-8af2-600e4ced139d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:58:08.432966 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 625/1245] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:58:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:08.439866 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d2eb2-1959-4f10-864d-931101c6a422 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:08.449525 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d2eb2-1959-4f10-864d-931101c6a422 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:08.454732 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8154f9-0cc9-4b2f-af20-4e1a74626722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:08.456002 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8154f9-0cc9-4b2f-af20-4e1a74626722 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:08.456285 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8154f9-0cc9-4b2f-af20-4e1a74626722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:08.456555 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8154f9-0cc9-4b2f-af20-4e1a74626722 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:08.457286 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8154f9-0cc9-4b2f-af20-4e1a74626722 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:08.457585 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8154f9-0cc9-4b2f-af20-4e1a74626722 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:08.459141 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8154f9-0cc9-4b2f-af20-4e1a74626722 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:08.470745 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 621/1246] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:58:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:08.476712 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d53ab4-9af8-45fc-8af2-600e4ced139d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:08.486206 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d53ab4-9af8-45fc-8af2-600e4ced139d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:08.490643 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a95ff-a7e0-4373-aea2-0509bc059bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:08.491443 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a95ff-a7e0-4373-aea2-0509bc059bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:08.491907 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a95ff-a7e0-4373-aea2-0509bc059bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:08.492234 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a95ff-a7e0-4373-aea2-0509bc059bf4 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:08.499938 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a95ff-a7e0-4373-aea2-0509bc059bf4 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:08.502688 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a95ff-a7e0-4373-aea2-0509bc059bf4 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:08.515675 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-005a95ff-a7e0-4373-aea2-0509bc059bf4 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 23 03:58:08.518916 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 626/1247] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:58:08 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:08.523503 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8154f9-0cc9-4b2f-af20-4e1a74626722 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:08.534517 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8154f9-0cc9-4b2f-af20-4e1a74626722 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:08.539006 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d6aee-e4c9-417c-ac43-bee35765b6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:08.539683 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d6aee-e4c9-417c-ac43-bee35765b6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:08.539964 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d6aee-e4c9-417c-ac43-bee35765b6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:08.540233 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d6aee-e4c9-417c-ac43-bee35765b6c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:08.541065 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d6aee-e4c9-417c-ac43-bee35765b6c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:08.541372 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d6aee-e4c9-417c-ac43-bee35765b6c2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:08.543187 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d6aee-e4c9-417c-ac43-bee35765b6c2 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:08.560288 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 622/1248] 10.222.0.54 () {56 vars in 1164 bytes} [Tue Nov 23 03:58:08 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:08.566981 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a95ff-a7e0-4373-aea2-0509bc059bf4 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:08.576516 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a95ff-a7e0-4373-aea2-0509bc059bf4 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:08.581576 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892219a-9b17-4a07-8887-da40856653c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:08.582341 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892219a-9b17-4a07-8887-da40856653c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:08.582624 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892219a-9b17-4a07-8887-da40856653c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:08.582919 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892219a-9b17-4a07-8887-da40856653c3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:08.593464 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892219a-9b17-4a07-8887-da40856653c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:08.595289 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892219a-9b17-4a07-8887-da40856653c3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:08.611260 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-5892219a-9b17-4a07-8887-da40856653c3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:58:08.612397 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 627/1249] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:58:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:08.618574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d6aee-e4c9-417c-ac43-bee35765b6c2 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:08.628739 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d6aee-e4c9-417c-ac43-bee35765b6c2 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:08.633312 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e55b3-0902-416a-ab82-e6fb5a2aa5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:08.633943 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e55b3-0902-416a-ab82-e6fb5a2aa5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:08.634223 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e55b3-0902-416a-ab82-e6fb5a2aa5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:08.634516 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e55b3-0902-416a-ab82-e6fb5a2aa5a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:08.635267 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e55b3-0902-416a-ab82-e6fb5a2aa5a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:08.635570 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e55b3-0902-416a-ab82-e6fb5a2aa5a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:08.637128 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e55b3-0902-416a-ab82-e6fb5a2aa5a1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:08.648786 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 623/1250] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:58:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:08.654853 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892219a-9b17-4a07-8887-da40856653c3 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:08.664281 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892219a-9b17-4a07-8887-da40856653c3 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:08.668779 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d98b9-079b-44ca-9286-4f6153e12201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:08.669556 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d98b9-079b-44ca-9286-4f6153e12201 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:08.669837 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d98b9-079b-44ca-9286-4f6153e12201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:08.670111 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d98b9-079b-44ca-9286-4f6153e12201 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:08.679835 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d98b9-079b-44ca-9286-4f6153e12201 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:08.679835 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d98b9-079b-44ca-9286-4f6153e12201 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:08.693364 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-0b7d98b9-079b-44ca-9286-4f6153e12201 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:58:08.694506 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 628/1251] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:58:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:08.700850 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e55b3-0902-416a-ab82-e6fb5a2aa5a1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:08.710901 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e55b3-0902-416a-ab82-e6fb5a2aa5a1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:08.715403 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d72e7-c6f6-4bf9-a73f-33d0595edbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:08.716030 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d72e7-c6f6-4bf9-a73f-33d0595edbc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:08.716309 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d72e7-c6f6-4bf9-a73f-33d0595edbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:08.716582 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d72e7-c6f6-4bf9-a73f-33d0595edbc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:08.717359 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d72e7-c6f6-4bf9-a73f-33d0595edbc4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:08.717661 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d72e7-c6f6-4bf9-a73f-33d0595edbc4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:08.719582 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d72e7-c6f6-4bf9-a73f-33d0595edbc4 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:08.731089 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 624/1252] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:58:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:08.738100 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d98b9-079b-44ca-9286-4f6153e12201 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:08.747622 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d98b9-079b-44ca-9286-4f6153e12201 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:08.752945 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3b653-2c16-4165-ab8a-82a3e4a41bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:08.753809 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3b653-2c16-4165-ab8a-82a3e4a41bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:08.754096 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3b653-2c16-4165-ab8a-82a3e4a41bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:08.754377 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3b653-2c16-4165-ab8a-82a3e4a41bfd admin admin] PATH_INFO: `/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/b23c3a2a6cfd4492b7d8eaa62dacec94/roles/4dde72f5d769401aa566e1c65c1f40d5` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:08.769125 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3b653-2c16-4165-ab8a-82a3e4a41bfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa78bb05b3e48f3a9c973567c781357, user_id=b23c3a2a6cfd4492b7d8eaa62dacec94, role_id=4dde72f5d769401aa566e1c65c1f40d5)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:08.772000 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3b653-2c16-4165-ab8a-82a3e4a41bfd admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:08.889994 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 629/1253] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:58:08 2021] PUT /identity/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/b23c3a2a6cfd4492b7d8eaa62dacec94/roles/4dde72f5d769401aa566e1c65c1f40d5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 03:58:11.104662 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c2bbc-deee-41b4-b518-4bfd0410475d None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:11.105233 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c2bbc-deee-41b4-b518-4bfd0410475d None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:11.105233 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c2bbc-deee-41b4-b518-4bfd0410475d None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:11.107157 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 625/1254] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:58:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:58:11.113651 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21d602-8631-4879-bf31-dae355c114b7 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:11.114119 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21d602-8631-4879-bf31-dae355c114b7 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:11.114207 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21d602-8631-4879-bf31-dae355c114b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:11.131756 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-7a21d602-8631-4879-bf31-dae355c114b7 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:58:11.132936 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-7a21d602-8631-4879-bf31-dae355c114b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:58:11.193835 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 630/1255] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:58:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:58:11.218607 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c2bbc-deee-41b4-b518-4bfd0410475d None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:11.232106 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c2bbc-deee-41b4-b518-4bfd0410475d None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:11.236829 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9b224-7c90-4435-bc4a-2bdd5d4d17eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:11.237610 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9b224-7c90-4435-bc4a-2bdd5d4d17eb admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:11.237893 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9b224-7c90-4435-bc4a-2bdd5d4d17eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:11.238170 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9b224-7c90-4435-bc4a-2bdd5d4d17eb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:11.248419 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9b224-7c90-4435-bc4a-2bdd5d4d17eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:58:11.255488 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-0db9b224-7c90-4435-bc4a-2bdd5d4d17eb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 03:58:11.256753 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 626/1256] 10.222.0.54 () {56 vars in 1123 bytes} [Tue Nov 23 03:58:11 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:11.263234 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21d602-8631-4879-bf31-dae355c114b7 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:11.272844 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21d602-8631-4879-bf31-dae355c114b7 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:11.277408 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39b258-c124-4f6c-8c73-3c1a285ce036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:11.278056 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39b258-c124-4f6c-8c73-3c1a285ce036 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:11.278341 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39b258-c124-4f6c-8c73-3c1a285ce036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:11.278646 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39b258-c124-4f6c-8c73-3c1a285ce036 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:11.279428 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39b258-c124-4f6c-8c73-3c1a285ce036 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:11.279734 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39b258-c124-4f6c-8c73-3c1a285ce036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:11.284532 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39b258-c124-4f6c-8c73-3c1a285ce036 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:11.290065 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 631/1257] 10.222.0.54 () {56 vars in 1124 bytes} [Tue Nov 23 03:58:11 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 03:58:11.296132 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9b224-7c90-4435-bc4a-2bdd5d4d17eb admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:11.306153 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9b224-7c90-4435-bc4a-2bdd5d4d17eb admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:11.310610 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff566b1-be8e-45fe-a59b-c7d65465ff6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:11.311390 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff566b1-be8e-45fe-a59b-c7d65465ff6f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:11.311668 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff566b1-be8e-45fe-a59b-c7d65465ff6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:11.311935 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff566b1-be8e-45fe-a59b-c7d65465ff6f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:11.322365 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff566b1-be8e-45fe-a59b-c7d65465ff6f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:11.324205 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff566b1-be8e-45fe-a59b-c7d65465ff6f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:11.340754 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-cff566b1-be8e-45fe-a59b-c7d65465ff6f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:58:11.341963 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 627/1258] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:58:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:58:11.348809 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39b258-c124-4f6c-8c73-3c1a285ce036 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:11.365926 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39b258-c124-4f6c-8c73-3c1a285ce036 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:11.365926 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe914fa-051d-45ca-ba42-534d4ea45a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:11.365926 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe914fa-051d-45ca-ba42-534d4ea45a39 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:11.365926 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe914fa-051d-45ca-ba42-534d4ea45a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:11.366323 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe914fa-051d-45ca-ba42-534d4ea45a39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:11.366323 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe914fa-051d-45ca-ba42-534d4ea45a39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:11.366323 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe914fa-051d-45ca-ba42-534d4ea45a39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:11.366567 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe914fa-051d-45ca-ba42-534d4ea45a39 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:11.378634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 632/1259] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:58:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:11.384566 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff566b1-be8e-45fe-a59b-c7d65465ff6f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:11.395519 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff566b1-be8e-45fe-a59b-c7d65465ff6f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:11.400181 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc03fd-74f3-4416-a46e-66d19499e9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:11.400942 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc03fd-74f3-4416-a46e-66d19499e9dc admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:11.401222 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc03fd-74f3-4416-a46e-66d19499e9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:11.401496 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc03fd-74f3-4416-a46e-66d19499e9dc admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:11.408849 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc03fd-74f3-4416-a46e-66d19499e9dc admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:11.410899 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc03fd-74f3-4416-a46e-66d19499e9dc admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:11.424757 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-2cfc03fd-74f3-4416-a46e-66d19499e9dc admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 23 03:58:11.425873 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 628/1260] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:58:11 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:11.432005 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe914fa-051d-45ca-ba42-534d4ea45a39 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:11.442391 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe914fa-051d-45ca-ba42-534d4ea45a39 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:11.446983 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0862e-16c5-41d0-a404-95660aba734d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:11.447661 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0862e-16c5-41d0-a404-95660aba734d admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:11.447990 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0862e-16c5-41d0-a404-95660aba734d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:11.448272 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0862e-16c5-41d0-a404-95660aba734d admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:11.449106 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0862e-16c5-41d0-a404-95660aba734d admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:11.449417 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0862e-16c5-41d0-a404-95660aba734d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:11.451242 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0862e-16c5-41d0-a404-95660aba734d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:11.468492 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 633/1261] 10.222.0.54 () {56 vars in 1164 bytes} [Tue Nov 23 03:58:11 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:11.475057 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc03fd-74f3-4416-a46e-66d19499e9dc admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:11.484658 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc03fd-74f3-4416-a46e-66d19499e9dc admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:11.497746 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26170097-59f3-4a27-b899-7501ab8fd186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:11.497746 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26170097-59f3-4a27-b899-7501ab8fd186 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:11.497746 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26170097-59f3-4a27-b899-7501ab8fd186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:11.497746 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26170097-59f3-4a27-b899-7501ab8fd186 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:11.498392 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26170097-59f3-4a27-b899-7501ab8fd186 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:11.500157 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26170097-59f3-4a27-b899-7501ab8fd186 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:11.509911 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 629/1262] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:58:11 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 03:58:11.515901 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0862e-16c5-41d0-a404-95660aba734d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:11.525996 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0862e-16c5-41d0-a404-95660aba734d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:11.530418 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50ce35-691c-448e-b316-45ce483fd25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:11.531178 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50ce35-691c-448e-b316-45ce483fd25e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:11.531488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50ce35-691c-448e-b316-45ce483fd25e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:11.531760 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50ce35-691c-448e-b316-45ce483fd25e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:11.541789 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50ce35-691c-448e-b316-45ce483fd25e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:11.543625 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50ce35-691c-448e-b316-45ce483fd25e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:11.559836 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-ca50ce35-691c-448e-b316-45ce483fd25e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:58:11.560948 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 634/1263] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:58:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:58:11.567553 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26170097-59f3-4a27-b899-7501ab8fd186 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:11.576144 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26170097-59f3-4a27-b899-7501ab8fd186 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:11.581317 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12944d-c016-4ab4-b9eb-337002779c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:11.581961 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12944d-c016-4ab4-b9eb-337002779c9b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:11.582241 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12944d-c016-4ab4-b9eb-337002779c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:11.582512 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12944d-c016-4ab4-b9eb-337002779c9b admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:11.583251 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12944d-c016-4ab4-b9eb-337002779c9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:11.583554 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12944d-c016-4ab4-b9eb-337002779c9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:11.585097 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12944d-c016-4ab4-b9eb-337002779c9b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:11.596000 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 630/1264] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:58:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:11.601724 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50ce35-691c-448e-b316-45ce483fd25e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:11.611763 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50ce35-691c-448e-b316-45ce483fd25e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:11.618130 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83be7a-ae53-4ff7-8a38-5c41499223c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:11.618130 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83be7a-ae53-4ff7-8a38-5c41499223c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:11.618130 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83be7a-ae53-4ff7-8a38-5c41499223c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:11.618130 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83be7a-ae53-4ff7-8a38-5c41499223c9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:11.624232 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83be7a-ae53-4ff7-8a38-5c41499223c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:11.626725 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83be7a-ae53-4ff7-8a38-5c41499223c9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:11.639133 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-bf83be7a-ae53-4ff7-8a38-5c41499223c9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:58:11.640276 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 635/1265] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:58:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:11.647052 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12944d-c016-4ab4-b9eb-337002779c9b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:11.656563 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12944d-c016-4ab4-b9eb-337002779c9b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:11.661267 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21367c7d-036d-4906-859d-afbc8cdc6d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:11.661892 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21367c7d-036d-4906-859d-afbc8cdc6d64 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:11.662169 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21367c7d-036d-4906-859d-afbc8cdc6d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:11.662464 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21367c7d-036d-4906-859d-afbc8cdc6d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:11.663273 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21367c7d-036d-4906-859d-afbc8cdc6d64 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:11.663579 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21367c7d-036d-4906-859d-afbc8cdc6d64 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:11.665379 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21367c7d-036d-4906-859d-afbc8cdc6d64 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:11.679153 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 631/1266] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:58:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:11.686913 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83be7a-ae53-4ff7-8a38-5c41499223c9 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:11.696642 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83be7a-ae53-4ff7-8a38-5c41499223c9 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:11.701082 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73dff2-a5fb-4092-9b2c-79119ebf13a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:11.701736 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73dff2-a5fb-4092-9b2c-79119ebf13a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:11.702019 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73dff2-a5fb-4092-9b2c-79119ebf13a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:11.702291 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73dff2-a5fb-4092-9b2c-79119ebf13a1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:11.703111 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73dff2-a5fb-4092-9b2c-79119ebf13a1 admin admin] RBAC: Adding query filter params (role.id=4dde72f5d769401aa566e1c65c1f40d5, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=b23c3a2a6cfd4492b7d8eaa62dacec94) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:11.703447 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73dff2-a5fb-4092-9b2c-79119ebf13a1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:11.705834 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73dff2-a5fb-4092-9b2c-79119ebf13a1 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:11.711491 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 636/1267] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:58:11 2021] GET /identity/v3/role_assignments?user.id=b23c3a2a6cfd4492b7d8eaa62dacec94&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=4dde72f5d769401aa566e1c65c1f40d5 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:14.048615 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa6257-ec92-4eb4-8340-310bac68499e None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:14.049161 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa6257-ec92-4eb4-8340-310bac68499e None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:14.049161 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa6257-ec92-4eb4-8340-310bac68499e None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:14.050958 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 632/1268] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:58:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:58:14.056827 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968dee8-d303-4536-8761-3b8286aae848 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:14.057256 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968dee8-d303-4536-8761-3b8286aae848 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:14.057376 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968dee8-d303-4536-8761-3b8286aae848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:14.074825 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-8968dee8-d303-4536-8761-3b8286aae848 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:58:14.076018 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-8968dee8-d303-4536-8761-3b8286aae848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:58:14.083647 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 637/1269] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:58:14 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:58:14.108028 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa6257-ec92-4eb4-8340-310bac68499e None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:14.120760 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa6257-ec92-4eb4-8340-310bac68499e None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:14.125116 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e23083-a65c-4a64-bf68-6ff3d2e0f982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:14.126438 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e23083-a65c-4a64-bf68-6ff3d2e0f982 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:14.126721 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e23083-a65c-4a64-bf68-6ff3d2e0f982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:14.128996 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e23083-a65c-4a64-bf68-6ff3d2e0f982 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:14.137073 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e23083-a65c-4a64-bf68-6ff3d2e0f982 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:58:14.145101 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-73e23083-a65c-4a64-bf68-6ff3d2e0f982 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:58:14.146254 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 633/1270] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:58:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:14.152856 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968dee8-d303-4536-8761-3b8286aae848 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:14.162440 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968dee8-d303-4536-8761-3b8286aae848 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:14.166901 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6a5c5-9758-4e15-a578-c314c8d65c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:14.167585 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6a5c5-9758-4e15-a578-c314c8d65c64 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:14.167866 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6a5c5-9758-4e15-a578-c314c8d65c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:14.168192 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6a5c5-9758-4e15-a578-c314c8d65c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:14.168938 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6a5c5-9758-4e15-a578-c314c8d65c64 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:14.169240 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6a5c5-9758-4e15-a578-c314c8d65c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:14.170793 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6a5c5-9758-4e15-a578-c314c8d65c64 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:14.179581 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 638/1271] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:58:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:14.185972 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e23083-a65c-4a64-bf68-6ff3d2e0f982 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:14.196581 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e23083-a65c-4a64-bf68-6ff3d2e0f982 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:14.201088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a08fb6-383b-4a53-a239-b5bd58e05695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:14.201837 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a08fb6-383b-4a53-a239-b5bd58e05695 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:14.202119 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a08fb6-383b-4a53-a239-b5bd58e05695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:14.202394 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a08fb6-383b-4a53-a239-b5bd58e05695 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:14.213300 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a08fb6-383b-4a53-a239-b5bd58e05695 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:14.215378 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a08fb6-383b-4a53-a239-b5bd58e05695 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:14.232149 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-29a08fb6-383b-4a53-a239-b5bd58e05695 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:58:14.233304 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 634/1272] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:58:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:58:14.239833 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6a5c5-9758-4e15-a578-c314c8d65c64 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:14.249135 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6a5c5-9758-4e15-a578-c314c8d65c64 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:14.253702 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f7911-c511-498f-8357-cd435d538979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:14.254341 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f7911-c511-498f-8357-cd435d538979 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:14.254621 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f7911-c511-498f-8357-cd435d538979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:14.254895 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f7911-c511-498f-8357-cd435d538979 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:14.255652 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f7911-c511-498f-8357-cd435d538979 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:14.255971 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f7911-c511-498f-8357-cd435d538979 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:14.257513 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f7911-c511-498f-8357-cd435d538979 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:14.269696 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 639/1273] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:58:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:14.275815 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a08fb6-383b-4a53-a239-b5bd58e05695 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:14.285855 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a08fb6-383b-4a53-a239-b5bd58e05695 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:14.290381 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b7d90-2137-4ede-a9e2-14ab6027c6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:14.291149 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b7d90-2137-4ede-a9e2-14ab6027c6da admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:14.291463 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b7d90-2137-4ede-a9e2-14ab6027c6da admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:14.291737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b7d90-2137-4ede-a9e2-14ab6027c6da admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:14.299482 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b7d90-2137-4ede-a9e2-14ab6027c6da admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:14.301426 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b7d90-2137-4ede-a9e2-14ab6027c6da admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:14.315884 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-d00b7d90-2137-4ede-a9e2-14ab6027c6da admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 23 03:58:14.317069 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 635/1274] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:58:14 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:14.323134 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f7911-c511-498f-8357-cd435d538979 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:14.332688 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f7911-c511-498f-8357-cd435d538979 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:14.337170 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b67f2d-27da-4ec3-adcb-1ff7fe894e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:14.337814 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b67f2d-27da-4ec3-adcb-1ff7fe894e4e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:14.338092 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b67f2d-27da-4ec3-adcb-1ff7fe894e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:14.338415 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b67f2d-27da-4ec3-adcb-1ff7fe894e4e admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:14.339481 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b67f2d-27da-4ec3-adcb-1ff7fe894e4e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:14.339804 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b67f2d-27da-4ec3-adcb-1ff7fe894e4e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:14.341637 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b67f2d-27da-4ec3-adcb-1ff7fe894e4e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:14.359449 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 640/1275] 10.222.0.54 () {56 vars in 1164 bytes} [Tue Nov 23 03:58:14 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:14.366361 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b7d90-2137-4ede-a9e2-14ab6027c6da admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:14.375936 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b7d90-2137-4ede-a9e2-14ab6027c6da admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:14.380359 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c9991-796c-4174-9c8c-27ef7bc4c9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:14.380979 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c9991-796c-4174-9c8c-27ef7bc4c9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:14.381264 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c9991-796c-4174-9c8c-27ef7bc4c9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:14.381569 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c9991-796c-4174-9c8c-27ef7bc4c9d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:14.389079 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c9991-796c-4174-9c8c-27ef7bc4c9d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:14.390807 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c9991-796c-4174-9c8c-27ef7bc4c9d6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:14.399470 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 636/1276] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:58:14 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 03:58:14.405330 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b67f2d-27da-4ec3-adcb-1ff7fe894e4e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:14.415746 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b67f2d-27da-4ec3-adcb-1ff7fe894e4e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:14.420175 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771f99a-0614-466b-b09e-358fe09d644f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:14.420938 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771f99a-0614-466b-b09e-358fe09d644f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:14.421216 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771f99a-0614-466b-b09e-358fe09d644f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:14.421488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771f99a-0614-466b-b09e-358fe09d644f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:14.432241 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771f99a-0614-466b-b09e-358fe09d644f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:14.434061 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771f99a-0614-466b-b09e-358fe09d644f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:14.450906 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-0771f99a-0614-466b-b09e-358fe09d644f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:58:14.452071 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 641/1277] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:58:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:14.458184 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c9991-796c-4174-9c8c-27ef7bc4c9d6 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:14.466805 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c9991-796c-4174-9c8c-27ef7bc4c9d6 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:14.472064 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63892e4-1af5-458e-bd36-e19b93c2ed16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:14.472693 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63892e4-1af5-458e-bd36-e19b93c2ed16 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:14.472970 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63892e4-1af5-458e-bd36-e19b93c2ed16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:14.473279 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63892e4-1af5-458e-bd36-e19b93c2ed16 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:14.474005 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63892e4-1af5-458e-bd36-e19b93c2ed16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:14.474304 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63892e4-1af5-458e-bd36-e19b93c2ed16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:14.475897 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63892e4-1af5-458e-bd36-e19b93c2ed16 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:14.487967 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 637/1278] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:58:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:14.493953 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771f99a-0614-466b-b09e-358fe09d644f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:14.504205 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771f99a-0614-466b-b09e-358fe09d644f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:14.508834 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fb46e-b211-407e-9ef1-2a168bbbed07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:14.509604 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fb46e-b211-407e-9ef1-2a168bbbed07 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:14.509889 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fb46e-b211-407e-9ef1-2a168bbbed07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:14.510168 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fb46e-b211-407e-9ef1-2a168bbbed07 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:14.517433 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fb46e-b211-407e-9ef1-2a168bbbed07 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:14.519520 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fb46e-b211-407e-9ef1-2a168bbbed07 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:14.533251 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-da7fb46e-b211-407e-9ef1-2a168bbbed07 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:58:14.534369 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 642/1279] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:58:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:14.540657 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63892e4-1af5-458e-bd36-e19b93c2ed16 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:14.551245 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63892e4-1af5-458e-bd36-e19b93c2ed16 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:14.555748 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5bb8c-d14d-4f9c-af3d-2a2fd30640d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:14.560292 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5bb8c-d14d-4f9c-af3d-2a2fd30640d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:14.560292 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5bb8c-d14d-4f9c-af3d-2a2fd30640d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:14.560292 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5bb8c-d14d-4f9c-af3d-2a2fd30640d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:14.560292 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5bb8c-d14d-4f9c-af3d-2a2fd30640d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:14.560292 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5bb8c-d14d-4f9c-af3d-2a2fd30640d5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:14.560292 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5bb8c-d14d-4f9c-af3d-2a2fd30640d5 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:14.573395 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 638/1280] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:58:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:14.579871 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fb46e-b211-407e-9ef1-2a168bbbed07 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:14.590243 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fb46e-b211-407e-9ef1-2a168bbbed07 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:14.595483 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac002f1e-3ede-4d23-97fe-bc94b38cafe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:14.596118 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac002f1e-3ede-4d23-97fe-bc94b38cafe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:14.596399 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac002f1e-3ede-4d23-97fe-bc94b38cafe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:14.596694 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac002f1e-3ede-4d23-97fe-bc94b38cafe4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:14.597508 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac002f1e-3ede-4d23-97fe-bc94b38cafe4 admin admin] RBAC: Adding query filter params (role.id=3db7012b41944542a50049819500eadd, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=b23c3a2a6cfd4492b7d8eaa62dacec94) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:14.597814 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac002f1e-3ede-4d23-97fe-bc94b38cafe4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:14.599679 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac002f1e-3ede-4d23-97fe-bc94b38cafe4 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:14.605087 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 643/1281] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:58:14 2021] GET /identity/v3/role_assignments?user.id=b23c3a2a6cfd4492b7d8eaa62dacec94&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=3db7012b41944542a50049819500eadd => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:16.810419 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485e50c-4edd-4bc8-85e3-08a03b72c199 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:16.810950 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485e50c-4edd-4bc8-85e3-08a03b72c199 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:16.810950 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485e50c-4edd-4bc8-85e3-08a03b72c199 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:16.812767 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 639/1282] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:58:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:58:16.818737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34373432-88af-44c2-a20f-ca9165986c9c None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:16.819111 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34373432-88af-44c2-a20f-ca9165986c9c None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:16.819319 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34373432-88af-44c2-a20f-ca9165986c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:16.836220 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-34373432-88af-44c2-a20f-ca9165986c9c None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:58:16.837392 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-34373432-88af-44c2-a20f-ca9165986c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:58:16.845518 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 644/1283] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:58:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:58:16.868853 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485e50c-4edd-4bc8-85e3-08a03b72c199 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:16.881782 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485e50c-4edd-4bc8-85e3-08a03b72c199 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:16.886145 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e942f-9dbf-4465-841f-93a55b77d371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:16.886902 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e942f-9dbf-4465-841f-93a55b77d371 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:16.887177 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e942f-9dbf-4465-841f-93a55b77d371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:16.887472 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e942f-9dbf-4465-841f-93a55b77d371 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:16.898522 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e942f-9dbf-4465-841f-93a55b77d371 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:58:16.905257 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-9d1e942f-9dbf-4465-841f-93a55b77d371 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:58:16.906504 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 640/1284] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:58:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:16.912852 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34373432-88af-44c2-a20f-ca9165986c9c None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:16.921477 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34373432-88af-44c2-a20f-ca9165986c9c None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:16.925897 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b89615-2c0e-4447-9b66-cb73e67c9b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:16.926538 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b89615-2c0e-4447-9b66-cb73e67c9b92 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:16.926818 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b89615-2c0e-4447-9b66-cb73e67c9b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:16.927092 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b89615-2c0e-4447-9b66-cb73e67c9b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:16.927887 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b89615-2c0e-4447-9b66-cb73e67c9b92 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:16.928190 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b89615-2c0e-4447-9b66-cb73e67c9b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:16.929807 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b89615-2c0e-4447-9b66-cb73e67c9b92 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:16.937690 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 645/1285] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:58:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:16.944460 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e942f-9dbf-4465-841f-93a55b77d371 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:16.954595 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e942f-9dbf-4465-841f-93a55b77d371 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:16.958968 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5acae-9304-43b4-a8a6-86f17be9ac1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:16.959756 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5acae-9304-43b4-a8a6-86f17be9ac1d admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:16.960035 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5acae-9304-43b4-a8a6-86f17be9ac1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:16.960300 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5acae-9304-43b4-a8a6-86f17be9ac1d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:16.971240 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5acae-9304-43b4-a8a6-86f17be9ac1d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:16.979072 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5acae-9304-43b4-a8a6-86f17be9ac1d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:16.989544 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-18e5acae-9304-43b4-a8a6-86f17be9ac1d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:58:16.990830 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 641/1286] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:58:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:16.997104 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b89615-2c0e-4447-9b66-cb73e67c9b92 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:17.007437 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b89615-2c0e-4447-9b66-cb73e67c9b92 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:17.011930 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235181a-0a97-49cf-a83f-9ee1b33e38bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:17.012576 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235181a-0a97-49cf-a83f-9ee1b33e38bc admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:17.012850 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235181a-0a97-49cf-a83f-9ee1b33e38bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:17.013126 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235181a-0a97-49cf-a83f-9ee1b33e38bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:17.013878 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235181a-0a97-49cf-a83f-9ee1b33e38bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:17.014181 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235181a-0a97-49cf-a83f-9ee1b33e38bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:17.015771 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235181a-0a97-49cf-a83f-9ee1b33e38bc admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:17.027620 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 646/1287] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:58:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:17.033685 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5acae-9304-43b4-a8a6-86f17be9ac1d admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:17.043306 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5acae-9304-43b4-a8a6-86f17be9ac1d admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:17.049200 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3371563-d5fb-4923-8386-9c6d461ffc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:17.049987 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3371563-d5fb-4923-8386-9c6d461ffc65 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:17.051182 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3371563-d5fb-4923-8386-9c6d461ffc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:17.051182 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3371563-d5fb-4923-8386-9c6d461ffc65 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:17.058747 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3371563-d5fb-4923-8386-9c6d461ffc65 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:17.060861 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3371563-d5fb-4923-8386-9c6d461ffc65 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:17.074994 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-d3371563-d5fb-4923-8386-9c6d461ffc65 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 23 03:58:17.076175 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 642/1288] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:58:17 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:17.082512 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235181a-0a97-49cf-a83f-9ee1b33e38bc admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:17.091875 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235181a-0a97-49cf-a83f-9ee1b33e38bc admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:17.096583 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519a31d-1ff5-4981-a410-760a5468a690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:17.097225 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519a31d-1ff5-4981-a410-760a5468a690 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:17.097503 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519a31d-1ff5-4981-a410-760a5468a690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:17.097771 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519a31d-1ff5-4981-a410-760a5468a690 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:17.098599 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519a31d-1ff5-4981-a410-760a5468a690 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:17.098899 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519a31d-1ff5-4981-a410-760a5468a690 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:17.100730 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519a31d-1ff5-4981-a410-760a5468a690 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:17.118031 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 647/1289] 10.222.0.54 () {56 vars in 1164 bytes} [Tue Nov 23 03:58:17 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:17.123910 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3371563-d5fb-4923-8386-9c6d461ffc65 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:17.134093 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3371563-d5fb-4923-8386-9c6d461ffc65 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:17.138481 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a2d5c-21d2-4f21-812b-3b7332de09ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:17.139254 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a2d5c-21d2-4f21-812b-3b7332de09ba admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:17.139533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a2d5c-21d2-4f21-812b-3b7332de09ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:17.139800 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a2d5c-21d2-4f21-812b-3b7332de09ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:17.150284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a2d5c-21d2-4f21-812b-3b7332de09ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:17.152251 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a2d5c-21d2-4f21-812b-3b7332de09ba admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:17.168597 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-7f2a2d5c-21d2-4f21-812b-3b7332de09ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:58:17.169708 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 643/1290] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:58:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:17.176955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519a31d-1ff5-4981-a410-760a5468a690 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:17.186482 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519a31d-1ff5-4981-a410-760a5468a690 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:17.192104 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018098c-e24b-48f0-9437-1c09d009b65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:17.192775 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018098c-e24b-48f0-9437-1c09d009b65a admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:17.198683 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018098c-e24b-48f0-9437-1c09d009b65a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:17.198683 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018098c-e24b-48f0-9437-1c09d009b65a admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:17.198683 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018098c-e24b-48f0-9437-1c09d009b65a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:17.198683 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018098c-e24b-48f0-9437-1c09d009b65a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:17.198683 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018098c-e24b-48f0-9437-1c09d009b65a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:17.207580 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 648/1291] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:58:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:17.213427 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a2d5c-21d2-4f21-812b-3b7332de09ba admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:17.222873 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a2d5c-21d2-4f21-812b-3b7332de09ba admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:17.227357 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47195c8-3dd4-4529-9a08-288d0f2cfe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:17.228150 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47195c8-3dd4-4529-9a08-288d0f2cfe4b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:17.228431 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47195c8-3dd4-4529-9a08-288d0f2cfe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:17.228701 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47195c8-3dd4-4529-9a08-288d0f2cfe4b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:17.236052 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47195c8-3dd4-4529-9a08-288d0f2cfe4b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:17.237993 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47195c8-3dd4-4529-9a08-288d0f2cfe4b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:17.252182 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-a47195c8-3dd4-4529-9a08-288d0f2cfe4b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:58:17.253337 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 644/1292] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:58:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:17.259410 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018098c-e24b-48f0-9437-1c09d009b65a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:17.268962 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018098c-e24b-48f0-9437-1c09d009b65a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:17.273500 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50c0bd-77a0-4deb-87eb-6381ca02716d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:17.274122 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50c0bd-77a0-4deb-87eb-6381ca02716d admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:17.274407 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50c0bd-77a0-4deb-87eb-6381ca02716d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:17.274685 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50c0bd-77a0-4deb-87eb-6381ca02716d admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:17.275502 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50c0bd-77a0-4deb-87eb-6381ca02716d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:17.275813 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50c0bd-77a0-4deb-87eb-6381ca02716d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:17.277613 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50c0bd-77a0-4deb-87eb-6381ca02716d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:17.289577 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 649/1293] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:58:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:17.295814 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47195c8-3dd4-4529-9a08-288d0f2cfe4b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:17.306150 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47195c8-3dd4-4529-9a08-288d0f2cfe4b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:17.310677 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c56517-43b3-4f4d-95d9-998437f02166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:17.311560 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c56517-43b3-4f4d-95d9-998437f02166 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:17.311841 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c56517-43b3-4f4d-95d9-998437f02166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:17.312110 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c56517-43b3-4f4d-95d9-998437f02166 admin admin] PATH_INFO: `/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/b23c3a2a6cfd4492b7d8eaa62dacec94/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:17.314778 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c56517-43b3-4f4d-95d9-998437f02166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa78bb05b3e48f3a9c973567c781357, user_id=b23c3a2a6cfd4492b7d8eaa62dacec94, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:17.317435 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c56517-43b3-4f4d-95d9-998437f02166 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:17.483975 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 645/1294] 10.222.0.54 () {58 vars in 1460 bytes} [Tue Nov 23 03:58:17 2021] PUT /identity/v3/projects/cfa78bb05b3e48f3a9c973567c781357/users/b23c3a2a6cfd4492b7d8eaa62dacec94/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 03:58:19.693695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec35ba7-3a39-430a-84d2-cdf02042cdc9 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:19.694184 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec35ba7-3a39-430a-84d2-cdf02042cdc9 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:19.694305 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec35ba7-3a39-430a-84d2-cdf02042cdc9 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:19.696097 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 650/1295] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:58:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:58:19.701786 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91393220-ba33-417e-b93e-232807a4e819 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:19.702193 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91393220-ba33-417e-b93e-232807a4e819 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:19.702367 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91393220-ba33-417e-b93e-232807a4e819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:19.720502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-91393220-ba33-417e-b93e-232807a4e819 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:58:19.721664 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-91393220-ba33-417e-b93e-232807a4e819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:58:19.776672 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 646/1296] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:58:19 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:58:19.802229 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec35ba7-3a39-430a-84d2-cdf02042cdc9 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:19.814683 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec35ba7-3a39-430a-84d2-cdf02042cdc9 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:19.819199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5420b-098a-4726-969a-68c757c03b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:19.820004 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5420b-098a-4726-969a-68c757c03b13 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:19.820285 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5420b-098a-4726-969a-68c757c03b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:19.820555 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5420b-098a-4726-969a-68c757c03b13 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:19.830460 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5420b-098a-4726-969a-68c757c03b13 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 03:58:19.837205 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-d9f5420b-098a-4726-969a-68c757c03b13 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 03:58:19.838329 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 651/1297] 10.222.0.54 () {56 vars in 1117 bytes} [Tue Nov 23 03:58:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:19.845195 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91393220-ba33-417e-b93e-232807a4e819 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:19.854051 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91393220-ba33-417e-b93e-232807a4e819 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:19.858523 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d82ad-4ed8-45c1-ab04-644f77ad443b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:19.859160 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d82ad-4ed8-45c1-ab04-644f77ad443b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:19.859477 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d82ad-4ed8-45c1-ab04-644f77ad443b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:19.859745 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d82ad-4ed8-45c1-ab04-644f77ad443b admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:19.861479 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d82ad-4ed8-45c1-ab04-644f77ad443b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:19.861781 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d82ad-4ed8-45c1-ab04-644f77ad443b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:19.863360 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d82ad-4ed8-45c1-ab04-644f77ad443b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:19.871596 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 647/1298] 10.222.0.54 () {56 vars in 1120 bytes} [Tue Nov 23 03:58:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:19.877857 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5420b-098a-4726-969a-68c757c03b13 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:19.887735 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5420b-098a-4726-969a-68c757c03b13 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:19.892298 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b112b8-de98-4704-8762-38d9d82690eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:19.896022 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b112b8-de98-4704-8762-38d9d82690eb admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:19.896022 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b112b8-de98-4704-8762-38d9d82690eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:19.896022 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b112b8-de98-4704-8762-38d9d82690eb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:19.903697 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b112b8-de98-4704-8762-38d9d82690eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:19.905498 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b112b8-de98-4704-8762-38d9d82690eb admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:19.922339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-85b112b8-de98-4704-8762-38d9d82690eb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:58:19.924086 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 652/1299] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:58:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:58:19.958266 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d82ad-4ed8-45c1-ab04-644f77ad443b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:19.958266 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d82ad-4ed8-45c1-ab04-644f77ad443b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:19.958266 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad3f7a-c4e7-4497-a104-2391e31a11bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:19.958266 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad3f7a-c4e7-4497-a104-2391e31a11bf admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:19.958677 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad3f7a-c4e7-4497-a104-2391e31a11bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:19.958677 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad3f7a-c4e7-4497-a104-2391e31a11bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:19.958677 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad3f7a-c4e7-4497-a104-2391e31a11bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:19.958677 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad3f7a-c4e7-4497-a104-2391e31a11bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:19.958677 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad3f7a-c4e7-4497-a104-2391e31a11bf admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:19.959580 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 648/1300] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:58:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:19.965365 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b112b8-de98-4704-8762-38d9d82690eb admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:19.975255 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b112b8-de98-4704-8762-38d9d82690eb admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:19.979786 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0eefc-1f1c-4337-a074-eada57989a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:19.980563 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0eefc-1f1c-4337-a074-eada57989a07 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:19.980841 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0eefc-1f1c-4337-a074-eada57989a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:19.981112 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0eefc-1f1c-4337-a074-eada57989a07 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:19.989067 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0eefc-1f1c-4337-a074-eada57989a07 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:19.991049 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0eefc-1f1c-4337-a074-eada57989a07 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:20.004806 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-0fe0eefc-1f1c-4337-a074-eada57989a07 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 23 03:58:20.005924 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 653/1301] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:58:19 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:20.012249 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad3f7a-c4e7-4497-a104-2391e31a11bf admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:20.022985 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad3f7a-c4e7-4497-a104-2391e31a11bf admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:20.027571 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd084df-1e0f-461c-a25f-38b7b7acba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:20.028217 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd084df-1e0f-461c-a25f-38b7b7acba46 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:20.028501 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd084df-1e0f-461c-a25f-38b7b7acba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:20.028773 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd084df-1e0f-461c-a25f-38b7b7acba46 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:20.029609 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd084df-1e0f-461c-a25f-38b7b7acba46 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:20.029914 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd084df-1e0f-461c-a25f-38b7b7acba46 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:20.032571 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd084df-1e0f-461c-a25f-38b7b7acba46 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:20.050384 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 649/1302] 10.222.0.54 () {56 vars in 1164 bytes} [Tue Nov 23 03:58:20 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:20.056497 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0eefc-1f1c-4337-a074-eada57989a07 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:20.066380 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0eefc-1f1c-4337-a074-eada57989a07 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:20.070839 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9491b71-17a4-4fef-8fad-4515ade68b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:20.071495 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9491b71-17a4-4fef-8fad-4515ade68b96 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:20.071777 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9491b71-17a4-4fef-8fad-4515ade68b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:20.072050 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9491b71-17a4-4fef-8fad-4515ade68b96 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:20.080759 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9491b71-17a4-4fef-8fad-4515ade68b96 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:20.082500 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9491b71-17a4-4fef-8fad-4515ade68b96 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:20.091673 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 654/1303] 10.222.0.54 () {58 vars in 1324 bytes} [Tue Nov 23 03:58:20 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 03:58:20.098568 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd084df-1e0f-461c-a25f-38b7b7acba46 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:20.108116 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd084df-1e0f-461c-a25f-38b7b7acba46 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:20.112632 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513ce4f-fbdc-436f-84b0-a5e46d5c96d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:20.113424 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513ce4f-fbdc-436f-84b0-a5e46d5c96d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:20.113704 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513ce4f-fbdc-436f-84b0-a5e46d5c96d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:20.113973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513ce4f-fbdc-436f-84b0-a5e46d5c96d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:20.123957 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513ce4f-fbdc-436f-84b0-a5e46d5c96d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:20.125825 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513ce4f-fbdc-436f-84b0-a5e46d5c96d0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:20.142242 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-4513ce4f-fbdc-436f-84b0-a5e46d5c96d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 03:58:20.143454 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 650/1304] 10.222.0.54 () {56 vars in 1129 bytes} [Tue Nov 23 03:58:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:20.149881 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9491b71-17a4-4fef-8fad-4515ade68b96 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:20.159752 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9491b71-17a4-4fef-8fad-4515ade68b96 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:20.164558 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce120f-6017-452d-9cca-a25c910756c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:20.169390 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce120f-6017-452d-9cca-a25c910756c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:20.169390 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce120f-6017-452d-9cca-a25c910756c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:20.169390 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce120f-6017-452d-9cca-a25c910756c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:20.169390 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce120f-6017-452d-9cca-a25c910756c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:20.169390 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce120f-6017-452d-9cca-a25c910756c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:20.169390 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce120f-6017-452d-9cca-a25c910756c3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:20.179589 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 655/1305] 10.222.0.54 () {56 vars in 1130 bytes} [Tue Nov 23 03:58:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:20.185532 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513ce4f-fbdc-436f-84b0-a5e46d5c96d0 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:20.195155 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513ce4f-fbdc-436f-84b0-a5e46d5c96d0 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:20.199756 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba748e8-9983-471e-995b-d45b30e40f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:20.200510 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba748e8-9983-471e-995b-d45b30e40f23 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:20.200847 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba748e8-9983-471e-995b-d45b30e40f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:20.201120 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba748e8-9983-471e-995b-d45b30e40f23 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:20.208363 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba748e8-9983-471e-995b-d45b30e40f23 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:20.210193 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba748e8-9983-471e-995b-d45b30e40f23 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:20.223492 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING keystone.server.flask.application [None req-eba748e8-9983-471e-995b-d45b30e40f23 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 03:58:20.224592 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 651/1306] 10.222.0.54 () {56 vars in 1132 bytes} [Tue Nov 23 03:58:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:20.230799 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce120f-6017-452d-9cca-a25c910756c3 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:20.240715 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce120f-6017-452d-9cca-a25c910756c3 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:20.245361 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9b60c-5d42-4f46-8801-fecd09d9dcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:20.246003 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9b60c-5d42-4f46-8801-fecd09d9dcdb admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:20.246288 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9b60c-5d42-4f46-8801-fecd09d9dcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:20.246564 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9b60c-5d42-4f46-8801-fecd09d9dcdb admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:20.247484 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9b60c-5d42-4f46-8801-fecd09d9dcdb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:20.249824 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9b60c-5d42-4f46-8801-fecd09d9dcdb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:20.249824 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9b60c-5d42-4f46-8801-fecd09d9dcdb admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:20.262113 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 656/1307] 10.222.0.54 () {56 vars in 1169 bytes} [Tue Nov 23 03:58:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:20.269099 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba748e8-9983-471e-995b-d45b30e40f23 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:20.279035 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba748e8-9983-471e-995b-d45b30e40f23 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:20.284238 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb42a7c-39d3-4026-883a-cba15ffbb68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:20.284854 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb42a7c-39d3-4026-883a-cba15ffbb68f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:20.285127 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb42a7c-39d3-4026-883a-cba15ffbb68f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:20.285399 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb42a7c-39d3-4026-883a-cba15ffbb68f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:20.286215 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb42a7c-39d3-4026-883a-cba15ffbb68f admin admin] RBAC: Adding query filter params (role.id=3db7012b41944542a50049819500eadd, scope.project.id=cfa78bb05b3e48f3a9c973567c781357, user.id=b23c3a2a6cfd4492b7d8eaa62dacec94) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:20.286521 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb42a7c-39d3-4026-883a-cba15ffbb68f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:20.288342 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb42a7c-39d3-4026-883a-cba15ffbb68f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:20.293882 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 652/1308] 10.222.0.54 () {56 vars in 1395 bytes} [Tue Nov 23 03:58:20 2021] GET /identity/v3/role_assignments?user.id=b23c3a2a6cfd4492b7d8eaa62dacec94&scope.project.id=cfa78bb05b3e48f3a9c973567c781357&role.id=3db7012b41944542a50049819500eadd => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:22.540476 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4671a-b1b5-4339-8f62-fd91f0998f19 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:22.541025 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4671a-b1b5-4339-8f62-fd91f0998f19 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:22.541025 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4671a-b1b5-4339-8f62-fd91f0998f19 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:22.542843 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 657/1309] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:58:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:58:22.549484 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140be4b-d871-4415-8eca-19a46068d8ea None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:22.549868 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140be4b-d871-4415-8eca-19a46068d8ea None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:22.550027 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140be4b-d871-4415-8eca-19a46068d8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:22.568151 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-0140be4b-d871-4415-8eca-19a46068d8ea None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:58:22.569348 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-0140be4b-d871-4415-8eca-19a46068d8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:58:22.576973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 653/1310] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:58:22 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:58:22.599944 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4671a-b1b5-4339-8f62-fd91f0998f19 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:22.612257 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4671a-b1b5-4339-8f62-fd91f0998f19 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:22.616839 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137dcd1a-db4f-497c-b32d-9094d87999ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:22.617615 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dcd1a-db4f-497c-b32d-9094d87999ab admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:22.617897 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dcd1a-db4f-497c-b32d-9094d87999ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:22.618172 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dcd1a-db4f-497c-b32d-9094d87999ab admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:22.618834 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137dcd1a-db4f-497c-b32d-9094d87999ab admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:22.620438 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137dcd1a-db4f-497c-b32d-9094d87999ab admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:22.632586 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-137dcd1a-db4f-497c-b32d-9094d87999ab admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 23 03:58:22.633709 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 658/1311] 10.222.0.54 () {56 vars in 1138 bytes} [Tue Nov 23 03:58:22 2021] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:22.640086 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140be4b-d871-4415-8eca-19a46068d8ea None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:22.649365 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140be4b-d871-4415-8eca-19a46068d8ea None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:22.653850 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62c46b-bd04-41a0-9be8-83a4c7860dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:22.654506 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62c46b-bd04-41a0-9be8-83a4c7860dcd admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:22.654832 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62c46b-bd04-41a0-9be8-83a4c7860dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:22.655169 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62c46b-bd04-41a0-9be8-83a4c7860dcd admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:22.656032 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62c46b-bd04-41a0-9be8-83a4c7860dcd admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:22.656331 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62c46b-bd04-41a0-9be8-83a4c7860dcd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:22.658533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62c46b-bd04-41a0-9be8-83a4c7860dcd admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:22.663188 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 654/1312] 10.222.0.54 () {56 vars in 1137 bytes} [Tue Nov 23 03:58:22 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:22.669314 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137dcd1a-db4f-497c-b32d-9094d87999ab admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:22.679939 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137dcd1a-db4f-497c-b32d-9094d87999ab admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:22.684199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc7efe-9cdc-415f-bcd5-852771bf5aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:22.684843 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc7efe-9cdc-415f-bcd5-852771bf5aba admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:22.685126 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc7efe-9cdc-415f-bcd5-852771bf5aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:22.685402 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc7efe-9cdc-415f-bcd5-852771bf5aba admin admin] PATH_INFO: `/v3/services` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:22.686118 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc7efe-9cdc-415f-bcd5-852771bf5aba admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:22.686427 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc7efe-9cdc-415f-bcd5-852771bf5aba admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:22.688048 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc7efe-9cdc-415f-bcd5-852771bf5aba admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:22.692960 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 659/1313] 10.222.0.54 () {56 vars in 1137 bytes} [Tue Nov 23 03:58:22 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:24.916137 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c7bc3-2349-46da-bfb6-55c863eae2e6 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:24.916682 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c7bc3-2349-46da-bfb6-55c863eae2e6 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:24.916682 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c7bc3-2349-46da-bfb6-55c863eae2e6 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:24.918445 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 655/1314] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:58:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:58:24.924739 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6babc53-a0ee-4d69-97e6-15690d577b7d None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:24.925383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6babc53-a0ee-4d69-97e6-15690d577b7d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:24.925383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6babc53-a0ee-4d69-97e6-15690d577b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:24.947601 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-e6babc53-a0ee-4d69-97e6-15690d577b7d None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:58:24.947601 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e6babc53-a0ee-4d69-97e6-15690d577b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:58:24.952489 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 660/1315] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:58:24 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 03:58:24.976872 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c7bc3-2349-46da-bfb6-55c863eae2e6 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:24.988845 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c7bc3-2349-46da-bfb6-55c863eae2e6 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:24.993286 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33092b65-23de-4089-8307-3f1dadaec910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:24.993928 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33092b65-23de-4089-8307-3f1dadaec910 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:24.994214 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33092b65-23de-4089-8307-3f1dadaec910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:24.994492 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33092b65-23de-4089-8307-3f1dadaec910 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:24.995242 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33092b65-23de-4089-8307-3f1dadaec910 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:24.996824 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33092b65-23de-4089-8307-3f1dadaec910 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:25.087193 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 656/1316] 10.222.0.54 () {60 vars in 1162 bytes} [Tue Nov 23 03:58:24 2021] POST /identity/v3/services => generated 246 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 03:58:27.336070 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553811b-4c68-49c0-9f65-a5c057adf66b None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:27.336630 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553811b-4c68-49c0-9f65-a5c057adf66b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:27.336630 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553811b-4c68-49c0-9f65-a5c057adf66b None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:27.338394 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 661/1317] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:58:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:58:27.344115 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7f5a2-1b27-4893-8511-8cb941d32cb9 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:27.344720 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7f5a2-1b27-4893-8511-8cb941d32cb9 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:27.344720 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7f5a2-1b27-4893-8511-8cb941d32cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:27.362198 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-64f7f5a2-1b27-4893-8511-8cb941d32cb9 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:58:27.363408 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-64f7f5a2-1b27-4893-8511-8cb941d32cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:58:27.380311 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 657/1318] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:58:27 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:58:27.404944 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553811b-4c68-49c0-9f65-a5c057adf66b None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:27.417263 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553811b-4c68-49c0-9f65-a5c057adf66b None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:27.421654 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f99446-a1b1-4490-8b1e-d6c8fea4128f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:27.422429 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f99446-a1b1-4490-8b1e-d6c8fea4128f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:27.422707 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f99446-a1b1-4490-8b1e-d6c8fea4128f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:27.422982 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f99446-a1b1-4490-8b1e-d6c8fea4128f admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:27.423677 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f99446-a1b1-4490-8b1e-d6c8fea4128f admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:27.425302 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f99446-a1b1-4490-8b1e-d6c8fea4128f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:27.436006 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-42f99446-a1b1-4490-8b1e-d6c8fea4128f admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 23 03:58:27.437195 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 662/1319] 10.222.0.54 () {56 vars in 1138 bytes} [Tue Nov 23 03:58:27 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 03:58:27.443886 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7f5a2-1b27-4893-8511-8cb941d32cb9 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:27.452622 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7f5a2-1b27-4893-8511-8cb941d32cb9 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:27.459058 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d404a8-63ae-44f2-bdd7-ad993360f586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:27.459778 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d404a8-63ae-44f2-bdd7-ad993360f586 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:27.460059 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d404a8-63ae-44f2-bdd7-ad993360f586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:27.460329 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d404a8-63ae-44f2-bdd7-ad993360f586 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:27.461039 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d404a8-63ae-44f2-bdd7-ad993360f586 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:27.461339 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d404a8-63ae-44f2-bdd7-ad993360f586 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:27.462895 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d404a8-63ae-44f2-bdd7-ad993360f586 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:27.467963 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 658/1320] 10.222.0.54 () {56 vars in 1137 bytes} [Tue Nov 23 03:58:27 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:27.474173 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f99446-a1b1-4490-8b1e-d6c8fea4128f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:27.483674 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f99446-a1b1-4490-8b1e-d6c8fea4128f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:27.489232 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61c6d3-e149-4789-9760-f1457de66f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:27.489860 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61c6d3-e149-4789-9760-f1457de66f62 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:27.490151 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61c6d3-e149-4789-9760-f1457de66f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:27.490416 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61c6d3-e149-4789-9760-f1457de66f62 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:27.491200 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61c6d3-e149-4789-9760-f1457de66f62 admin admin] RBAC: Adding query filter params (interface=public, service_id=2df9644119674d43ac69282c5d2f1969, region_id=RegionOne) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:27.491537 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61c6d3-e149-4789-9760-f1457de66f62 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:27.493084 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61c6d3-e149-4789-9760-f1457de66f62 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:27.498114 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 663/1321] 10.222.0.54 () {56 vars in 1272 bytes} [Tue Nov 23 03:58:27 2021] GET /identity/v3/endpoints?service_id=2df9644119674d43ac69282c5d2f1969&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:27.504815 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d404a8-63ae-44f2-bdd7-ad993360f586 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:27.514267 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d404a8-63ae-44f2-bdd7-ad993360f586 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:27.518847 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7c686-6803-4f73-a3e9-0f5ba4cbdb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:27.519568 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7c686-6803-4f73-a3e9-0f5ba4cbdb40 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:27.519849 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7c686-6803-4f73-a3e9-0f5ba4cbdb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:27.520123 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7c686-6803-4f73-a3e9-0f5ba4cbdb40 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:27.520807 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7c686-6803-4f73-a3e9-0f5ba4cbdb40 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:27.522348 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7c686-6803-4f73-a3e9-0f5ba4cbdb40 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:27.529032 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 659/1322] 10.222.0.54 () {56 vars in 1108 bytes} [Tue Nov 23 03:58:27 2021] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 03:58:29.762706 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaed17-13d3-4222-96cd-0f1082f324a1 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:29.763272 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaed17-13d3-4222-96cd-0f1082f324a1 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:29.763272 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaed17-13d3-4222-96cd-0f1082f324a1 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:29.765093 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 664/1323] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 03:58:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 03:58:29.772002 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ff329-76ce-4e0a-a50d-5b7352a2a580 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:29.772412 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ff329-76ce-4e0a-a50d-5b7352a2a580 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:29.772590 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ff329-76ce-4e0a-a50d-5b7352a2a580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:29.791996 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-031ff329-76ce-4e0a-a50d-5b7352a2a580 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 03:58:29.793205 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-031ff329-76ce-4e0a-a50d-5b7352a2a580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 03:58:29.801286 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 660/1324] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 03:58:29 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 03:58:29.826692 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaed17-13d3-4222-96cd-0f1082f324a1 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:29.839507 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaed17-13d3-4222-96cd-0f1082f324a1 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:29.843846 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c558f9a-c0f4-4283-b096-d9070d03a2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:29.845347 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c558f9a-c0f4-4283-b096-d9070d03a2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:29.845631 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c558f9a-c0f4-4283-b096-d9070d03a2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:29.845905 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c558f9a-c0f4-4283-b096-d9070d03a2f7 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:29.846564 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c558f9a-c0f4-4283-b096-d9070d03a2f7 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:29.848156 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c558f9a-c0f4-4283-b096-d9070d03a2f7 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:29.858788 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING keystone.server.flask.application [None req-9c558f9a-c0f4-4283-b096-d9070d03a2f7 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 23 03:58:29.860039 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 665/1325] 10.222.0.54 () {56 vars in 1138 bytes} [Tue Nov 23 03:58:29 2021] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 03:58:29.866382 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ff329-76ce-4e0a-a50d-5b7352a2a580 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:29.875399 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ff329-76ce-4e0a-a50d-5b7352a2a580 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:29.880195 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ab0cb-2541-4967-9892-65f29b264242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:29.880926 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ab0cb-2541-4967-9892-65f29b264242 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:29.881206 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ab0cb-2541-4967-9892-65f29b264242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:29.881473 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ab0cb-2541-4967-9892-65f29b264242 admin admin] PATH_INFO: `/v3/services` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:29.882183 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ab0cb-2541-4967-9892-65f29b264242 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 03:58:29.882484 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ab0cb-2541-4967-9892-65f29b264242 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:29.884073 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ab0cb-2541-4967-9892-65f29b264242 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:29.889016 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 661/1326] 10.222.0.54 () {56 vars in 1137 bytes} [Tue Nov 23 03:58:29 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 03:58:29.896282 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c558f9a-c0f4-4283-b096-d9070d03a2f7 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 03:58:29.906125 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c558f9a-c0f4-4283-b096-d9070d03a2f7 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 03:58:29.911655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efe8aa-6df0-4e2c-aa3f-4f04bbd29ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 03:58:29.912291 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efe8aa-6df0-4e2c-aa3f-4f04bbd29ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 03:58:29.912573 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efe8aa-6df0-4e2c-aa3f-4f04bbd29ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 03:58:29.912850 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efe8aa-6df0-4e2c-aa3f-4f04bbd29ca3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 03:58:29.913688 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7efe8aa-6df0-4e2c-aa3f-4f04bbd29ca3 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 03:58:29.915269 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7efe8aa-6df0-4e2c-aa3f-4f04bbd29ca3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 03:58:29.994202 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 666/1327] 10.222.0.54 () {60 vars in 1165 bytes} [Tue Nov 23 03:58:29 2021] POST /identity/v3/endpoints => generated 331 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:06:00.298809 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de960703-9f0c-4c82-a3a6-6e974f48944f None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:00.299765 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de960703-9f0c-4c82-a3a6-6e974f48944f None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:00.300195 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de960703-9f0c-4c82-a3a6-6e974f48944f None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:00.308702 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae3d48-7010-4915-88e1-bc150169f9a3 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:00.309548 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae3d48-7010-4915-88e1-bc150169f9a3 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:00.309990 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae3d48-7010-4915-88e1-bc150169f9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:00.313478 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 662/1328] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:06:00 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:06:00.408200 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-2aae3d48-7010-4915-88e1-bc150169f9a3 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:06:00.409752 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-2aae3d48-7010-4915-88e1-bc150169f9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:00.596134 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 667/1329] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:06:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:06:00.608135 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de960703-9f0c-4c82-a3a6-6e974f48944f None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:06:00.609862 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-de960703-9f0c-4c82-a3a6-6e974f48944f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:00.867945 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de960703-9f0c-4c82-a3a6-6e974f48944f None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:06:00.989845 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45e070-8551-4208-88d8-775d09a99527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:06:00.990793 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45e070-8551-4208-88d8-775d09a99527 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:00.991238 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45e070-8551-4208-88d8-775d09a99527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:00.991714 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45e070-8551-4208-88d8-775d09a99527 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:00.992654 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45e070-8551-4208-88d8-775d09a99527 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:06:00.994747 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45e070-8551-4208-88d8-775d09a99527 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:06:01.015823 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 663/1330] 10.222.0.54 () {56 vars in 1108 bytes} [Tue Nov 23 04:06:00 2021] GET /identity/v3/projects => generated 2553 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:06:03.393613 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f75948-5429-4d80-8c07-8dd36393a035 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:03.394161 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f75948-5429-4d80-8c07-8dd36393a035 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:03.394161 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f75948-5429-4d80-8c07-8dd36393a035 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:03.396049 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 668/1331] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:06:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:06:03.401887 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c93dc-4d5b-4741-baa2-6f426cc5b1a4 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:03.402325 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c93dc-4d5b-4741-baa2-6f426cc5b1a4 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:03.402485 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c93dc-4d5b-4741-baa2-6f426cc5b1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:03.472184 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-ff4c93dc-4d5b-4741-baa2-6f426cc5b1a4 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:06:03.473919 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-ff4c93dc-4d5b-4741-baa2-6f426cc5b1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:03.566208 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 664/1332] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:06:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:06:03.617705 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdecc26-8d29-4b5b-9571-8d78db876d37 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:03.617990 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdecc26-8d29-4b5b-9571-8d78db876d37 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:03.618267 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdecc26-8d29-4b5b-9571-8d78db876d37 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:03.620119 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 669/1333] 10.222.0.54 () {54 vars in 964 bytes} [Tue Nov 23 04:06:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:06:03.626354 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f68b8-6482-4206-a707-3062683ca1f3 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:03.626650 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f68b8-6482-4206-a707-3062683ca1f3 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:03.626940 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f68b8-6482-4206-a707-3062683ca1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:03.703689 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-8b1f68b8-6482-4206-a707-3062683ca1f3 None None] MFA Rules not processed for user `5c06e29d656f48c99caeb193975b5b91`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:06:03.704893 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-8b1f68b8-6482-4206-a707-3062683ca1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:03.780688 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 665/1334] 10.222.0.54 () {58 vars in 1061 bytes} [Tue Nov 23 04:06:03 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:06:03.790547 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdecc26-8d29-4b5b-9571-8d78db876d37 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:06:03.792113 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-5bdecc26-8d29-4b5b-9571-8d78db876d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:03.891596 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdecc26-8d29-4b5b-9571-8d78db876d37 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:06:03.964189 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4558d2-05d3-4ccc-a1eb-42aca6691562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:06:03.964833 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4558d2-05d3-4ccc-a1eb-42aca6691562 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:03.965118 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4558d2-05d3-4ccc-a1eb-42aca6691562 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:03.965395 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4558d2-05d3-4ccc-a1eb-42aca6691562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:03.967059 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-df4558d2-05d3-4ccc-a1eb-42aca6691562 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:04.071826 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4558d2-05d3-4ccc-a1eb-42aca6691562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:06:04.073250 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4558d2-05d3-4ccc-a1eb-42aca6691562 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:06:04.090871 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 670/1335] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:06:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:06:06.610609 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab552d-a2dc-42d8-b9b0-aa732bc7e616 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:06.611112 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab552d-a2dc-42d8-b9b0-aa732bc7e616 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:06.611112 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab552d-a2dc-42d8-b9b0-aa732bc7e616 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:06.612991 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 666/1336] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:06:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:06:06.618609 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72316d8-c963-460f-8c76-451765d33dc9 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:06.619016 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72316d8-c963-460f-8c76-451765d33dc9 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:06.619173 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72316d8-c963-460f-8c76-451765d33dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:06.683766 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-c72316d8-c963-460f-8c76-451765d33dc9 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:06:06.684965 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-c72316d8-c963-460f-8c76-451765d33dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:06.776627 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 671/1337] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:06:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:06:06.815910 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab552d-a2dc-42d8-b9b0-aa732bc7e616 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:06:06.818177 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-91ab552d-a2dc-42d8-b9b0-aa732bc7e616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:06.916451 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab552d-a2dc-42d8-b9b0-aa732bc7e616 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:06:06.986745 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44718fb0-4a45-4c53-a71e-b639a48645b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:06:06.987404 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44718fb0-4a45-4c53-a71e-b639a48645b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:06.987691 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44718fb0-4a45-4c53-a71e-b639a48645b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:06.988490 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44718fb0-4a45-4c53-a71e-b639a48645b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:06.990111 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-44718fb0-4a45-4c53-a71e-b639a48645b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:07.095927 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44718fb0-4a45-4c53-a71e-b639a48645b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:06:07.097914 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44718fb0-4a45-4c53-a71e-b639a48645b6 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:06:07.115223 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 667/1338] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:06:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:06:09.967294 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb24353-6ce9-4671-9208-873faa49eb46 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:09.967822 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb24353-6ce9-4671-9208-873faa49eb46 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:09.967822 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb24353-6ce9-4671-9208-873faa49eb46 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:09.969609 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 672/1339] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:06:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:06:09.975344 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464a08e-ba58-4718-b979-266b3d4f024a None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:09.975735 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464a08e-ba58-4718-b979-266b3d4f024a None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:09.975900 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464a08e-ba58-4718-b979-266b3d4f024a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:10.038809 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-f464a08e-ba58-4718-b979-266b3d4f024a None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:06:10.040123 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-f464a08e-ba58-4718-b979-266b3d4f024a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:10.133849 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 668/1340] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:06:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:06:10.170015 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb24353-6ce9-4671-9208-873faa49eb46 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:06:10.171573 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-1cb24353-6ce9-4671-9208-873faa49eb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:10.290082 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb24353-6ce9-4671-9208-873faa49eb46 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:06:10.380870 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc3ced-cafa-46a1-a32a-6f9409274dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:06:10.381714 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc3ced-cafa-46a1-a32a-6f9409274dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:10.381998 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc3ced-cafa-46a1-a32a-6f9409274dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:10.382272 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc3ced-cafa-46a1-a32a-6f9409274dd9 admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:10.391876 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc3ced-cafa-46a1-a32a-6f9409274dd9 admin admin] RBAC: Authorizing `identity:get_project(project_id=04deb99f5f1a4beba726c6ac86a84723)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:06:10.393929 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc3ced-cafa-46a1-a32a-6f9409274dd9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:06:10.396273 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 673/1341] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 04:06:10 2021] GET /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:06:10.408677 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464a08e-ba58-4718-b979-266b3d4f024a None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:06:10.409915 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-f464a08e-ba58-4718-b979-266b3d4f024a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:10.494906 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464a08e-ba58-4718-b979-266b3d4f024a None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:06:10.563473 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63166ddd-22ac-4088-90ce-a575186ac24f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:06:10.564043 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63166ddd-22ac-4088-90ce-a575186ac24f service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:10.564328 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63166ddd-22ac-4088-90ce-a575186ac24f service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:10.564605 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63166ddd-22ac-4088-90ce-a575186ac24f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:10.566901 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-63166ddd-22ac-4088-90ce-a575186ac24f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:10.668830 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63166ddd-22ac-4088-90ce-a575186ac24f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:06:10.670263 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63166ddd-22ac-4088-90ce-a575186ac24f service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:06:10.688771 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 669/1342] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:06:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:06:13.949711 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e29f6-80a8-439f-9556-85594bc5d1d9 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:13.950286 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e29f6-80a8-439f-9556-85594bc5d1d9 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:13.950286 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e29f6-80a8-439f-9556-85594bc5d1d9 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:13.952044 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 674/1343] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:06:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:06:13.958474 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deceeda7-9db0-446c-8614-d59b781f47db None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:13.958962 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deceeda7-9db0-446c-8614-d59b781f47db None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:13.959066 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deceeda7-9db0-446c-8614-d59b781f47db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:14.020274 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-deceeda7-9db0-446c-8614-d59b781f47db None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:06:14.021445 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-deceeda7-9db0-446c-8614-d59b781f47db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:14.111270 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 670/1344] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:06:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:06:14.145382 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e29f6-80a8-439f-9556-85594bc5d1d9 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:06:14.146879 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-0d1e29f6-80a8-439f-9556-85594bc5d1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:14.263758 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e29f6-80a8-439f-9556-85594bc5d1d9 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:06:14.352901 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510b0b0-7801-4587-94b7-20ac711c3774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:06:14.353747 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510b0b0-7801-4587-94b7-20ac711c3774 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:14.354026 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510b0b0-7801-4587-94b7-20ac711c3774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:14.354295 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510b0b0-7801-4587-94b7-20ac711c3774 admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:14.363785 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510b0b0-7801-4587-94b7-20ac711c3774 admin admin] RBAC: Authorizing `identity:get_project(project_id=04deb99f5f1a4beba726c6ac86a84723)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:06:14.365823 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510b0b0-7801-4587-94b7-20ac711c3774 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:06:14.367521 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 675/1345] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 04:06:14 2021] GET /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:06:14.380378 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deceeda7-9db0-446c-8614-d59b781f47db None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:06:14.381574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-deceeda7-9db0-446c-8614-d59b781f47db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:14.467914 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deceeda7-9db0-446c-8614-d59b781f47db None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:06:14.538346 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38372cb-fac2-4769-b0b8-c0d8ece817e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:06:14.538916 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38372cb-fac2-4769-b0b8-c0d8ece817e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:14.539202 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38372cb-fac2-4769-b0b8-c0d8ece817e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:14.539507 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38372cb-fac2-4769-b0b8-c0d8ece817e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:14.541151 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-b38372cb-fac2-4769-b0b8-c0d8ece817e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:14.645009 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38372cb-fac2-4769-b0b8-c0d8ece817e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:06:14.648181 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38372cb-fac2-4769-b0b8-c0d8ece817e4 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:06:14.663661 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 671/1346] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:06:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:06:17.906633 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1795b6-3b5d-4ced-a022-a93fc0c4f46a None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:17.907191 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1795b6-3b5d-4ced-a022-a93fc0c4f46a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:17.907191 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1795b6-3b5d-4ced-a022-a93fc0c4f46a None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:17.909007 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 676/1347] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:06:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:06:17.915792 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edc87b-1896-49b6-b0f9-dd9151e64bf9 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:17.916392 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edc87b-1896-49b6-b0f9-dd9151e64bf9 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:17.916392 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edc87b-1896-49b6-b0f9-dd9151e64bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:17.984566 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-03edc87b-1896-49b6-b0f9-dd9151e64bf9 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:06:17.985797 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-03edc87b-1896-49b6-b0f9-dd9151e64bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:18.082385 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 672/1348] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:06:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:06:18.136362 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53823bc8-ab47-4353-b029-8405f41992ca None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:18.136656 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53823bc8-ab47-4353-b029-8405f41992ca None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:18.136933 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53823bc8-ab47-4353-b029-8405f41992ca None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:18.138717 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 677/1349] 10.222.0.54 () {54 vars in 964 bytes} [Tue Nov 23 04:06:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:06:18.145323 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b4fd9-78bc-4151-9999-7e6c2091125d None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:18.145614 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b4fd9-78bc-4151-9999-7e6c2091125d None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:18.145893 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b4fd9-78bc-4151-9999-7e6c2091125d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:18.219718 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-be8b4fd9-78bc-4151-9999-7e6c2091125d None None] MFA Rules not processed for user `5c06e29d656f48c99caeb193975b5b91`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:06:18.220920 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-be8b4fd9-78bc-4151-9999-7e6c2091125d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:18.294337 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 673/1350] 10.222.0.54 () {58 vars in 1061 bytes} [Tue Nov 23 04:06:18 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:06:18.303431 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53823bc8-ab47-4353-b029-8405f41992ca None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:06:18.305179 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-53823bc8-ab47-4353-b029-8405f41992ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:18.404444 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53823bc8-ab47-4353-b029-8405f41992ca None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:06:18.476014 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7eb12c-d193-4655-93c5-9677e67b4979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:06:18.476829 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7eb12c-d193-4655-93c5-9677e67b4979 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:18.477112 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7eb12c-d193-4655-93c5-9677e67b4979 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:18.477389 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7eb12c-d193-4655-93c5-9677e67b4979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:18.479010 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-cf7eb12c-d193-4655-93c5-9677e67b4979 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:18.583387 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7eb12c-d193-4655-93c5-9677e67b4979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:06:18.584733 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7eb12c-d193-4655-93c5-9677e67b4979 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:06:18.602587 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 678/1351] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:06:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:06:21.126583 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc1d1e-f39e-4397-b2e8-9337d55a48b0 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:21.127108 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc1d1e-f39e-4397-b2e8-9337d55a48b0 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:21.127108 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc1d1e-f39e-4397-b2e8-9337d55a48b0 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:21.129463 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 674/1352] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:06:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:06:21.137782 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454210d6-e043-4708-8fb5-e63f288b6656 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:21.137782 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454210d6-e043-4708-8fb5-e63f288b6656 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:21.137782 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454210d6-e043-4708-8fb5-e63f288b6656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:21.201125 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-454210d6-e043-4708-8fb5-e63f288b6656 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:06:21.202324 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-454210d6-e043-4708-8fb5-e63f288b6656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:21.293786 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 679/1353] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:06:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:06:21.330799 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc1d1e-f39e-4397-b2e8-9337d55a48b0 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:06:21.332957 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-34dc1d1e-f39e-4397-b2e8-9337d55a48b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:21.430920 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc1d1e-f39e-4397-b2e8-9337d55a48b0 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:06:21.499820 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6692f8-09ab-45c8-8f4f-1021e183b817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:06:21.500458 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6692f8-09ab-45c8-8f4f-1021e183b817 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:21.500737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6692f8-09ab-45c8-8f4f-1021e183b817 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:21.501010 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6692f8-09ab-45c8-8f4f-1021e183b817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:21.502610 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-9c6692f8-09ab-45c8-8f4f-1021e183b817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:21.613869 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6692f8-09ab-45c8-8f4f-1021e183b817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:06:21.615485 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6692f8-09ab-45c8-8f4f-1021e183b817 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:06:21.634407 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 675/1354] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:06:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:06:23.965328 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8e408-d92f-428c-b175-1dceaf7a0465 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:23.965859 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8e408-d92f-428c-b175-1dceaf7a0465 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:23.965859 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8e408-d92f-428c-b175-1dceaf7a0465 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:23.967604 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 680/1355] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:06:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:06:23.973643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa3d81-7843-42f8-99cc-e85d1ba9eb38 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:23.974074 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa3d81-7843-42f8-99cc-e85d1ba9eb38 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:23.974213 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa3d81-7843-42f8-99cc-e85d1ba9eb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:24.037977 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-bdfa3d81-7843-42f8-99cc-e85d1ba9eb38 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:06:24.039186 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-bdfa3d81-7843-42f8-99cc-e85d1ba9eb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:24.134210 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 676/1356] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:06:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:06:24.167461 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8e408-d92f-428c-b175-1dceaf7a0465 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:06:24.168985 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-65a8e408-d92f-428c-b175-1dceaf7a0465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:24.289980 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8e408-d92f-428c-b175-1dceaf7a0465 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:06:24.382638 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ba725-1901-46d7-9125-df8c677c0c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:06:24.383518 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ba725-1901-46d7-9125-df8c677c0c81 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:24.383804 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ba725-1901-46d7-9125-df8c677c0c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:24.384083 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ba725-1901-46d7-9125-df8c677c0c81 admin admin] PATH_INFO: `/v3/projects/04deb99f5f1a4beba726c6ac86a84723` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:24.394472 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ba725-1901-46d7-9125-df8c677c0c81 admin admin] RBAC: Authorizing `identity:get_project(project_id=04deb99f5f1a4beba726c6ac86a84723)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:06:24.396555 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ba725-1901-46d7-9125-df8c677c0c81 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:06:24.398453 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 681/1357] 10.222.0.54 () {56 vars in 1207 bytes} [Tue Nov 23 04:06:24 2021] GET /identity/v3/projects/04deb99f5f1a4beba726c6ac86a84723 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:06:24.410100 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa3d81-7843-42f8-99cc-e85d1ba9eb38 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:06:24.411356 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-bdfa3d81-7843-42f8-99cc-e85d1ba9eb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:24.509635 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa3d81-7843-42f8-99cc-e85d1ba9eb38 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:06:24.586142 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd99e0-c8fc-4beb-a340-b1ba3b5645f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:06:24.586800 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd99e0-c8fc-4beb-a340-b1ba3b5645f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:24.587081 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd99e0-c8fc-4beb-a340-b1ba3b5645f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:24.587399 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd99e0-c8fc-4beb-a340-b1ba3b5645f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:24.589073 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-1fdd99e0-c8fc-4beb-a340-b1ba3b5645f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:24.698514 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd99e0-c8fc-4beb-a340-b1ba3b5645f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:06:24.700024 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd99e0-c8fc-4beb-a340-b1ba3b5645f4 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:06:24.719174 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 677/1358] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:06:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:06:27.443325 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc00896-51a5-43c9-9b62-2f7bd91a9769 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:27.443854 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc00896-51a5-43c9-9b62-2f7bd91a9769 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:27.443854 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc00896-51a5-43c9-9b62-2f7bd91a9769 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:27.445596 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 682/1359] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:06:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:06:27.451315 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a242096-6869-415a-9aaf-b484321ae98d None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:27.451754 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a242096-6869-415a-9aaf-b484321ae98d None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:27.451867 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a242096-6869-415a-9aaf-b484321ae98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:27.515167 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-5a242096-6869-415a-9aaf-b484321ae98d None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:06:27.516379 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-5a242096-6869-415a-9aaf-b484321ae98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:27.609352 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 678/1360] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:06:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:06:27.647169 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc00896-51a5-43c9-9b62-2f7bd91a9769 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:06:27.648226 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-dfc00896-51a5-43c9-9b62-2f7bd91a9769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:27.747656 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc00896-51a5-43c9-9b62-2f7bd91a9769 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:06:27.816705 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d410b84-823e-4813-a4f6-76b5432f6f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:06:27.817344 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d410b84-823e-4813-a4f6-76b5432f6f38 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:27.817626 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d410b84-823e-4813-a4f6-76b5432f6f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:27.817898 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d410b84-823e-4813-a4f6-76b5432f6f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:27.819535 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-6d410b84-823e-4813-a4f6-76b5432f6f38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:27.921662 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d410b84-823e-4813-a4f6-76b5432f6f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:06:27.923072 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d410b84-823e-4813-a4f6-76b5432f6f38 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:06:27.941113 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 683/1361] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:06:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:06:30.215967 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ea91a-f1fc-422f-aa35-63f2ef8021fb None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:30.216530 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ea91a-f1fc-422f-aa35-63f2ef8021fb None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:30.216530 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ea91a-f1fc-422f-aa35-63f2ef8021fb None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:30.218342 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 679/1362] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:06:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:06:30.224522 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf84130-9f0e-41ba-969c-7909beb3b646 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:30.224946 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf84130-9f0e-41ba-969c-7909beb3b646 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:30.225056 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf84130-9f0e-41ba-969c-7909beb3b646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:30.287552 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-ddf84130-9f0e-41ba-969c-7909beb3b646 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:06:30.288725 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-ddf84130-9f0e-41ba-969c-7909beb3b646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:30.382775 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 684/1363] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:06:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:06:30.423727 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ea91a-f1fc-422f-aa35-63f2ef8021fb None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:06:30.425973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-571ea91a-f1fc-422f-aa35-63f2ef8021fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:30.524714 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ea91a-f1fc-422f-aa35-63f2ef8021fb None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:06:30.593975 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c0142-043d-472f-b32a-e8f7a268e673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:06:30.594604 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c0142-043d-472f-b32a-e8f7a268e673 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:30.594883 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c0142-043d-472f-b32a-e8f7a268e673 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:30.595153 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c0142-043d-472f-b32a-e8f7a268e673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:30.597418 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-497c0142-043d-472f-b32a-e8f7a268e673 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:30.704040 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c0142-043d-472f-b32a-e8f7a268e673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:06:30.705456 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c0142-043d-472f-b32a-e8f7a268e673 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:06:30.723846 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 680/1364] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:06:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:06:33.511721 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df2f69-a7bf-4226-b086-5e6fec66935d None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:33.512245 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df2f69-a7bf-4226-b086-5e6fec66935d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:33.512334 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df2f69-a7bf-4226-b086-5e6fec66935d None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:33.514048 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 685/1365] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:06:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:06:33.520389 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0c4af-62e1-4d64-bf2a-453e0c8a9550 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:33.520831 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0c4af-62e1-4d64-bf2a-453e0c8a9550 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:33.520933 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0c4af-62e1-4d64-bf2a-453e0c8a9550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:33.586868 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-9af0c4af-62e1-4d64-bf2a-453e0c8a9550 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:06:33.588007 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-9af0c4af-62e1-4d64-bf2a-453e0c8a9550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:33.685656 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 681/1366] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:06:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:06:33.723926 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df2f69-a7bf-4226-b086-5e6fec66935d None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:06:33.725860 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e8df2f69-a7bf-4226-b086-5e6fec66935d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:33.816394 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df2f69-a7bf-4226-b086-5e6fec66935d None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:06:33.819876 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf13d6-f65b-4217-b053-00894746116e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:06:33.820508 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf13d6-f65b-4217-b053-00894746116e service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:33.820786 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf13d6-f65b-4217-b053-00894746116e service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:33.821058 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf13d6-f65b-4217-b053-00894746116e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:33.829549 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf13d6-f65b-4217-b053-00894746116e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:06:33.831594 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf13d6-f65b-4217-b053-00894746116e service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:06:33.840567 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 686/1367] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:06:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:06:38.630650 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd78afa-4ea9-4b56-b5cf-b8acb38f4b4a None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:38.631147 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd78afa-4ea9-4b56-b5cf-b8acb38f4b4a None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:38.631147 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd78afa-4ea9-4b56-b5cf-b8acb38f4b4a None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:38.633026 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 682/1368] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:06:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:06:38.638627 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d09d95-122d-4058-a9c5-379eb1cef0c2 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:38.639011 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d09d95-122d-4058-a9c5-379eb1cef0c2 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:38.639198 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d09d95-122d-4058-a9c5-379eb1cef0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:38.656248 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-11d09d95-122d-4058-a9c5-379eb1cef0c2 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:06:38.657441 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-11d09d95-122d-4058-a9c5-379eb1cef0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:38.666671 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 687/1369] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:06:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:06:38.706975 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd78afa-4ea9-4b56-b5cf-b8acb38f4b4a None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:06:38.708684 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-4bd78afa-4ea9-4b56-b5cf-b8acb38f4b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:38.722082 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd78afa-4ea9-4b56-b5cf-b8acb38f4b4a None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:06:38.725808 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5a25d-c764-4fcc-a503-5c12a567d99d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:06:38.729918 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5a25d-c764-4fcc-a503-5c12a567d99d service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:38.729918 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5a25d-c764-4fcc-a503-5c12a567d99d service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:38.729918 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5a25d-c764-4fcc-a503-5c12a567d99d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:38.735973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5a25d-c764-4fcc-a503-5c12a567d99d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:06:38.737604 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5a25d-c764-4fcc-a503-5c12a567d99d service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:06:38.746916 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 683/1370] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:06:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:06:42.044845 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743f688-d577-4322-bb40-32db6f0a46e2 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:42.045380 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743f688-d577-4322-bb40-32db6f0a46e2 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:42.045380 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743f688-d577-4322-bb40-32db6f0a46e2 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:42.047177 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 688/1371] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:06:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:06:42.053677 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2641d65-d99b-4ace-87db-4737655c9ca9 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:42.054129 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2641d65-d99b-4ace-87db-4737655c9ca9 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:42.054224 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2641d65-d99b-4ace-87db-4737655c9ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:42.072224 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-b2641d65-d99b-4ace-87db-4737655c9ca9 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:06:42.073427 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-b2641d65-d99b-4ace-87db-4737655c9ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:42.081878 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 684/1372] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:06:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:06:42.120475 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743f688-d577-4322-bb40-32db6f0a46e2 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:06:42.132355 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743f688-d577-4322-bb40-32db6f0a46e2 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:06:42.135945 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6ed3a-8cc7-4fc8-a6f6-2cf1bfdd16c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:06:42.136599 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6ed3a-8cc7-4fc8-a6f6-2cf1bfdd16c1 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:42.136882 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6ed3a-8cc7-4fc8-a6f6-2cf1bfdd16c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:42.137159 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6ed3a-8cc7-4fc8-a6f6-2cf1bfdd16c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:42.147509 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6ed3a-8cc7-4fc8-a6f6-2cf1bfdd16c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:06:42.148953 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6ed3a-8cc7-4fc8-a6f6-2cf1bfdd16c1 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:06:42.159726 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 689/1373] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:06:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:06:47.045775 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c202f-0f82-4325-8687-567af24e4947 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:47.046366 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c202f-0f82-4325-8687-567af24e4947 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:47.046366 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c202f-0f82-4325-8687-567af24e4947 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:47.048129 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 685/1374] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:06:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:06:47.055035 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814db158-5a56-4261-a6ad-6fa7bdcb537a None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:47.055571 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814db158-5a56-4261-a6ad-6fa7bdcb537a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:47.055684 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814db158-5a56-4261-a6ad-6fa7bdcb537a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:47.074038 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-814db158-5a56-4261-a6ad-6fa7bdcb537a None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:06:47.075260 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-814db158-5a56-4261-a6ad-6fa7bdcb537a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:47.083158 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 690/1375] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:06:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:06:47.122559 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c202f-0f82-4325-8687-567af24e4947 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:06:47.133636 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c202f-0f82-4325-8687-567af24e4947 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:06:47.137102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a82a28-aa21-4d91-8511-e11d697bc593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:06:47.137737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a82a28-aa21-4d91-8511-e11d697bc593 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:47.138019 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a82a28-aa21-4d91-8511-e11d697bc593 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:47.138297 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a82a28-aa21-4d91-8511-e11d697bc593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:47.147790 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a82a28-aa21-4d91-8511-e11d697bc593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:06:47.149213 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a82a28-aa21-4d91-8511-e11d697bc593 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:06:47.158940 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 686/1376] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:06:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:06:51.983986 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adad9cf-5706-47a6-af81-468288c97e25 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:51.984929 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adad9cf-5706-47a6-af81-468288c97e25 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:51.985415 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adad9cf-5706-47a6-af81-468288c97e25 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:51.988577 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 691/1377] 10.222.0.54 () {54 vars in 921 bytes} [Tue Nov 23 04:06:51 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:06:51.998293 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08437a06-cadd-4587-bac1-b63f1a413093 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:51.999116 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08437a06-cadd-4587-bac1-b63f1a413093 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:51.999426 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08437a06-cadd-4587-bac1-b63f1a413093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:52.091139 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-08437a06-cadd-4587-bac1-b63f1a413093 None None] MFA Rules not processed for user `b23c3a2a6cfd4492b7d8eaa62dacec94`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:06:52.092645 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-08437a06-cadd-4587-bac1-b63f1a413093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:52.175991 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 687/1378] 10.222.0.54 () {58 vars in 1018 bytes} [Tue Nov 23 04:06:51 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:06:56.485975 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d81a4e-433c-4c35-bbd8-7a44658f33f7 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:56.486498 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d81a4e-433c-4c35-bbd8-7a44658f33f7 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:56.486498 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d81a4e-433c-4c35-bbd8-7a44658f33f7 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:56.488493 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 692/1379] 10.222.0.54 () {54 vars in 921 bytes} [Tue Nov 23 04:06:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:06:56.496450 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898aed7-8b87-4b4a-9fc3-ae6f9623aede None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:56.496862 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898aed7-8b87-4b4a-9fc3-ae6f9623aede None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:56.497065 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898aed7-8b87-4b4a-9fc3-ae6f9623aede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:56.517024 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-e898aed7-8b87-4b4a-9fc3-ae6f9623aede None None] MFA Rules not processed for user `b23c3a2a6cfd4492b7d8eaa62dacec94`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:06:56.518840 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-e898aed7-8b87-4b4a-9fc3-ae6f9623aede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:56.527410 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 688/1380] 10.222.0.54 () {58 vars in 1018 bytes} [Tue Nov 23 04:06:56 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:06:57.807109 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f11828-bcc4-4d44-99a6-4a2f071440ac None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:57.807662 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f11828-bcc4-4d44-99a6-4a2f071440ac None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:57.807776 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f11828-bcc4-4d44-99a6-4a2f071440ac None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:57.809468 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 693/1381] 10.222.0.54 () {54 vars in 921 bytes} [Tue Nov 23 04:06:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:06:57.815437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa592b34-26dc-4e27-92a2-096ec02a2d37 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:06:57.815869 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa592b34-26dc-4e27-92a2-096ec02a2d37 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:06:57.815992 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa592b34-26dc-4e27-92a2-096ec02a2d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:06:57.833917 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-aa592b34-26dc-4e27-92a2-096ec02a2d37 None None] MFA Rules not processed for user `b23c3a2a6cfd4492b7d8eaa62dacec94`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:06:57.835373 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-aa592b34-26dc-4e27-92a2-096ec02a2d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:06:57.845032 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 689/1382] 10.222.0.54 () {58 vars in 1018 bytes} [Tue Nov 23 04:06:57 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:07:01.623812 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676ae62-248a-4274-9a51-85ec4a8b8ee1 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:01.624322 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676ae62-248a-4274-9a51-85ec4a8b8ee1 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:01.624322 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676ae62-248a-4274-9a51-85ec4a8b8ee1 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:01.626865 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 694/1383] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:07:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:01.632840 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f203e9-907c-4d3a-96f0-865a63203981 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:01.633245 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f203e9-907c-4d3a-96f0-865a63203981 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:01.633394 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f203e9-907c-4d3a-96f0-865a63203981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:01.651928 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-99f203e9-907c-4d3a-96f0-865a63203981 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:01.653095 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-99f203e9-907c-4d3a-96f0-865a63203981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:01.661403 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 690/1384] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:07:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:07:01.712327 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a6c9f-b338-4f11-9912-4283109ec7fd None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:01.712609 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a6c9f-b338-4f11-9912-4283109ec7fd None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:01.713061 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a6c9f-b338-4f11-9912-4283109ec7fd None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:01.714844 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 695/1385] 10.222.0.54 () {54 vars in 961 bytes} [Tue Nov 23 04:07:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:01.721955 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957666b-4010-4c68-9c3f-351a976fd4c3 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:01.722396 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957666b-4010-4c68-9c3f-351a976fd4c3 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:01.722683 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957666b-4010-4c68-9c3f-351a976fd4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:01.774900 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-6957666b-4010-4c68-9c3f-351a976fd4c3 None None] MFA Rules not processed for user `35e14131fb22470cba63cd5e8db359e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:01.776359 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-6957666b-4010-4c68-9c3f-351a976fd4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:01.861889 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 691/1386] 10.222.0.54 () {58 vars in 1058 bytes} [Tue Nov 23 04:07:01 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:07:01.870466 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a6c9f-b338-4f11-9912-4283109ec7fd None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:07:01.887319 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a6c9f-b338-4f11-9912-4283109ec7fd None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:07:01.894055 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170feae3-e0da-4e3d-9dcf-c58bcbbc78a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:07:01.894924 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170feae3-e0da-4e3d-9dcf-c58bcbbc78a7 service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:01.895453 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170feae3-e0da-4e3d-9dcf-c58bcbbc78a7 service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:01.897693 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170feae3-e0da-4e3d-9dcf-c58bcbbc78a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:01.905972 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170feae3-e0da-4e3d-9dcf-c58bcbbc78a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:07:01.908415 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170feae3-e0da-4e3d-9dcf-c58bcbbc78a7 service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:07:01.918618 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 696/1387] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:07:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:07:04.529319 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489aa88-cee4-4cae-992c-7c415ac18fdf None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:04.529821 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489aa88-cee4-4cae-992c-7c415ac18fdf None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:04.529821 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489aa88-cee4-4cae-992c-7c415ac18fdf None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:04.531785 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 692/1388] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:07:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:04.537488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a47ef-fa08-46d8-8d06-4961db2b70fd None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:04.537885 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a47ef-fa08-46d8-8d06-4961db2b70fd None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:04.538038 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a47ef-fa08-46d8-8d06-4961db2b70fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:04.556351 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-554a47ef-fa08-46d8-8d06-4961db2b70fd None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:04.557663 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-554a47ef-fa08-46d8-8d06-4961db2b70fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:04.571253 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 697/1389] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:07:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:07:04.615717 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489aa88-cee4-4cae-992c-7c415ac18fdf None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:07:04.630416 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489aa88-cee4-4cae-992c-7c415ac18fdf None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:07:04.635743 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12da00-06b4-4785-a935-c6af79c48860 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:07:04.636377 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12da00-06b4-4785-a935-c6af79c48860 service nova] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:04.636660 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12da00-06b4-4785-a935-c6af79c48860 service nova] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:04.636936 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12da00-06b4-4785-a935-c6af79c48860 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:04.646121 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12da00-06b4-4785-a935-c6af79c48860 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:07:04.647745 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12da00-06b4-4785-a935-c6af79c48860 service nova] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:07:04.657257 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 693/1390] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:07:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:07:07.522763 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73f5b1-8540-4ed4-a8f5-bb97a13f9b72 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:07.523360 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73f5b1-8540-4ed4-a8f5-bb97a13f9b72 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:07.523360 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73f5b1-8540-4ed4-a8f5-bb97a13f9b72 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:07.525130 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 698/1391] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:07:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:07.530985 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bb556-6ff8-4f57-8ab6-b639eb70d3d1 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:07.531790 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bb556-6ff8-4f57-8ab6-b639eb70d3d1 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:07.533048 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bb556-6ff8-4f57-8ab6-b639eb70d3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:07.552728 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-aa9bb556-6ff8-4f57-8ab6-b639eb70d3d1 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:07.553922 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-aa9bb556-6ff8-4f57-8ab6-b639eb70d3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:07.561893 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 694/1392] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:07:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:07:07.609490 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fdaf8-d272-4898-a4b1-08ebe42eb2b0 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:07.609778 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fdaf8-d272-4898-a4b1-08ebe42eb2b0 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:07.610059 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fdaf8-d272-4898-a4b1-08ebe42eb2b0 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:07.612494 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 699/1393] 10.222.0.54 () {54 vars in 961 bytes} [Tue Nov 23 04:07:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:07.618624 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1235069-7c3c-4068-a88f-4bd631995dc5 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:07.618913 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1235069-7c3c-4068-a88f-4bd631995dc5 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:07.619195 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1235069-7c3c-4068-a88f-4bd631995dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:07.637895 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-e1235069-7c3c-4068-a88f-4bd631995dc5 None None] MFA Rules not processed for user `35e14131fb22470cba63cd5e8db359e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:07.639075 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-e1235069-7c3c-4068-a88f-4bd631995dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:07.648911 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 695/1394] 10.222.0.54 () {58 vars in 1058 bytes} [Tue Nov 23 04:07:07 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:07:07.658135 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fdaf8-d272-4898-a4b1-08ebe42eb2b0 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:07:07.672462 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fdaf8-d272-4898-a4b1-08ebe42eb2b0 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:07:07.682966 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd1e1f-16cf-46ca-881a-580cfe1679dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:07:07.683827 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd1e1f-16cf-46ca-881a-580cfe1679dd service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:07.684113 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd1e1f-16cf-46ca-881a-580cfe1679dd service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:07.684389 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd1e1f-16cf-46ca-881a-580cfe1679dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:07.693115 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd1e1f-16cf-46ca-881a-580cfe1679dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:07:07.694848 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd1e1f-16cf-46ca-881a-580cfe1679dd service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:07:07.707488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 700/1395] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:07:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:07:09.462917 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c3617-8fa9-435b-9980-8b334dc8f909 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:09.463522 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c3617-8fa9-435b-9980-8b334dc8f909 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:09.463522 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c3617-8fa9-435b-9980-8b334dc8f909 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:09.465288 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 696/1396] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:07:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:09.471913 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddf102-1af5-4985-b53f-a2fd619ca751 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:09.472383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddf102-1af5-4985-b53f-a2fd619ca751 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:09.472463 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddf102-1af5-4985-b53f-a2fd619ca751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:09.490282 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-c2ddf102-1af5-4985-b53f-a2fd619ca751 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:09.491504 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-c2ddf102-1af5-4985-b53f-a2fd619ca751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:09.499437 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 701/1397] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:07:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:07:09.552806 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838e6f5-4258-4c7d-8668-0d003cd49e60 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:09.553101 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838e6f5-4258-4c7d-8668-0d003cd49e60 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:09.553572 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838e6f5-4258-4c7d-8668-0d003cd49e60 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:09.555357 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 697/1398] 10.222.0.54 () {54 vars in 963 bytes} [Tue Nov 23 04:07:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:09.560790 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136483f4-fac6-456f-807c-8ce27f450a1b None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:09.561221 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136483f4-fac6-456f-807c-8ce27f450a1b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:09.561623 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136483f4-fac6-456f-807c-8ce27f450a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:09.615014 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-136483f4-fac6-456f-807c-8ce27f450a1b None None] MFA Rules not processed for user `3dd4736db18940b8961c73142381cee7`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:09.616431 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-136483f4-fac6-456f-807c-8ce27f450a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:09.685520 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 702/1399] 10.222.0.54 () {58 vars in 1060 bytes} [Tue Nov 23 04:07:09 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:07:09.694548 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838e6f5-4258-4c7d-8668-0d003cd49e60 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:07:09.707346 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838e6f5-4258-4c7d-8668-0d003cd49e60 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:07:09.711082 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e917a58-c374-49d4-9ff9-913ce570b4d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:07:09.711773 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e917a58-c374-49d4-9ff9-913ce570b4d2 service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:09.712075 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e917a58-c374-49d4-9ff9-913ce570b4d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:09.712334 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e917a58-c374-49d4-9ff9-913ce570b4d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:09.723115 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e917a58-c374-49d4-9ff9-913ce570b4d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:07:09.724790 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e917a58-c374-49d4-9ff9-913ce570b4d2 service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:07:09.735027 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 698/1400] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:07:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:07:10.240389 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f029b1-dff6-4b23-83d6-b406e561a9d9 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:10.240679 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f029b1-dff6-4b23-83d6-b406e561a9d9 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:10.241161 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f029b1-dff6-4b23-83d6-b406e561a9d9 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:10.242951 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 703/1401] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:07:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:10.248715 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b3689-7d8b-4d2e-8609-bc34e89d63b4 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:10.249009 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b3689-7d8b-4d2e-8609-bc34e89d63b4 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:10.249292 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b3689-7d8b-4d2e-8609-bc34e89d63b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:10.267251 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-c80b3689-7d8b-4d2e-8609-bc34e89d63b4 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:10.268723 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c80b3689-7d8b-4d2e-8609-bc34e89d63b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:10.276665 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 699/1402] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:07:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:07:10.323377 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f029b1-dff6-4b23-83d6-b406e561a9d9 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:07:10.339377 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f029b1-dff6-4b23-83d6-b406e561a9d9 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:07:10.346939 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d996f-017d-4c82-9c48-0f4a5f911887 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:07:10.347870 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d996f-017d-4c82-9c48-0f4a5f911887 service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:10.348331 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d996f-017d-4c82-9c48-0f4a5f911887 service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:10.348746 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d996f-017d-4c82-9c48-0f4a5f911887 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:10.358236 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d996f-017d-4c82-9c48-0f4a5f911887 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:07:10.359853 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d996f-017d-4c82-9c48-0f4a5f911887 service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:07:10.370238 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 704/1403] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:07:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:07:12.839323 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7f841-8c44-4cdb-ad32-a166463b7779 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:12.839900 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7f841-8c44-4cdb-ad32-a166463b7779 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:12.839900 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7f841-8c44-4cdb-ad32-a166463b7779 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:12.841640 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 700/1404] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:07:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:12.848550 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699db46d-5cae-4476-8af5-5f94f8ef3f2f None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:12.848998 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699db46d-5cae-4476-8af5-5f94f8ef3f2f None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:12.849099 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699db46d-5cae-4476-8af5-5f94f8ef3f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:12.868243 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-699db46d-5cae-4476-8af5-5f94f8ef3f2f None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:12.869441 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-699db46d-5cae-4476-8af5-5f94f8ef3f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:12.877706 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 705/1405] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:07:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:07:12.926514 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7f841-8c44-4cdb-ad32-a166463b7779 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:07:12.941655 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7f841-8c44-4cdb-ad32-a166463b7779 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:07:12.947151 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f38702-b123-4f92-b9b5-44de2eba88cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:07:12.947829 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f38702-b123-4f92-b9b5-44de2eba88cf service nova] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:12.948095 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f38702-b123-4f92-b9b5-44de2eba88cf service nova] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:12.948367 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f38702-b123-4f92-b9b5-44de2eba88cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:12.956583 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f38702-b123-4f92-b9b5-44de2eba88cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:07:12.958132 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f38702-b123-4f92-b9b5-44de2eba88cf service nova] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:07:12.967237 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 701/1406] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:07:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:07:15.529982 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533dd67-ac4e-4ca4-b247-19d835a809cf None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:15.530566 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533dd67-ac4e-4ca4-b247-19d835a809cf None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:15.530843 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533dd67-ac4e-4ca4-b247-19d835a809cf None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:15.533531 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 706/1407] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:07:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:15.539196 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8fbd8-8ca9-4acf-89a8-bf6618d5a698 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:15.540454 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8fbd8-8ca9-4acf-89a8-bf6618d5a698 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:15.540736 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8fbd8-8ca9-4acf-89a8-bf6618d5a698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:15.561068 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-a4c8fbd8-8ca9-4acf-89a8-bf6618d5a698 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:15.562241 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-a4c8fbd8-8ca9-4acf-89a8-bf6618d5a698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:15.571036 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 702/1408] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:07:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:07:15.619457 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533dd67-ac4e-4ca4-b247-19d835a809cf None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:07:15.635494 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533dd67-ac4e-4ca4-b247-19d835a809cf None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:07:15.640917 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b3339-2b16-424d-89a5-9d8a627d4cdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:07:15.641888 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b3339-2b16-424d-89a5-9d8a627d4cdd service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:15.642237 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b3339-2b16-424d-89a5-9d8a627d4cdd service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:15.642590 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b3339-2b16-424d-89a5-9d8a627d4cdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:15.651911 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b3339-2b16-424d-89a5-9d8a627d4cdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:07:15.653558 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b3339-2b16-424d-89a5-9d8a627d4cdd service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:07:15.663696 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 707/1409] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:07:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:07:18.152425 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddbd66-6360-4823-b9b7-3f666f018b97 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:18.153036 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddbd66-6360-4823-b9b7-3f666f018b97 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:18.153036 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddbd66-6360-4823-b9b7-3f666f018b97 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:18.154733 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 703/1410] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:07:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:18.161228 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d1dbd-6895-4200-aa7a-64748362a177 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:18.161669 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d1dbd-6895-4200-aa7a-64748362a177 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:18.161795 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d1dbd-6895-4200-aa7a-64748362a177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:18.180952 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-422d1dbd-6895-4200-aa7a-64748362a177 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:18.182152 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-422d1dbd-6895-4200-aa7a-64748362a177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:18.190081 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 708/1411] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:07:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:07:18.235711 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddbd66-6360-4823-b9b7-3f666f018b97 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:07:18.249760 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddbd66-6360-4823-b9b7-3f666f018b97 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:07:18.255557 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0f912-6080-4214-9fe8-586ea89f891c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:07:18.256190 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0f912-6080-4214-9fe8-586ea89f891c service nova] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:18.256472 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0f912-6080-4214-9fe8-586ea89f891c service nova] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:18.256749 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0f912-6080-4214-9fe8-586ea89f891c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:18.264732 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0f912-6080-4214-9fe8-586ea89f891c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:07:18.266394 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0f912-6080-4214-9fe8-586ea89f891c service nova] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:07:18.276330 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 704/1412] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:07:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:07:20.529685 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b509e1c-be8e-474f-8835-e444ab1962a6 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:20.530371 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b509e1c-be8e-474f-8835-e444ab1962a6 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:20.530371 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b509e1c-be8e-474f-8835-e444ab1962a6 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:20.532738 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 709/1413] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:07:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:20.538874 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b055318-2cd6-4dd0-a398-33b7648b12de None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:20.539363 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b055318-2cd6-4dd0-a398-33b7648b12de None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:20.539521 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b055318-2cd6-4dd0-a398-33b7648b12de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:20.558469 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-5b055318-2cd6-4dd0-a398-33b7648b12de None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:20.559781 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-5b055318-2cd6-4dd0-a398-33b7648b12de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:20.568321 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 705/1414] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:07:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:07:20.614986 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b509e1c-be8e-474f-8835-e444ab1962a6 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:07:20.633610 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b509e1c-be8e-474f-8835-e444ab1962a6 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:07:20.640273 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb45d3d-4eab-47cb-aca6-f81f956f2e5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:07:20.641670 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb45d3d-4eab-47cb-aca6-f81f956f2e5b service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:20.642289 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb45d3d-4eab-47cb-aca6-f81f956f2e5b service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:20.642633 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb45d3d-4eab-47cb-aca6-f81f956f2e5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:20.652687 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb45d3d-4eab-47cb-aca6-f81f956f2e5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:07:20.654772 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb45d3d-4eab-47cb-aca6-f81f956f2e5b service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:07:20.667667 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 710/1415] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:07:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:07:23.319072 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5afc7-777c-4e5e-8a20-be14e8e5d976 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:23.319804 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5afc7-777c-4e5e-8a20-be14e8e5d976 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:23.319804 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5afc7-777c-4e5e-8a20-be14e8e5d976 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:23.321518 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 706/1416] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:07:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:23.327876 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba1e0e-0838-4e87-8dbb-3887021d6ef3 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:23.332412 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba1e0e-0838-4e87-8dbb-3887021d6ef3 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:23.332412 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba1e0e-0838-4e87-8dbb-3887021d6ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:23.348987 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-6fba1e0e-0838-4e87-8dbb-3887021d6ef3 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:23.350188 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-6fba1e0e-0838-4e87-8dbb-3887021d6ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:23.359561 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 711/1417] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:07:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:07:23.406287 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5afc7-777c-4e5e-8a20-be14e8e5d976 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:07:23.420999 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5afc7-777c-4e5e-8a20-be14e8e5d976 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:07:23.427028 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f4be9-2490-4e1a-8b7f-e0022b1034ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:07:23.427705 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f4be9-2490-4e1a-8b7f-e0022b1034ef service nova] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:23.428005 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f4be9-2490-4e1a-8b7f-e0022b1034ef service nova] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:23.428289 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f4be9-2490-4e1a-8b7f-e0022b1034ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:23.436973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f4be9-2490-4e1a-8b7f-e0022b1034ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:07:23.439137 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f4be9-2490-4e1a-8b7f-e0022b1034ef service nova] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:07:23.448750 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 707/1418] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:07:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:07:25.835588 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9f170-f901-4375-b489-c54558e665f6 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:25.836188 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9f170-f901-4375-b489-c54558e665f6 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:25.836188 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9f170-f901-4375-b489-c54558e665f6 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:25.838060 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 712/1419] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:07:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:25.843591 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50390bb-5137-4dcf-86e5-7550ef22090a None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:25.846827 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50390bb-5137-4dcf-86e5-7550ef22090a None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:25.846827 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50390bb-5137-4dcf-86e5-7550ef22090a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:25.862249 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-a50390bb-5137-4dcf-86e5-7550ef22090a None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:25.863460 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-a50390bb-5137-4dcf-86e5-7550ef22090a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:25.871106 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 708/1420] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:07:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:07:25.917546 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9f170-f901-4375-b489-c54558e665f6 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:07:25.932292 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9f170-f901-4375-b489-c54558e665f6 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:07:25.937609 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d62e5-3499-4cf4-a205-3ade68ef351c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:07:25.938327 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d62e5-3499-4cf4-a205-3ade68ef351c service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:25.938607 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d62e5-3499-4cf4-a205-3ade68ef351c service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:25.938883 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d62e5-3499-4cf4-a205-3ade68ef351c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:25.947327 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d62e5-3499-4cf4-a205-3ade68ef351c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:07:25.948895 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d62e5-3499-4cf4-a205-3ade68ef351c service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:07:25.959992 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 713/1421] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:07:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:07:26.138568 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee4c9a-6ab8-4984-96bb-264e64ed2fd9 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:26.138877 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee4c9a-6ab8-4984-96bb-264e64ed2fd9 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:26.139153 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee4c9a-6ab8-4984-96bb-264e64ed2fd9 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:26.140983 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 709/1422] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:07:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:26.147027 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af48f19-72b2-4d6d-8f18-b846d7c76028 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:26.147577 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af48f19-72b2-4d6d-8f18-b846d7c76028 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:26.147868 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af48f19-72b2-4d6d-8f18-b846d7c76028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:26.167190 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-1af48f19-72b2-4d6d-8f18-b846d7c76028 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:26.168697 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-1af48f19-72b2-4d6d-8f18-b846d7c76028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:26.177788 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 714/1423] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:07:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:07:26.237869 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f02df-487a-4ae1-8267-fa2753a393c4 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:26.238260 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f02df-487a-4ae1-8267-fa2753a393c4 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:26.238601 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f02df-487a-4ae1-8267-fa2753a393c4 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:26.240516 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 710/1424] 10.222.0.54 () {54 vars in 962 bytes} [Tue Nov 23 04:07:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:26.246824 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c383b3-a644-4e28-a143-e54d2aa1316e None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:26.247110 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c383b3-a644-4e28-a143-e54d2aa1316e None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:26.247429 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c383b3-a644-4e28-a143-e54d2aa1316e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:26.301271 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-20c383b3-a644-4e28-a143-e54d2aa1316e None None] MFA Rules not processed for user `e1f52add52aa4586aee0b801ceffd764`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:26.302837 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-20c383b3-a644-4e28-a143-e54d2aa1316e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:26.369758 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 715/1425] 10.222.0.54 () {58 vars in 1059 bytes} [Tue Nov 23 04:07:26 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:07:26.378986 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f02df-487a-4ae1-8267-fa2753a393c4 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:07:26.389401 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f02df-487a-4ae1-8267-fa2753a393c4 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:07:26.393135 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044a380-f670-4c76-975d-c2012c9fa27d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f52add52aa4586aee0b801ceffd764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:07:26.393832 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044a380-f670-4c76-975d-c2012c9fa27d service glance] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:26.394174 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044a380-f670-4c76-975d-c2012c9fa27d service glance] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:26.394574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044a380-f670-4c76-975d-c2012c9fa27d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:26.403760 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044a380-f670-4c76-975d-c2012c9fa27d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:07:26.405231 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044a380-f670-4c76-975d-c2012c9fa27d service glance] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:07:26.415843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 711/1426] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:07:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:07:27.189879 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b9aca-4083-4e09-bcfa-f01d6a88bc6b None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:27.195765 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b9aca-4083-4e09-bcfa-f01d6a88bc6b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:27.195765 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b9aca-4083-4e09-bcfa-f01d6a88bc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:27.238833 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-8e3b9aca-4083-4e09-bcfa-f01d6a88bc6b None None] MFA Rules not processed for user `b68d0745d9cb49a5bd9331148967764a`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:27.240064 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-8e3b9aca-4083-4e09-bcfa-f01d6a88bc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:27.305575 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 716/1427] 10.222.0.54 () {58 vars in 1009 bytes} [Tue Nov 23 04:07:27 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:07:27.352763 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023244c-3ca5-4ca6-ab51-1d8640faac36 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:27.353254 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023244c-3ca5-4ca6-ab51-1d8640faac36 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:27.353351 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023244c-3ca5-4ca6-ab51-1d8640faac36 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:27.355071 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 712/1428] 10.222.0.54 () {54 vars in 942 bytes} [Tue Nov 23 04:07:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:27.363877 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8b0f2-6552-40a9-b7c8-2e1de558f842 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:27.364164 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8b0f2-6552-40a9-b7c8-2e1de558f842 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:27.364441 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8b0f2-6552-40a9-b7c8-2e1de558f842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:27.410775 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-37e8b0f2-6552-40a9-b7c8-2e1de558f842 None None] MFA Rules not processed for user `3bd439c1f0764f4cac7eb641a485937a`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:27.411983 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-37e8b0f2-6552-40a9-b7c8-2e1de558f842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:27.479694 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 717/1429] 10.222.0.54 () {58 vars in 1039 bytes} [Tue Nov 23 04:07:27 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:07:27.490412 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023244c-3ca5-4ca6-ab51-1d8640faac36 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:07:27.504451 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023244c-3ca5-4ca6-ab51-1d8640faac36 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:07:27.509281 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef534534-7900-4cac-9b10-c23818d32a52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd439c1f0764f4cac7eb641a485937a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:07:27.509905 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef534534-7900-4cac-9b10-c23818d32a52 service swift] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:27.510183 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef534534-7900-4cac-9b10-c23818d32a52 service swift] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:27.510455 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef534534-7900-4cac-9b10-c23818d32a52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:27.518554 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef534534-7900-4cac-9b10-c23818d32a52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:07:27.520177 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef534534-7900-4cac-9b10-c23818d32a52 service swift] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:07:27.527831 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 713/1430] 10.222.0.54 () {60 vars in 1384 bytes} [Tue Nov 23 04:07:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 04:07:28.373750 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf184db6-3994-4416-837a-f15d7b7e8512 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:28.374295 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf184db6-3994-4416-837a-f15d7b7e8512 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:28.374295 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf184db6-3994-4416-837a-f15d7b7e8512 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:28.377452 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 718/1431] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:07:28 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:28.382470 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde902a-7b92-4b6b-9de0-cfd372779c41 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:28.382995 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde902a-7b92-4b6b-9de0-cfd372779c41 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:28.382995 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde902a-7b92-4b6b-9de0-cfd372779c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:28.405590 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-edde902a-7b92-4b6b-9de0-cfd372779c41 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:28.407412 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-edde902a-7b92-4b6b-9de0-cfd372779c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:28.415830 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 714/1432] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:07:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:07:28.461790 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf184db6-3994-4416-837a-f15d7b7e8512 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:07:28.478301 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf184db6-3994-4416-837a-f15d7b7e8512 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:07:28.485712 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbf3ec-6a48-4be8-be46-94a38c35380b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:07:28.486443 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbf3ec-6a48-4be8-be46-94a38c35380b service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:28.486803 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbf3ec-6a48-4be8-be46-94a38c35380b service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:28.487152 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbf3ec-6a48-4be8-be46-94a38c35380b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:28.496275 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbf3ec-6a48-4be8-be46-94a38c35380b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:07:28.497960 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbf3ec-6a48-4be8-be46-94a38c35380b service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:07:28.507624 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 719/1433] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:07:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:07:31.134527 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35523c-7f1e-4160-b203-f9273afd5143 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:31.135080 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35523c-7f1e-4160-b203-f9273afd5143 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:31.135080 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35523c-7f1e-4160-b203-f9273afd5143 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:31.136953 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 715/1434] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:07:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:31.145454 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0de92-fc72-4bc7-b48c-d037f66f19fa None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:31.145962 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0de92-fc72-4bc7-b48c-d037f66f19fa None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:31.146150 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0de92-fc72-4bc7-b48c-d037f66f19fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:31.170854 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-dce0de92-fc72-4bc7-b48c-d037f66f19fa None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:31.173267 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-dce0de92-fc72-4bc7-b48c-d037f66f19fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:31.182558 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 720/1435] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:07:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:07:31.231843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35523c-7f1e-4160-b203-f9273afd5143 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:07:31.254100 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35523c-7f1e-4160-b203-f9273afd5143 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:07:31.260404 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c67ed-c013-4635-a1aa-fff3e6ae3f5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:07:31.261054 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c67ed-c013-4635-a1aa-fff3e6ae3f5c service nova] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:31.261338 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c67ed-c013-4635-a1aa-fff3e6ae3f5c service nova] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:31.261621 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c67ed-c013-4635-a1aa-fff3e6ae3f5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:31.275104 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c67ed-c013-4635-a1aa-fff3e6ae3f5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:07:31.276861 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c67ed-c013-4635-a1aa-fff3e6ae3f5c service nova] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:07:31.287232 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 716/1436] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:07:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:07:51.892785 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8735c2-ba36-4c0a-b3cb-f8b198cb9b8d None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:51.893346 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8735c2-ba36-4c0a-b3cb-f8b198cb9b8d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:51.893346 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8735c2-ba36-4c0a-b3cb-f8b198cb9b8d None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:51.895128 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 721/1437] 10.222.0.54 () {54 vars in 918 bytes} [Tue Nov 23 04:07:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:51.900847 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5705c17-6fdf-4d9c-96e8-21d6fa6e6c39 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:51.901256 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5705c17-6fdf-4d9c-96e8-21d6fa6e6c39 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:51.901395 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5705c17-6fdf-4d9c-96e8-21d6fa6e6c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:51.919328 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-c5705c17-6fdf-4d9c-96e8-21d6fa6e6c39 None None] MFA Rules not processed for user `b23c3a2a6cfd4492b7d8eaa62dacec94`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:51.920515 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c5705c17-6fdf-4d9c-96e8-21d6fa6e6c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:51.929608 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 717/1438] 10.222.0.54 () {58 vars in 1015 bytes} [Tue Nov 23 04:07:51 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:07:51.944431 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375c8c8-f5d6-4f2b-9d06-582d79fb7b1e None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:51.944748 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375c8c8-f5d6-4f2b-9d06-582d79fb7b1e None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:51.945029 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375c8c8-f5d6-4f2b-9d06-582d79fb7b1e None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:51.946762 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 722/1439] 10.222.0.54 () {54 vars in 918 bytes} [Tue Nov 23 04:07:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:51.951765 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681bc6d-0692-4670-99c4-fe02161952ed None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:51.952105 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681bc6d-0692-4670-99c4-fe02161952ed None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:51.952437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681bc6d-0692-4670-99c4-fe02161952ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:51.970009 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-f681bc6d-0692-4670-99c4-fe02161952ed None None] MFA Rules not processed for user `35e14131fb22470cba63cd5e8db359e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:51.971190 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-f681bc6d-0692-4670-99c4-fe02161952ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:51.980044 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 718/1440] 10.222.0.54 () {58 vars in 1015 bytes} [Tue Nov 23 04:07:51 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:07:54.785066 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d5608-ac5c-4cfe-b43d-c22edc59635b None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:54.785595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d5608-ac5c-4cfe-b43d-c22edc59635b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:54.785595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d5608-ac5c-4cfe-b43d-c22edc59635b None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:54.787408 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 04:07:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:54.793239 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c5353-a6a0-4baa-ac42-9cab1dd009e2 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:54.793699 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c5353-a6a0-4baa-ac42-9cab1dd009e2 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:54.793821 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c5353-a6a0-4baa-ac42-9cab1dd009e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:54.811817 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-878c5353-a6a0-4baa-ac42-9cab1dd009e2 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:54.813029 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-878c5353-a6a0-4baa-ac42-9cab1dd009e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:54.820603 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 04:07:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:07:54.864200 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d5608-ac5c-4cfe-b43d-c22edc59635b None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:07:54.878605 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d5608-ac5c-4cfe-b43d-c22edc59635b None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:07:54.883911 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1356200-fe2b-4442-bc9a-fe26bfd389e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:07:54.884534 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1356200-fe2b-4442-bc9a-fe26bfd389e8 service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:54.884816 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1356200-fe2b-4442-bc9a-fe26bfd389e8 service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:54.885090 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1356200-fe2b-4442-bc9a-fe26bfd389e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:54.893621 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1356200-fe2b-4442-bc9a-fe26bfd389e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:07:54.895160 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1356200-fe2b-4442-bc9a-fe26bfd389e8 service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:07:54.904091 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 724/1443] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:07:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:07:56.363351 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabb1b2-06ec-4bf1-a396-d7a42390ffc1 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:56.363932 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabb1b2-06ec-4bf1-a396-d7a42390ffc1 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:56.363932 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabb1b2-06ec-4bf1-a396-d7a42390ffc1 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:56.365747 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 04:07:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:56.371364 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0598214-1d2e-4f70-a55f-d00bc28ced1b None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:56.371766 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0598214-1d2e-4f70-a55f-d00bc28ced1b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:56.371932 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0598214-1d2e-4f70-a55f-d00bc28ced1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:56.390724 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-a0598214-1d2e-4f70-a55f-d00bc28ced1b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:56.391942 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-a0598214-1d2e-4f70-a55f-d00bc28ced1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:56.399696 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 04:07:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:07:56.552811 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabb1b2-06ec-4bf1-a396-d7a42390ffc1 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:07:56.566883 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabb1b2-06ec-4bf1-a396-d7a42390ffc1 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:07:56.572206 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46fa84-a201-4c01-9161-cd7ae9bc9419 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:07:56.572839 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46fa84-a201-4c01-9161-cd7ae9bc9419 service nova] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:56.573103 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46fa84-a201-4c01-9161-cd7ae9bc9419 service nova] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:56.573380 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46fa84-a201-4c01-9161-cd7ae9bc9419 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:56.581175 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46fa84-a201-4c01-9161-cd7ae9bc9419 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:07:56.582723 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46fa84-a201-4c01-9161-cd7ae9bc9419 service nova] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:07:56.591727 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 721/1446] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:07:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:07:58.022356 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19f7d7-0087-463a-8dc9-b10424bc926e None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:58.022926 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19f7d7-0087-463a-8dc9-b10424bc926e None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:58.022926 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19f7d7-0087-463a-8dc9-b10424bc926e None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:58.024723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 04:07:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:58.030577 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa64b2e-f095-47e2-a377-ab66bed0fdfe None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:58.031066 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa64b2e-f095-47e2-a377-ab66bed0fdfe None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:58.031300 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa64b2e-f095-47e2-a377-ab66bed0fdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:58.049279 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-caa64b2e-f095-47e2-a377-ab66bed0fdfe None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:58.050464 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-caa64b2e-f095-47e2-a377-ab66bed0fdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:58.058305 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 04:07:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:07:58.212750 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19f7d7-0087-463a-8dc9-b10424bc926e None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:07:58.227476 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19f7d7-0087-463a-8dc9-b10424bc926e None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:07:58.232697 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842c617-cd91-4aad-b1ab-25b397ca1a3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:07:58.233322 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842c617-cd91-4aad-b1ab-25b397ca1a3c service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:58.233778 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842c617-cd91-4aad-b1ab-25b397ca1a3c service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:58.234054 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842c617-cd91-4aad-b1ab-25b397ca1a3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:58.242252 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842c617-cd91-4aad-b1ab-25b397ca1a3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:07:58.243838 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842c617-cd91-4aad-b1ab-25b397ca1a3c service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:07:58.253001 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 727/1449] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:07:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:07:59.656579 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd6d86-8c8d-4810-bdb9-eb964655aae0 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:59.657147 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd6d86-8c8d-4810-bdb9-eb964655aae0 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:59.657147 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd6d86-8c8d-4810-bdb9-eb964655aae0 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:59.658906 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 04:07:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:07:59.664574 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397dd79-a36d-432c-ad0d-108b9577a292 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:59.664988 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397dd79-a36d-432c-ad0d-108b9577a292 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:59.665127 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397dd79-a36d-432c-ad0d-108b9577a292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:59.683445 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-0397dd79-a36d-432c-ad0d-108b9577a292 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:07:59.684625 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-0397dd79-a36d-432c-ad0d-108b9577a292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:07:59.692877 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 04:07:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:07:59.843993 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd6d86-8c8d-4810-bdb9-eb964655aae0 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:07:59.857754 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd6d86-8c8d-4810-bdb9-eb964655aae0 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:07:59.863561 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4bc6d-542c-4bd5-8982-b2c4ac115efd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:07:59.864181 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4bc6d-542c-4bd5-8982-b2c4ac115efd service nova] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:07:59.864461 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4bc6d-542c-4bd5-8982-b2c4ac115efd service nova] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:07:59.864732 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4bc6d-542c-4bd5-8982-b2c4ac115efd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:07:59.872503 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4bc6d-542c-4bd5-8982-b2c4ac115efd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:07:59.874888 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4bc6d-542c-4bd5-8982-b2c4ac115efd service nova] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:07:59.883910 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 724/1452] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:07:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:08:01.349170 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedeae2-28eb-4189-b947-879a4ba809d1 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:01.349710 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedeae2-28eb-4189-b947-879a4ba809d1 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:01.349710 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedeae2-28eb-4189-b947-879a4ba809d1 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:01.351710 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 04:08:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:08:01.357290 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4687787-99f0-4f01-8728-09cf821d0cbd None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:01.357714 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4687787-99f0-4f01-8728-09cf821d0cbd None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:01.358368 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4687787-99f0-4f01-8728-09cf821d0cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:01.376452 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-b4687787-99f0-4f01-8728-09cf821d0cbd None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:08:01.377636 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-b4687787-99f0-4f01-8728-09cf821d0cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:08:01.385308 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 04:08:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:08:01.538259 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedeae2-28eb-4189-b947-879a4ba809d1 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:08:01.552727 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedeae2-28eb-4189-b947-879a4ba809d1 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:08:01.557888 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3c877-b9c1-4fbb-986b-800c4e870368 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:08:01.558506 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3c877-b9c1-4fbb-986b-800c4e870368 service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:01.558784 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3c877-b9c1-4fbb-986b-800c4e870368 service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:01.559055 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3c877-b9c1-4fbb-986b-800c4e870368 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:01.566783 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3c877-b9c1-4fbb-986b-800c4e870368 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:08:01.568359 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3c877-b9c1-4fbb-986b-800c4e870368 service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:08:01.577414 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 730/1455] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:08:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:08:03.014529 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e4f88-d1db-435e-9193-bb489107778a None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:03.015091 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e4f88-d1db-435e-9193-bb489107778a None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:03.015091 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e4f88-d1db-435e-9193-bb489107778a None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:03.016911 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 04:08:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:08:03.022392 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43968f6d-3e0a-466c-abfa-eff4a0492ee3 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:03.022817 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43968f6d-3e0a-466c-abfa-eff4a0492ee3 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:03.022995 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43968f6d-3e0a-466c-abfa-eff4a0492ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:03.040885 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-43968f6d-3e0a-466c-abfa-eff4a0492ee3 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:08:03.042069 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-43968f6d-3e0a-466c-abfa-eff4a0492ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:08:03.050803 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 04:08:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:08:03.202876 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e4f88-d1db-435e-9193-bb489107778a None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:08:03.217019 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e4f88-d1db-435e-9193-bb489107778a None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:08:03.222895 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e9bd2-c591-4618-bff3-71d16a594549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:08:03.223559 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e9bd2-c591-4618-bff3-71d16a594549 service nova] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:03.223841 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e9bd2-c591-4618-bff3-71d16a594549 service nova] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:03.224117 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e9bd2-c591-4618-bff3-71d16a594549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:03.232066 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e9bd2-c591-4618-bff3-71d16a594549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:08:03.234432 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e9bd2-c591-4618-bff3-71d16a594549 service nova] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:08:03.243537 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 727/1458] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:08:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:08:04.679195 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8a5a5-768f-4f2a-8143-b63b47cd2515 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:04.679775 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8a5a5-768f-4f2a-8143-b63b47cd2515 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:04.679775 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8a5a5-768f-4f2a-8143-b63b47cd2515 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:04.681555 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 04:08:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:08:04.687161 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c6d0b-33cf-4c7a-90a0-66aa1a5c51d1 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:04.687591 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c6d0b-33cf-4c7a-90a0-66aa1a5c51d1 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:04.687756 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c6d0b-33cf-4c7a-90a0-66aa1a5c51d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:04.705453 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-192c6d0b-33cf-4c7a-90a0-66aa1a5c51d1 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:08:04.706625 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-192c6d0b-33cf-4c7a-90a0-66aa1a5c51d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:08:04.714137 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 04:08:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:08:04.869254 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8a5a5-768f-4f2a-8143-b63b47cd2515 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:08:04.884246 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8a5a5-768f-4f2a-8143-b63b47cd2515 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:08:04.890658 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee53120-cd76-4059-bf92-fd3c24ee1390 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:08:04.891321 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee53120-cd76-4059-bf92-fd3c24ee1390 service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:04.891610 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee53120-cd76-4059-bf92-fd3c24ee1390 service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:04.891889 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee53120-cd76-4059-bf92-fd3c24ee1390 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:04.899904 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee53120-cd76-4059-bf92-fd3c24ee1390 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:08:04.901453 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee53120-cd76-4059-bf92-fd3c24ee1390 service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:08:04.911160 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 733/1461] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:08:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:08:06.325977 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4260a-ca0f-4c52-a71c-7cb193093304 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:06.326466 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4260a-ca0f-4c52-a71c-7cb193093304 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:06.326622 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4260a-ca0f-4c52-a71c-7cb193093304 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:06.328561 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 04:08:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:08:06.334285 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a02bc-55b4-4937-b2b4-d45e3840d205 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:06.334722 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a02bc-55b4-4937-b2b4-d45e3840d205 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:06.334836 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a02bc-55b4-4937-b2b4-d45e3840d205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:06.352964 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-981a02bc-55b4-4937-b2b4-d45e3840d205 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:08:06.354140 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-981a02bc-55b4-4937-b2b4-d45e3840d205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:08:06.362461 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 04:08:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:08:06.518072 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4260a-ca0f-4c52-a71c-7cb193093304 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:08:06.532951 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4260a-ca0f-4c52-a71c-7cb193093304 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:08:06.538267 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6e43a-49f0-4080-960b-037c428c5865 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:08:06.538904 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6e43a-49f0-4080-960b-037c428c5865 service nova] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:06.539187 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6e43a-49f0-4080-960b-037c428c5865 service nova] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:06.539498 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6e43a-49f0-4080-960b-037c428c5865 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:06.547860 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6e43a-49f0-4080-960b-037c428c5865 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:08:06.549447 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6e43a-49f0-4080-960b-037c428c5865 service nova] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:08:06.558904 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 730/1464] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:08:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:08:07.985510 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa81b39-c0d6-4110-a9a3-148366915627 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:07.986037 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa81b39-c0d6-4110-a9a3-148366915627 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:07.986037 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa81b39-c0d6-4110-a9a3-148366915627 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:07.987856 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 04:08:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:08:07.993266 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b418dba-24b3-4c95-899c-69b0dafe6536 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:07.993664 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b418dba-24b3-4c95-899c-69b0dafe6536 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:07.993826 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b418dba-24b3-4c95-899c-69b0dafe6536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:08.011674 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-2b418dba-24b3-4c95-899c-69b0dafe6536 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:08:08.012863 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-2b418dba-24b3-4c95-899c-69b0dafe6536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:08:08.021110 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 04:08:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:08:08.188159 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa81b39-c0d6-4110-a9a3-148366915627 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:08:08.202484 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa81b39-c0d6-4110-a9a3-148366915627 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:08:08.207782 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50b844-29ed-41b3-8952-83c520d9848e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:08:08.208440 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50b844-29ed-41b3-8952-83c520d9848e service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:08.208725 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50b844-29ed-41b3-8952-83c520d9848e service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:08.209000 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50b844-29ed-41b3-8952-83c520d9848e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:08.216845 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50b844-29ed-41b3-8952-83c520d9848e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:08:08.219075 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50b844-29ed-41b3-8952-83c520d9848e service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:08:08.228121 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 736/1467] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:08:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:08:10.360540 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc923b9-8cf9-4474-8c5e-e2b9b57a9798 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:10.361111 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc923b9-8cf9-4474-8c5e-e2b9b57a9798 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:10.361111 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc923b9-8cf9-4474-8c5e-e2b9b57a9798 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:10.362858 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 04:08:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:08:10.368739 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa314b-7a9e-4282-8056-f8d772922275 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:10.369183 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa314b-7a9e-4282-8056-f8d772922275 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:10.369333 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa314b-7a9e-4282-8056-f8d772922275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:10.386829 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-05aa314b-7a9e-4282-8056-f8d772922275 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:08:10.388055 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-05aa314b-7a9e-4282-8056-f8d772922275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:08:10.396430 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 04:08:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:08:10.437183 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc923b9-8cf9-4474-8c5e-e2b9b57a9798 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:08:10.447462 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc923b9-8cf9-4474-8c5e-e2b9b57a9798 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:08:10.450937 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062e9ba-973c-4c3c-99ec-e208ff1b2698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:08:10.452288 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062e9ba-973c-4c3c-99ec-e208ff1b2698 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:10.452654 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062e9ba-973c-4c3c-99ec-e208ff1b2698 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:10.453026 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062e9ba-973c-4c3c-99ec-e208ff1b2698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:10.463760 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062e9ba-973c-4c3c-99ec-e208ff1b2698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:08:10.465195 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062e9ba-973c-4c3c-99ec-e208ff1b2698 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:08:10.475296 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 733/1470] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:08:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:08:12.887804 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c363f-51bd-4bbd-856e-a4fbf5e1b7e1 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:12.888416 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c363f-51bd-4bbd-856e-a4fbf5e1b7e1 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:12.888416 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c363f-51bd-4bbd-856e-a4fbf5e1b7e1 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:12.890770 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 738/1471] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 04:08:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:08:12.896684 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9104216-39af-4059-ac10-71425496c42f None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:12.897119 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9104216-39af-4059-ac10-71425496c42f None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:12.897227 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9104216-39af-4059-ac10-71425496c42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:12.914520 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-b9104216-39af-4059-ac10-71425496c42f None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:08:12.915736 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-b9104216-39af-4059-ac10-71425496c42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:08:12.923354 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 734/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 04:08:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:08:12.963591 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c363f-51bd-4bbd-856e-a4fbf5e1b7e1 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:08:12.974008 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c363f-51bd-4bbd-856e-a4fbf5e1b7e1 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:08:12.977403 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07d586-95ad-4620-bb51-502d60ceb0e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:08:12.978021 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07d586-95ad-4620-bb51-502d60ceb0e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:12.978299 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07d586-95ad-4620-bb51-502d60ceb0e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:12.978570 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07d586-95ad-4620-bb51-502d60ceb0e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:12.987199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07d586-95ad-4620-bb51-502d60ceb0e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:08:12.988617 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07d586-95ad-4620-bb51-502d60ceb0e9 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:08:12.997541 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 739/1473] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:08:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:08:15.601477 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b5f19-2146-42e5-a199-6019edaa251b None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:15.602041 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b5f19-2146-42e5-a199-6019edaa251b None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:15.602041 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b5f19-2146-42e5-a199-6019edaa251b None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:15.603946 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 735/1474] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 04:08:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:08:15.610680 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fbeab-450b-47aa-8608-a5db6444a1c6 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:15.611103 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fbeab-450b-47aa-8608-a5db6444a1c6 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:15.611262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fbeab-450b-47aa-8608-a5db6444a1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:15.629065 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-c92fbeab-450b-47aa-8608-a5db6444a1c6 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:08:15.630246 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-c92fbeab-450b-47aa-8608-a5db6444a1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:08:15.637886 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 740/1475] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 04:08:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:08:15.678846 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b5f19-2146-42e5-a199-6019edaa251b None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:08:15.690018 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b5f19-2146-42e5-a199-6019edaa251b None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:08:15.693565 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5092bf-c8b3-437a-959e-9a990f0dadef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:08:15.694199 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5092bf-c8b3-437a-959e-9a990f0dadef service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:15.694483 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5092bf-c8b3-437a-959e-9a990f0dadef service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:15.694761 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5092bf-c8b3-437a-959e-9a990f0dadef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:15.705059 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5092bf-c8b3-437a-959e-9a990f0dadef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:08:15.706481 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5092bf-c8b3-437a-959e-9a990f0dadef service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:08:15.715634 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 736/1476] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:08:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:08:18.092006 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599395f7-dc55-465c-9ebf-51c4df7394bb None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:18.093038 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599395f7-dc55-465c-9ebf-51c4df7394bb None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:18.093038 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599395f7-dc55-465c-9ebf-51c4df7394bb None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:18.094443 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 741/1477] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 04:08:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:08:18.100514 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b591a3b-3b5c-4b7c-87c4-6516b016d1a2 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:18.100967 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b591a3b-3b5c-4b7c-87c4-6516b016d1a2 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:18.101078 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b591a3b-3b5c-4b7c-87c4-6516b016d1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:18.118977 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-8b591a3b-3b5c-4b7c-87c4-6516b016d1a2 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:08:18.120188 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-8b591a3b-3b5c-4b7c-87c4-6516b016d1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:08:18.127997 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 737/1478] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 04:08:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:08:18.167539 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599395f7-dc55-465c-9ebf-51c4df7394bb None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:08:18.178906 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599395f7-dc55-465c-9ebf-51c4df7394bb None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:08:18.182410 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac328e-c062-430a-868c-23d7a3aca4f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:08:18.183040 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac328e-c062-430a-868c-23d7a3aca4f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:18.183370 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac328e-c062-430a-868c-23d7a3aca4f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:18.183653 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac328e-c062-430a-868c-23d7a3aca4f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:18.192683 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac328e-c062-430a-868c-23d7a3aca4f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:08:18.194130 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac328e-c062-430a-868c-23d7a3aca4f1 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:08:18.203877 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 742/1479] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:08:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:08:20.557775 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9d3ab-434a-4b49-8256-1149cf363df0 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:20.558343 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9d3ab-434a-4b49-8256-1149cf363df0 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:20.558343 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9d3ab-434a-4b49-8256-1149cf363df0 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:20.560208 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 738/1480] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 04:08:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:08:20.566035 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1a780-caf4-4c7e-8395-f8090e05753a None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:20.566479 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1a780-caf4-4c7e-8395-f8090e05753a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:20.566589 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1a780-caf4-4c7e-8395-f8090e05753a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:20.583837 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-f4e1a780-caf4-4c7e-8395-f8090e05753a None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:08:20.585017 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-f4e1a780-caf4-4c7e-8395-f8090e05753a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:08:20.593232 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 743/1481] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 04:08:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:08:20.632142 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9d3ab-434a-4b49-8256-1149cf363df0 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:08:20.642749 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9d3ab-434a-4b49-8256-1149cf363df0 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:08:20.646203 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37bbe3-8359-4717-a8f3-0952294db1b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:08:20.646820 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37bbe3-8359-4717-a8f3-0952294db1b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:20.647278 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37bbe3-8359-4717-a8f3-0952294db1b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:20.647560 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37bbe3-8359-4717-a8f3-0952294db1b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:20.656701 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37bbe3-8359-4717-a8f3-0952294db1b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:08:20.658098 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37bbe3-8359-4717-a8f3-0952294db1b1 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:08:20.667340 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 739/1482] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:08:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:08:22.959772 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d08a71-4788-4f47-b01f-f65174d26a08 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:22.960269 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d08a71-4788-4f47-b01f-f65174d26a08 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:22.960269 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d08a71-4788-4f47-b01f-f65174d26a08 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:22.962029 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 744/1483] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 04:08:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:08:22.968425 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a2120-b04c-425a-bd5b-0ecf4352e513 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:22.968829 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a2120-b04c-425a-bd5b-0ecf4352e513 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:22.968973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a2120-b04c-425a-bd5b-0ecf4352e513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:22.986251 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-c69a2120-b04c-425a-bd5b-0ecf4352e513 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:08:22.987467 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c69a2120-b04c-425a-bd5b-0ecf4352e513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:08:22.995034 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 740/1484] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 04:08:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:08:23.034225 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d08a71-4788-4f47-b01f-f65174d26a08 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:08:23.044720 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d08a71-4788-4f47-b01f-f65174d26a08 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:08:23.048215 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1b77d-cdb4-4b94-9270-d415afc26f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:08:23.048835 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1b77d-cdb4-4b94-9270-d415afc26f21 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:23.049140 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1b77d-cdb4-4b94-9270-d415afc26f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:23.049412 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1b77d-cdb4-4b94-9270-d415afc26f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:23.058184 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1b77d-cdb4-4b94-9270-d415afc26f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:08:23.059726 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1b77d-cdb4-4b94-9270-d415afc26f21 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:08:23.068648 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 745/1485] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:08:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:08:25.380309 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cb022-f82f-4c72-b965-8d410b223c9e None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:25.380845 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cb022-f82f-4c72-b965-8d410b223c9e None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:25.380958 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cb022-f82f-4c72-b965-8d410b223c9e None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:25.382655 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 741/1486] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 04:08:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:08:25.389114 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed3f08-1491-4272-a711-241c5da8b916 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:25.389527 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed3f08-1491-4272-a711-241c5da8b916 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:25.389663 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed3f08-1491-4272-a711-241c5da8b916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:25.407493 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-5eed3f08-1491-4272-a711-241c5da8b916 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:08:25.408753 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-5eed3f08-1491-4272-a711-241c5da8b916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:08:25.416300 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 746/1487] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 04:08:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:08:25.455679 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cb022-f82f-4c72-b965-8d410b223c9e None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:08:25.465952 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cb022-f82f-4c72-b965-8d410b223c9e None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:08:25.470205 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd50537-7ca8-4532-afe4-62dd458f46cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:08:25.470831 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd50537-7ca8-4532-afe4-62dd458f46cc service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:25.471111 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd50537-7ca8-4532-afe4-62dd458f46cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:25.471413 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd50537-7ca8-4532-afe4-62dd458f46cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:25.480036 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd50537-7ca8-4532-afe4-62dd458f46cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:08:25.481447 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd50537-7ca8-4532-afe4-62dd458f46cc service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:08:25.490733 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 742/1488] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:08:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:08:27.778149 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a5bee-7c6f-4476-a2c0-0588554355dd None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:27.779268 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a5bee-7c6f-4476-a2c0-0588554355dd None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:27.779268 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a5bee-7c6f-4476-a2c0-0588554355dd None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:27.781090 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 747/1489] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 04:08:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:08:27.786987 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b05387-de2a-4fb4-86e8-e66da3398fd2 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:27.787417 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b05387-de2a-4fb4-86e8-e66da3398fd2 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:27.787600 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b05387-de2a-4fb4-86e8-e66da3398fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:27.805619 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-15b05387-de2a-4fb4-86e8-e66da3398fd2 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:08:27.806863 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-15b05387-de2a-4fb4-86e8-e66da3398fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:08:27.814649 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 743/1490] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 04:08:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:08:27.853077 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a5bee-7c6f-4476-a2c0-0588554355dd None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:08:27.864248 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a5bee-7c6f-4476-a2c0-0588554355dd None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:08:27.867711 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed7af9-cf46-454b-9b25-41d2fb3be1aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:08:27.868339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed7af9-cf46-454b-9b25-41d2fb3be1aa service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:27.868752 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed7af9-cf46-454b-9b25-41d2fb3be1aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:27.869090 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed7af9-cf46-454b-9b25-41d2fb3be1aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:27.877937 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed7af9-cf46-454b-9b25-41d2fb3be1aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:08:27.879403 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed7af9-cf46-454b-9b25-41d2fb3be1aa service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:08:27.888619 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 748/1491] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:08:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:08:30.136784 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93d313-9b14-4998-b145-eecd7b89596c None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:30.137341 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93d313-9b14-4998-b145-eecd7b89596c None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:30.137341 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93d313-9b14-4998-b145-eecd7b89596c None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:30.139344 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 744/1492] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 04:08:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:08:30.145140 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d9ecc-b19d-4e9f-b576-2024a6f5fd80 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:30.145548 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d9ecc-b19d-4e9f-b576-2024a6f5fd80 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:30.145689 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d9ecc-b19d-4e9f-b576-2024a6f5fd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:30.163737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-336d9ecc-b19d-4e9f-b576-2024a6f5fd80 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:08:30.164913 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-336d9ecc-b19d-4e9f-b576-2024a6f5fd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:08:30.173997 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 749/1493] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 04:08:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:08:30.211778 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93d313-9b14-4998-b145-eecd7b89596c None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:08:30.222684 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93d313-9b14-4998-b145-eecd7b89596c None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:08:30.226173 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da04f43-6128-41b9-a8d3-614f4e181d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:08:30.226798 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da04f43-6128-41b9-a8d3-614f4e181d06 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:30.227080 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da04f43-6128-41b9-a8d3-614f4e181d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:30.227387 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da04f43-6128-41b9-a8d3-614f4e181d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:30.236600 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da04f43-6128-41b9-a8d3-614f4e181d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:08:30.238011 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da04f43-6128-41b9-a8d3-614f4e181d06 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:08:30.247118 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 745/1494] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:08:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:08:32.499390 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276ee68-d307-4399-936e-920c195c2b6d None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:32.499941 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276ee68-d307-4399-936e-920c195c2b6d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:32.499941 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276ee68-d307-4399-936e-920c195c2b6d None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:32.501699 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 750/1495] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 04:08:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:08:32.507563 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962504dd-5419-47da-a96c-c43d54d1f7fc None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:32.507999 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962504dd-5419-47da-a96c-c43d54d1f7fc None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:32.508120 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962504dd-5419-47da-a96c-c43d54d1f7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:32.526053 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-962504dd-5419-47da-a96c-c43d54d1f7fc None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:08:32.527257 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-962504dd-5419-47da-a96c-c43d54d1f7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:08:32.535361 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 746/1496] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 04:08:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:08:32.573054 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276ee68-d307-4399-936e-920c195c2b6d None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:08:32.584115 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276ee68-d307-4399-936e-920c195c2b6d None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:08:32.587611 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa353c-91b9-4326-a218-6c4d2117e4eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:08:32.588259 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa353c-91b9-4326-a218-6c4d2117e4eb service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:32.588542 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa353c-91b9-4326-a218-6c4d2117e4eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:32.588819 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa353c-91b9-4326-a218-6c4d2117e4eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:32.598571 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa353c-91b9-4326-a218-6c4d2117e4eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:08:32.600026 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa353c-91b9-4326-a218-6c4d2117e4eb service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:08:32.610218 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 751/1497] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:08:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:08:49.510403 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c43a42-f94a-4f26-907f-f63bda8d4fe3 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:49.510970 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c43a42-f94a-4f26-907f-f63bda8d4fe3 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:49.510970 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c43a42-f94a-4f26-907f-f63bda8d4fe3 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:49.512776 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 747/1498] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:08:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:08:49.518430 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006c259-f444-4380-bf2d-88b2221dc267 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:49.518873 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006c259-f444-4380-bf2d-88b2221dc267 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:49.518969 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006c259-f444-4380-bf2d-88b2221dc267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:49.537126 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-0006c259-f444-4380-bf2d-88b2221dc267 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:08:49.538303 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-0006c259-f444-4380-bf2d-88b2221dc267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:08:49.546645 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 752/1499] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:08:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:08:49.595558 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445eb077-4781-40bc-b66f-5802bf28e794 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:49.595844 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445eb077-4781-40bc-b66f-5802bf28e794 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:49.596120 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445eb077-4781-40bc-b66f-5802bf28e794 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:49.597857 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 748/1500] 10.222.0.54 () {54 vars in 962 bytes} [Tue Nov 23 04:08:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:08:49.603068 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0f23a-8925-43eb-afe4-ef3f2e2523fd None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:49.603441 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0f23a-8925-43eb-afe4-ef3f2e2523fd None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:49.603703 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0f23a-8925-43eb-afe4-ef3f2e2523fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:49.621898 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-01c0f23a-8925-43eb-afe4-ef3f2e2523fd None None] MFA Rules not processed for user `e1f52add52aa4586aee0b801ceffd764`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:08:49.623067 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-01c0f23a-8925-43eb-afe4-ef3f2e2523fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:08:49.629347 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 753/1501] 10.222.0.54 () {58 vars in 1059 bytes} [Tue Nov 23 04:08:49 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:08:49.637195 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445eb077-4781-40bc-b66f-5802bf28e794 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:08:49.647310 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445eb077-4781-40bc-b66f-5802bf28e794 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:08:49.650703 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19e211-cb0a-4276-996e-fd3235ea051e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f52add52aa4586aee0b801ceffd764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:08:49.651353 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19e211-cb0a-4276-996e-fd3235ea051e service glance] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:49.651634 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19e211-cb0a-4276-996e-fd3235ea051e service glance] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:49.651931 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19e211-cb0a-4276-996e-fd3235ea051e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:49.660958 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19e211-cb0a-4276-996e-fd3235ea051e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:08:49.662353 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19e211-cb0a-4276-996e-fd3235ea051e service glance] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:08:49.672269 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 749/1502] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:08:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:08:51.983933 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada38d6-50b8-461b-8ce1-64d005658cbe None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:51.984579 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada38d6-50b8-461b-8ce1-64d005658cbe None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:51.984579 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada38d6-50b8-461b-8ce1-64d005658cbe None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:51.986261 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 754/1503] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:08:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 04:08:51.992212 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6639f7-051a-4538-b74a-4e9e2faaf2ef None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:51.992741 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6639f7-051a-4538-b74a-4e9e2faaf2ef None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:51.992741 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6639f7-051a-4538-b74a-4e9e2faaf2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:52.010641 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-6a6639f7-051a-4538-b74a-4e9e2faaf2ef None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:08:52.013657 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-6a6639f7-051a-4538-b74a-4e9e2faaf2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:08:52.020177 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 750/1504] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:08:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:08:52.043862 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada38d6-50b8-461b-8ce1-64d005658cbe None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:08:52.056207 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada38d6-50b8-461b-8ce1-64d005658cbe None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:08:52.061142 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f201776-96c9-427e-a39f-adb77c5b7956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:08:52.061783 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f201776-96c9-427e-a39f-adb77c5b7956 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:52.062061 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f201776-96c9-427e-a39f-adb77c5b7956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:52.062337 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f201776-96c9-427e-a39f-adb77c5b7956 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:52.063072 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f201776-96c9-427e-a39f-adb77c5b7956 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:08:52.064920 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f201776-96c9-427e-a39f-adb77c5b7956 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:08:52.084955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 755/1505] 10.222.0.54 () {56 vars in 1108 bytes} [Tue Nov 23 04:08:52 2021] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:08:54.351949 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa91bc-8db7-42e0-893f-48c293ef59d3 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:54.352527 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa91bc-8db7-42e0-893f-48c293ef59d3 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:54.352527 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa91bc-8db7-42e0-893f-48c293ef59d3 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:54.354286 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 751/1506] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:08:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:08:54.360648 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2d9c9-ed70-4150-b8d7-7313eec860fa None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:54.361067 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2d9c9-ed70-4150-b8d7-7313eec860fa None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:54.361198 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2d9c9-ed70-4150-b8d7-7313eec860fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:54.378393 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-f2e2d9c9-ed70-4150-b8d7-7313eec860fa None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:08:54.379634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-f2e2d9c9-ed70-4150-b8d7-7313eec860fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:08:54.387537 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 756/1507] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:08:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:08:54.430823 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa91bc-8db7-42e0-893f-48c293ef59d3 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:08:54.445370 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa91bc-8db7-42e0-893f-48c293ef59d3 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:08:54.451299 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365de061-30d5-486e-8eb4-a2b3adee377d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:08:54.452029 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365de061-30d5-486e-8eb4-a2b3adee377d service nova] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:54.452309 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365de061-30d5-486e-8eb4-a2b3adee377d service nova] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:54.452592 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365de061-30d5-486e-8eb4-a2b3adee377d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:54.460915 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365de061-30d5-486e-8eb4-a2b3adee377d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:08:54.462477 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365de061-30d5-486e-8eb4-a2b3adee377d service nova] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:08:54.472142 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 752/1508] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:08:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:08:56.888430 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a5d04-0fd0-4bcb-bf59-c8f9eebcb3a4 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:56.888938 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a5d04-0fd0-4bcb-bf59-c8f9eebcb3a4 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:56.888938 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a5d04-0fd0-4bcb-bf59-c8f9eebcb3a4 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:56.890699 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 757/1509] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:08:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:08:56.896604 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f03ad-83d5-4c20-bf88-f3fbf31b1f66 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:56.897108 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f03ad-83d5-4c20-bf88-f3fbf31b1f66 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:56.897207 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f03ad-83d5-4c20-bf88-f3fbf31b1f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:56.915483 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-5a8f03ad-83d5-4c20-bf88-f3fbf31b1f66 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:08:56.916660 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-5a8f03ad-83d5-4c20-bf88-f3fbf31b1f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:08:56.924755 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 753/1510] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:08:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:08:56.961777 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a5d04-0fd0-4bcb-bf59-c8f9eebcb3a4 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:08:56.973294 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a5d04-0fd0-4bcb-bf59-c8f9eebcb3a4 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:08:56.976868 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91285920-6e86-40a4-b208-a7d5716e50d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:08:56.977495 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91285920-6e86-40a4-b208-a7d5716e50d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:56.977777 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91285920-6e86-40a4-b208-a7d5716e50d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:56.978053 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91285920-6e86-40a4-b208-a7d5716e50d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:56.987347 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91285920-6e86-40a4-b208-a7d5716e50d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:08:56.988780 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91285920-6e86-40a4-b208-a7d5716e50d2 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:08:56.998446 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 758/1511] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:08:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:08:59.309666 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77624c-4857-439d-b591-155a9546fa3a None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:59.310242 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77624c-4857-439d-b591-155a9546fa3a None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:59.310242 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77624c-4857-439d-b591-155a9546fa3a None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:59.312013 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 754/1512] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:08:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:08:59.317882 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a07491-750a-428a-9d91-a4b4b8c46b6b None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:59.318284 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a07491-750a-428a-9d91-a4b4b8c46b6b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:59.318468 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a07491-750a-428a-9d91-a4b4b8c46b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:59.335922 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-e1a07491-750a-428a-9d91-a4b4b8c46b6b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:08:59.337109 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e1a07491-750a-428a-9d91-a4b4b8c46b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:08:59.345452 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 759/1513] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:08:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:08:59.384749 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77624c-4857-439d-b591-155a9546fa3a None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:08:59.396276 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77624c-4857-439d-b591-155a9546fa3a None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:08:59.399769 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861381a-c771-42a3-8f0f-725f4309f007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:08:59.400423 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861381a-c771-42a3-8f0f-725f4309f007 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:08:59.400704 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861381a-c771-42a3-8f0f-725f4309f007 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:08:59.400977 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861381a-c771-42a3-8f0f-725f4309f007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:08:59.410273 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861381a-c771-42a3-8f0f-725f4309f007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:08:59.411725 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861381a-c771-42a3-8f0f-725f4309f007 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:08:59.421594 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 755/1514] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:08:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:09:01.852003 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01623bfe-22a7-4a7c-a003-f5e4bb1bf09a None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:09:01.852578 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01623bfe-22a7-4a7c-a003-f5e4bb1bf09a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:09:01.852578 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01623bfe-22a7-4a7c-a003-f5e4bb1bf09a None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:09:01.854344 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 760/1515] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:09:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:09:01.860780 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9dbee-dbb0-4232-b5e6-b04d0c0ec12c None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:09:01.861211 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9dbee-dbb0-4232-b5e6-b04d0c0ec12c None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:09:01.861339 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9dbee-dbb0-4232-b5e6-b04d0c0ec12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:09:01.878567 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-c8f9dbee-dbb0-4232-b5e6-b04d0c0ec12c None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:09:01.879799 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c8f9dbee-dbb0-4232-b5e6-b04d0c0ec12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:09:01.887448 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 756/1516] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:09:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:09:01.929470 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01623bfe-22a7-4a7c-a003-f5e4bb1bf09a None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:09:01.940055 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01623bfe-22a7-4a7c-a003-f5e4bb1bf09a None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:09:01.943499 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23a7df-290a-4480-8b13-6c9124a31c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:09:01.944122 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23a7df-290a-4480-8b13-6c9124a31c59 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:09:01.944404 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23a7df-290a-4480-8b13-6c9124a31c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:09:01.944680 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23a7df-290a-4480-8b13-6c9124a31c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:09:01.954045 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23a7df-290a-4480-8b13-6c9124a31c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:09:01.955485 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23a7df-290a-4480-8b13-6c9124a31c59 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:09:01.964480 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 761/1517] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:09:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:09:04.609390 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7f99f-ab76-4500-8f12-3ac46c9fda7d None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:09:04.609955 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7f99f-ab76-4500-8f12-3ac46c9fda7d None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:09:04.609955 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7f99f-ab76-4500-8f12-3ac46c9fda7d None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:09:04.611751 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 757/1518] 10.222.0.54 () {54 vars in 926 bytes} [Tue Nov 23 04:09:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:09:04.617480 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192faa76-a6c6-40f8-bc6a-7f1ee9e69c81 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:09:04.617868 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192faa76-a6c6-40f8-bc6a-7f1ee9e69c81 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:09:04.618027 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192faa76-a6c6-40f8-bc6a-7f1ee9e69c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:09:04.636006 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-192faa76-a6c6-40f8-bc6a-7f1ee9e69c81 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:09:04.637723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-192faa76-a6c6-40f8-bc6a-7f1ee9e69c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:09:04.645356 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 762/1519] 10.222.0.54 () {58 vars in 1023 bytes} [Tue Nov 23 04:09:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:09:04.685768 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7f99f-ab76-4500-8f12-3ac46c9fda7d None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:09:04.696570 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7f99f-ab76-4500-8f12-3ac46c9fda7d None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:09:04.700978 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6334b6-2a9c-4d52-8ad0-433923a67459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:09:04.701617 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6334b6-2a9c-4d52-8ad0-433923a67459 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:09:04.701900 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6334b6-2a9c-4d52-8ad0-433923a67459 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:09:04.702178 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6334b6-2a9c-4d52-8ad0-433923a67459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:09:04.710864 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6334b6-2a9c-4d52-8ad0-433923a67459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:09:04.712318 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6334b6-2a9c-4d52-8ad0-433923a67459 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:09:04.721616 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 758/1520] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:09:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:10:44.967185 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1cb01-d665-4046-837e-d0e88b342105 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:10:44.967763 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1cb01-d665-4046-837e-d0e88b342105 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:10:44.967763 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1cb01-d665-4046-837e-d0e88b342105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:10:44.986713 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-d7e1cb01-d665-4046-837e-d0e88b342105 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:10:44.987925 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-d7e1cb01-d665-4046-837e-d0e88b342105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:10:44.995762 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 763/1521] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:10:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:10:45.003662 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e3cea-ee56-4ef9-894c-0d1b4bbd6b7b None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:10:45.004126 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e3cea-ee56-4ef9-894c-0d1b4bbd6b7b None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:10:45.004240 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e3cea-ee56-4ef9-894c-0d1b4bbd6b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:10:45.022206 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-280e3cea-ee56-4ef9-894c-0d1b4bbd6b7b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:10:45.023405 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-280e3cea-ee56-4ef9-894c-0d1b4bbd6b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:10:45.031871 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 759/1522] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:10:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:10:45.036322 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1cb01-d665-4046-837e-d0e88b342105 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:10:45.045575 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1cb01-d665-4046-837e-d0e88b342105 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:10:45.050330 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39286e06-36c0-4078-b802-ac88c8b76a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:10:45.050974 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39286e06-36c0-4078-b802-ac88c8b76a2a admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:10:45.051358 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39286e06-36c0-4078-b802-ac88c8b76a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:10:45.051643 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39286e06-36c0-4078-b802-ac88c8b76a2a admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:10:45.052374 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39286e06-36c0-4078-b802-ac88c8b76a2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:10:45.052686 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39286e06-36c0-4078-b802-ac88c8b76a2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:10:45.054284 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39286e06-36c0-4078-b802-ac88c8b76a2a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:10:45.065240 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 764/1523] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:10:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:10:45.073552 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e3cea-ee56-4ef9-894c-0d1b4bbd6b7b None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:10:45.082392 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e3cea-ee56-4ef9-894c-0d1b4bbd6b7b None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:10:45.086806 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35810ba-fd17-4736-90c4-339c70b8bf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:10:45.087474 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35810ba-fd17-4736-90c4-339c70b8bf01 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:10:45.088295 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35810ba-fd17-4736-90c4-339c70b8bf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:10:45.088571 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35810ba-fd17-4736-90c4-339c70b8bf01 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:10:45.089259 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35810ba-fd17-4736-90c4-339c70b8bf01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:10:45.091105 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35810ba-fd17-4736-90c4-339c70b8bf01 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:10:45.221883 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 760/1524] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:10:45 2021] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:10:45.226046 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39286e06-36c0-4078-b802-ac88c8b76a2a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:10:45.235690 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39286e06-36c0-4078-b802-ac88c8b76a2a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:10:45.288839 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103d888-c3c3-460a-a9e2-afbf4f48e245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:10:45.289488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103d888-c3c3-460a-a9e2-afbf4f48e245 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:10:45.289770 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103d888-c3c3-460a-a9e2-afbf4f48e245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:10:45.290043 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103d888-c3c3-460a-a9e2-afbf4f48e245 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:10:45.290731 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103d888-c3c3-460a-a9e2-afbf4f48e245 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:10:45.292653 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103d888-c3c3-460a-a9e2-afbf4f48e245 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:10:45.403758 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 765/1525] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:10:45 2021] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:10:45.407947 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35810ba-fd17-4736-90c4-339c70b8bf01 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:10:45.418182 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35810ba-fd17-4736-90c4-339c70b8bf01 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:10:45.423024 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a07566-d7a9-49da-ab92-6bb91c05a2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:10:45.423704 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a07566-d7a9-49da-ab92-6bb91c05a2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:10:45.423993 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a07566-d7a9-49da-ab92-6bb91c05a2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:10:45.424272 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a07566-d7a9-49da-ab92-6bb91c05a2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:10:45.425005 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a07566-d7a9-49da-ab92-6bb91c05a2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:10:45.426625 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a07566-d7a9-49da-ab92-6bb91c05a2a1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:10:45.440186 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 761/1526] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:10:45 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:10:45.444089 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103d888-c3c3-460a-a9e2-afbf4f48e245 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:10:45.454634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103d888-c3c3-460a-a9e2-afbf4f48e245 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:10:45.459081 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e343a-49d3-450e-a0d1-48dc54dd8e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:10:45.459794 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e343a-49d3-450e-a0d1-48dc54dd8e55 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:10:45.460085 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e343a-49d3-450e-a0d1-48dc54dd8e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:10:45.460363 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e343a-49d3-450e-a0d1-48dc54dd8e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:10:45.461096 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e343a-49d3-450e-a0d1-48dc54dd8e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:10:45.462728 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e343a-49d3-450e-a0d1-48dc54dd8e55 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:10:45.476006 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 766/1527] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:10:45 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:10:45.480133 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a07566-d7a9-49da-ab92-6bb91c05a2a1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:10:45.489556 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a07566-d7a9-49da-ab92-6bb91c05a2a1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:10:45.494461 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82817f16-811d-481d-88dd-ce9fb43ea9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:10:45.495351 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82817f16-811d-481d-88dd-ce9fb43ea9b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:10:45.495651 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82817f16-811d-481d-88dd-ce9fb43ea9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:10:45.495903 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82817f16-811d-481d-88dd-ce9fb43ea9b6 admin admin] PATH_INFO: `/v3/projects/7cfa12b7123740e09133d6611ed7a9d3/users/e78e549a53214b69892564d5f1ec94bd/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:10:45.510397 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82817f16-811d-481d-88dd-ce9fb43ea9b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cfa12b7123740e09133d6611ed7a9d3, user_id=e78e549a53214b69892564d5f1ec94bd, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:10:45.513036 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82817f16-811d-481d-88dd-ce9fb43ea9b6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:10:45.575906 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 762/1528] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:10:45 2021] PUT /identity/v3/projects/7cfa12b7123740e09133d6611ed7a9d3/users/e78e549a53214b69892564d5f1ec94bd/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:10:45.587050 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f25d1-f19f-4d39-b335-b51671d3ac2e None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:10:45.587385 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f25d1-f19f-4d39-b335-b51671d3ac2e None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:10:45.587802 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f25d1-f19f-4d39-b335-b51671d3ac2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:10:45.613680 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-a51f25d1-f19f-4d39-b335-b51671d3ac2e None None] MFA Rules not processed for user `e78e549a53214b69892564d5f1ec94bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:10:45.614968 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-a51f25d1-f19f-4d39-b335-b51671d3ac2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:10:45.676171 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 767/1529] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:10:45 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:10:45.687994 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82817f16-811d-481d-88dd-ce9fb43ea9b6 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:10:45.756832 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82817f16-811d-481d-88dd-ce9fb43ea9b6 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:10:45.763393 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3935263-0e9c-4e92-b3ff-be7efedc1ec2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:10:45.764120 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3935263-0e9c-4e92-b3ff-be7efedc1ec2 service nova] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:10:45.764409 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3935263-0e9c-4e92-b3ff-be7efedc1ec2 service nova] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:10:45.764688 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3935263-0e9c-4e92-b3ff-be7efedc1ec2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:10:45.772225 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3935263-0e9c-4e92-b3ff-be7efedc1ec2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:10:45.773802 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3935263-0e9c-4e92-b3ff-be7efedc1ec2 service nova] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:10:45.782907 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 763/1530] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:10:45 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:10:45.853080 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f91800-cda5-4077-bdba-3c3e437bc605 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:10:45.854403 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f91800-cda5-4077-bdba-3c3e437bc605 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:10:45.854690 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f91800-cda5-4077-bdba-3c3e437bc605 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:10:45.856461 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 768/1531] 10.222.0.54 () {52 vars in 829 bytes} [Tue Nov 23 04:10:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:10:45.859957 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3935263-0e9c-4e92-b3ff-be7efedc1ec2 service nova] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:10:45.919544 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3935263-0e9c-4e92-b3ff-be7efedc1ec2 service nova] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:10:45.924282 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a553d0c-bfff-49eb-9381-6f030040c199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:10:45.925130 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a553d0c-bfff-49eb-9381-6f030040c199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:10:45.925416 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a553d0c-bfff-49eb-9381-6f030040c199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:10:45.925689 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a553d0c-bfff-49eb-9381-6f030040c199 admin admin] PATH_INFO: `/v3/users/e78e549a53214b69892564d5f1ec94bd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:10:45.926861 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a553d0c-bfff-49eb-9381-6f030040c199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e78e549a53214b69892564d5f1ec94bd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:10:45.927935 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING py.warnings [None req-8a553d0c-bfff-49eb-9381-6f030040c199 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:10:45.927935 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: warnings.warn(msg) Nov 23 04:10:45.927935 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: Nov 23 04:10:45.929122 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a553d0c-bfff-49eb-9381-6f030040c199 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:10:46.347886 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8a553d0c-bfff-49eb-9381-6f030040c199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e78e549a53214b69892564d5f1ec94bd'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:10:46.420626 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8a553d0c-bfff-49eb-9381-6f030040c199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e78e549a53214b69892564d5f1ec94bd'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:10:46.434597 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8a553d0c-bfff-49eb-9381-6f030040c199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e78e549a53214b69892564d5f1ec94bd'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:10:46.435356 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8a553d0c-bfff-49eb-9381-6f030040c199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e78e549a53214b69892564d5f1ec94bd'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:10:46.454812 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8a553d0c-bfff-49eb-9381-6f030040c199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e78e549a53214b69892564d5f1ec94bd'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:10:46.460943 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 764/1532] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:10:45 2021] DELETE /identity/v3/users/e78e549a53214b69892564d5f1ec94bd => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:10:46.465900 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d91547-fe92-4aeb-91c6-70a76ddb8474 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:10:46.466376 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d91547-fe92-4aeb-91c6-70a76ddb8474 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:10:46.466485 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d91547-fe92-4aeb-91c6-70a76ddb8474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:10:46.484080 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-45d91547-fe92-4aeb-91c6-70a76ddb8474 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:10:46.485252 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-45d91547-fe92-4aeb-91c6-70a76ddb8474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:10:46.540993 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 769/1533] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:10:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:10:46.551041 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a553d0c-bfff-49eb-9381-6f030040c199 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:10:46.553177 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-8a553d0c-bfff-49eb-9381-6f030040c199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:10:46.607885 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a553d0c-bfff-49eb-9381-6f030040c199 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:10:46.611442 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34671683-8459-4b60-868c-a985e1b16bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:10:46.612075 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34671683-8459-4b60-868c-a985e1b16bdd service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:10:46.612353 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34671683-8459-4b60-868c-a985e1b16bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:10:46.612625 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34671683-8459-4b60-868c-a985e1b16bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:10:46.621265 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34671683-8459-4b60-868c-a985e1b16bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:10:46.622677 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34671683-8459-4b60-868c-a985e1b16bdd service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:10:46.631746 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 765/1534] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:10:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:10:47.125398 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d91547-fe92-4aeb-91c6-70a76ddb8474 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:10:47.127009 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-45d91547-fe92-4aeb-91c6-70a76ddb8474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:10:47.138802 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d91547-fe92-4aeb-91c6-70a76ddb8474 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:10:47.144665 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ff28b-3bff-4c8d-b0be-8c8f9c04ecef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:10:47.145520 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ff28b-3bff-4c8d-b0be-8c8f9c04ecef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:10:47.145812 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ff28b-3bff-4c8d-b0be-8c8f9c04ecef admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:10:47.146060 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ff28b-3bff-4c8d-b0be-8c8f9c04ecef admin admin] PATH_INFO: `/v3/projects/7cfa12b7123740e09133d6611ed7a9d3` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:10:47.147316 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ff28b-3bff-4c8d-b0be-8c8f9c04ecef admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cfa12b7123740e09133d6611ed7a9d3)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:10:47.149233 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING py.warnings [None req-939ff28b-3bff-4c8d-b0be-8c8f9c04ecef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:10:47.149233 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: warnings.warn(msg) Nov 23 04:10:47.149233 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: Nov 23 04:10:47.151123 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ff28b-3bff-4c8d-b0be-8c8f9c04ecef admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:10:47.277225 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-939ff28b-3bff-4c8d-b0be-8c8f9c04ecef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cfa12b7123740e09133d6611ed7a9d3', 'request_id': 'req-939ff28b-3bff-4c8d-b0be-8c8f9c04ecef'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:10:47.291466 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-939ff28b-3bff-4c8d-b0be-8c8f9c04ecef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cfa12b7123740e09133d6611ed7a9d3', 'request_id': 'req-939ff28b-3bff-4c8d-b0be-8c8f9c04ecef'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:10:47.297695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-939ff28b-3bff-4c8d-b0be-8c8f9c04ecef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cfa12b7123740e09133d6611ed7a9d3', 'request_id': 'req-939ff28b-3bff-4c8d-b0be-8c8f9c04ecef'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:10:47.391769 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-939ff28b-3bff-4c8d-b0be-8c8f9c04ecef admin admin] The token cache is being invalidate because project 7cfa12b7123740e09133d6611ed7a9d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:10:47.391981 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-939ff28b-3bff-4c8d-b0be-8c8f9c04ecef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:10:47.392685 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-939ff28b-3bff-4c8d-b0be-8c8f9c04ecef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:10:47.394197 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 770/1535] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:10:47 2021] DELETE /identity/v3/projects/7cfa12b7123740e09133d6611ed7a9d3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:12:19.491428 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e92fb-6231-416f-9f97-ed5364cfd418 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:19.491999 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e92fb-6231-416f-9f97-ed5364cfd418 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:19.491999 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e92fb-6231-416f-9f97-ed5364cfd418 None None] PATH_INFO: `/v3` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:19.493281 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 766/1536] 10.222.0.50 () {54 vars in 925 bytes} [Tue Nov 23 04:12:19 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:12:19.500634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb955a-30e1-48ba-8fdf-61b4735bc61a None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:19.501076 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb955a-30e1-48ba-8fdf-61b4735bc61a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:19.501326 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb955a-30e1-48ba-8fdf-61b4735bc61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:19.520018 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-f5eb955a-30e1-48ba-8fdf-61b4735bc61a None None] MFA Rules not processed for user `b23c3a2a6cfd4492b7d8eaa62dacec94`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:12:19.521224 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-f5eb955a-30e1-48ba-8fdf-61b4735bc61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:12:19.583562 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 771/1537] 10.222.0.50 () {58 vars in 1015 bytes} [Tue Nov 23 04:12:19 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:12:20.024373 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4e9b3-dc8c-403e-8ba8-a801a86a7e3f None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:20.024662 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4e9b3-dc8c-403e-8ba8-a801a86a7e3f None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:20.024943 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4e9b3-dc8c-403e-8ba8-a801a86a7e3f None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:20.026764 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 767/1538] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 04:12:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:12:20.032583 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d945c-a601-42b6-b50d-615402aff224 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:20.038887 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d945c-a601-42b6-b50d-615402aff224 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:20.038887 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d945c-a601-42b6-b50d-615402aff224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:20.051562 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-b69d945c-a601-42b6-b50d-615402aff224 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:12:20.052745 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-b69d945c-a601-42b6-b50d-615402aff224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:12:20.107545 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 772/1539] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 04:12:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:12:20.262060 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4e9b3-dc8c-403e-8ba8-a801a86a7e3f None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:12:20.263710 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-66a4e9b3-dc8c-403e-8ba8-a801a86a7e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:12:20.335822 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4e9b3-dc8c-403e-8ba8-a801a86a7e3f None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:12:20.340937 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2110fcd-409d-499a-8608-9998a87da679 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:12:20.341573 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2110fcd-409d-499a-8608-9998a87da679 service nova] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:20.341856 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2110fcd-409d-499a-8608-9998a87da679 service nova] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:20.342154 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2110fcd-409d-499a-8608-9998a87da679 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:20.350002 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2110fcd-409d-499a-8608-9998a87da679 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:12:20.351610 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2110fcd-409d-499a-8608-9998a87da679 service nova] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:12:20.361299 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 768/1540] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:12:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:12:21.751321 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af9d98-151b-4a91-8318-7308395f50b3 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:21.751834 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af9d98-151b-4a91-8318-7308395f50b3 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:21.751961 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af9d98-151b-4a91-8318-7308395f50b3 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:21.753662 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 773/1541] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 04:12:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:12:21.758976 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1539ded-c6a4-4e07-b6f0-00fff0b14f34 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:21.759435 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1539ded-c6a4-4e07-b6f0-00fff0b14f34 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:21.759572 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1539ded-c6a4-4e07-b6f0-00fff0b14f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:21.777440 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-f1539ded-c6a4-4e07-b6f0-00fff0b14f34 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:12:21.778635 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-f1539ded-c6a4-4e07-b6f0-00fff0b14f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:12:21.786523 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 769/1542] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 04:12:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:12:21.946192 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af9d98-151b-4a91-8318-7308395f50b3 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:12:21.960225 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af9d98-151b-4a91-8318-7308395f50b3 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:12:21.965494 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435897dd-8fd7-446d-ac03-0c77ff1464ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:12:21.966117 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435897dd-8fd7-446d-ac03-0c77ff1464ad service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:21.966400 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435897dd-8fd7-446d-ac03-0c77ff1464ad service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:21.966705 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435897dd-8fd7-446d-ac03-0c77ff1464ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:21.975169 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435897dd-8fd7-446d-ac03-0c77ff1464ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:12:21.976782 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435897dd-8fd7-446d-ac03-0c77ff1464ad service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:12:21.986578 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 774/1543] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:12:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:12:28.280237 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d875a8-380a-469e-af54-214df8efb9d6 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:28.280697 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d875a8-380a-469e-af54-214df8efb9d6 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:28.280803 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d875a8-380a-469e-af54-214df8efb9d6 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:28.282534 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 770/1544] 10.222.0.54 () {54 vars in 960 bytes} [Tue Nov 23 04:12:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 04:12:28.288300 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45db18-592c-407b-bf34-7458b1f2f9a0 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:28.288750 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45db18-592c-407b-bf34-7458b1f2f9a0 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:28.288879 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45db18-592c-407b-bf34-7458b1f2f9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:28.308564 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-ae45db18-592c-407b-bf34-7458b1f2f9a0 None None] MFA Rules not processed for user `b23c3a2a6cfd4492b7d8eaa62dacec94`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:12:28.309936 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-ae45db18-592c-407b-bf34-7458b1f2f9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:12:28.318895 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 775/1545] 10.222.0.54 () {58 vars in 1057 bytes} [Tue Nov 23 04:12:28 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:12:28.327946 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d875a8-380a-469e-af54-214df8efb9d6 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:12:28.340952 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d875a8-380a-469e-af54-214df8efb9d6 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:12:28.346982 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd732c5-2d90-4ecb-aadf-adbe2651ab1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23c3a2a6cfd4492b7d8eaa62dacec94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:12:28.347643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd732c5-2d90-4ecb-aadf-adbe2651ab1c service placement] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:28.347931 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd732c5-2d90-4ecb-aadf-adbe2651ab1c service placement] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:28.348205 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd732c5-2d90-4ecb-aadf-adbe2651ab1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:28.356308 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd732c5-2d90-4ecb-aadf-adbe2651ab1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:12:28.358374 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd732c5-2d90-4ecb-aadf-adbe2651ab1c service placement] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:12:28.367693 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 771/1546] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:12:28 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:12:33.806573 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d621347-03e7-45be-9929-be32dc273c5b None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:33.807167 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d621347-03e7-45be-9929-be32dc273c5b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:33.807167 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d621347-03e7-45be-9929-be32dc273c5b None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:33.808948 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 776/1547] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 04:12:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:12:33.814884 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9af59-6100-4733-95da-90e3d249b219 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:33.815357 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9af59-6100-4733-95da-90e3d249b219 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:33.815462 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9af59-6100-4733-95da-90e3d249b219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:33.832964 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-fbf9af59-6100-4733-95da-90e3d249b219 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:12:33.834157 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-fbf9af59-6100-4733-95da-90e3d249b219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:12:33.841899 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 772/1548] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 04:12:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:12:33.996037 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d621347-03e7-45be-9929-be32dc273c5b None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:12:34.010500 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d621347-03e7-45be-9929-be32dc273c5b None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:12:34.016572 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100654e5-d2f1-4a2a-813b-69ed97b9115a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:12:34.017200 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100654e5-d2f1-4a2a-813b-69ed97b9115a service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:34.017485 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100654e5-d2f1-4a2a-813b-69ed97b9115a service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:34.017763 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100654e5-d2f1-4a2a-813b-69ed97b9115a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:34.025654 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100654e5-d2f1-4a2a-813b-69ed97b9115a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:12:34.027233 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100654e5-d2f1-4a2a-813b-69ed97b9115a service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:12:34.037479 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 777/1549] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:12:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:12:35.432678 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd36e49-c9c6-4899-afa5-1bfc5f4e7fa8 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:35.433217 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd36e49-c9c6-4899-afa5-1bfc5f4e7fa8 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:35.433217 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd36e49-c9c6-4899-afa5-1bfc5f4e7fa8 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:35.434985 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 773/1550] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 04:12:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:12:35.440255 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb739986-21d0-4550-a226-d475b157f261 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:35.440685 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb739986-21d0-4550-a226-d475b157f261 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:35.440805 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb739986-21d0-4550-a226-d475b157f261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:35.458323 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-eb739986-21d0-4550-a226-d475b157f261 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:12:35.459536 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-eb739986-21d0-4550-a226-d475b157f261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:12:35.469016 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 778/1551] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 04:12:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:12:35.624231 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd36e49-c9c6-4899-afa5-1bfc5f4e7fa8 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:12:35.638016 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd36e49-c9c6-4899-afa5-1bfc5f4e7fa8 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:12:35.643286 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cec7a1-9cbf-4a76-8a8e-5ceda2c6a0e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:12:35.643907 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cec7a1-9cbf-4a76-8a8e-5ceda2c6a0e6 service nova] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:35.644190 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cec7a1-9cbf-4a76-8a8e-5ceda2c6a0e6 service nova] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:35.644464 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cec7a1-9cbf-4a76-8a8e-5ceda2c6a0e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:35.652282 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cec7a1-9cbf-4a76-8a8e-5ceda2c6a0e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:12:35.653834 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cec7a1-9cbf-4a76-8a8e-5ceda2c6a0e6 service nova] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:12:35.663812 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 774/1552] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:12:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:12:39.854762 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543b3d9-e6f6-44b1-9f56-706ad9061174 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:39.855312 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543b3d9-e6f6-44b1-9f56-706ad9061174 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:39.855312 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543b3d9-e6f6-44b1-9f56-706ad9061174 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:39.857635 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 779/1553] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 04:12:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:12:39.863340 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b89894-3abb-4c03-a616-56f2ebd807e8 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:39.863782 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b89894-3abb-4c03-a616-56f2ebd807e8 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:39.863936 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b89894-3abb-4c03-a616-56f2ebd807e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:39.882176 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-99b89894-3abb-4c03-a616-56f2ebd807e8 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:12:39.883407 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-99b89894-3abb-4c03-a616-56f2ebd807e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:12:39.891136 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 775/1554] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 04:12:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:12:39.929796 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543b3d9-e6f6-44b1-9f56-706ad9061174 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:12:39.931465 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-b543b3d9-e6f6-44b1-9f56-706ad9061174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:12:39.986684 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543b3d9-e6f6-44b1-9f56-706ad9061174 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:12:39.990191 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b1d31-f39b-4f79-9668-b77314fe5aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:12:39.990830 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b1d31-f39b-4f79-9668-b77314fe5aff service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:39.991111 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b1d31-f39b-4f79-9668-b77314fe5aff service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:39.991418 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b1d31-f39b-4f79-9668-b77314fe5aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:40.000149 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b1d31-f39b-4f79-9668-b77314fe5aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:12:40.001560 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b1d31-f39b-4f79-9668-b77314fe5aff service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:12:40.010501 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 780/1555] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:12:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:12:42.248729 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13637cbb-d7c1-4722-ab72-f33f4f827ae9 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:42.249293 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13637cbb-d7c1-4722-ab72-f33f4f827ae9 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:42.249293 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13637cbb-d7c1-4722-ab72-f33f4f827ae9 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:42.251082 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 776/1556] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 04:12:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:12:42.256754 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c4a73-5f56-401c-a6e3-972db0378a8c None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:42.257162 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c4a73-5f56-401c-a6e3-972db0378a8c None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:42.257316 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c4a73-5f56-401c-a6e3-972db0378a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:42.275734 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-0e6c4a73-5f56-401c-a6e3-972db0378a8c None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:12:42.276948 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-0e6c4a73-5f56-401c-a6e3-972db0378a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:12:42.285485 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 781/1557] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 04:12:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:12:42.325010 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13637cbb-d7c1-4722-ab72-f33f4f827ae9 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:12:42.337155 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13637cbb-d7c1-4722-ab72-f33f4f827ae9 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:12:42.340981 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73f8d6-6a2a-47f0-871a-1a339536f907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:12:42.342877 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73f8d6-6a2a-47f0-871a-1a339536f907 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:42.343171 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73f8d6-6a2a-47f0-871a-1a339536f907 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:42.343480 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73f8d6-6a2a-47f0-871a-1a339536f907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:42.352574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73f8d6-6a2a-47f0-871a-1a339536f907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:12:42.353996 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73f8d6-6a2a-47f0-871a-1a339536f907 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:12:42.364017 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 777/1558] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:12:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:12:46.134580 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51773d-85f3-487d-9551-18fee5571fc6 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:46.135121 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51773d-85f3-487d-9551-18fee5571fc6 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:46.135121 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51773d-85f3-487d-9551-18fee5571fc6 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:46.137003 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 782/1559] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 04:12:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:12:46.142588 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140b159-bbb1-4f2c-aa87-0e89d3e01416 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:46.143086 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140b159-bbb1-4f2c-aa87-0e89d3e01416 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:46.143190 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140b159-bbb1-4f2c-aa87-0e89d3e01416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:46.161136 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-0140b159-bbb1-4f2c-aa87-0e89d3e01416 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:12:46.162318 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-0140b159-bbb1-4f2c-aa87-0e89d3e01416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:12:46.171031 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 778/1560] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 04:12:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:12:46.220918 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51773d-85f3-487d-9551-18fee5571fc6 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:12:46.222752 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-bb51773d-85f3-487d-9551-18fee5571fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:12:46.277917 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51773d-85f3-487d-9551-18fee5571fc6 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:12:46.282805 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2a96b-a162-42c0-a13a-44dfbffac0e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:12:46.283587 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2a96b-a162-42c0-a13a-44dfbffac0e8 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:46.283871 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2a96b-a162-42c0-a13a-44dfbffac0e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:46.284176 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2a96b-a162-42c0-a13a-44dfbffac0e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:46.293142 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2a96b-a162-42c0-a13a-44dfbffac0e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:12:46.296606 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2a96b-a162-42c0-a13a-44dfbffac0e8 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:12:46.305726 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 783/1561] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:12:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:12:48.556933 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f4313-6ca0-4a4f-a8af-248d5e671f90 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:48.557505 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f4313-6ca0-4a4f-a8af-248d5e671f90 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:48.557505 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f4313-6ca0-4a4f-a8af-248d5e671f90 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:48.559366 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 779/1562] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 04:12:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 04:12:48.565207 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b500de-456b-4a82-969d-2a50472e97ce None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:48.565631 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b500de-456b-4a82-969d-2a50472e97ce None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:48.565762 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b500de-456b-4a82-969d-2a50472e97ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:48.584308 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-09b500de-456b-4a82-969d-2a50472e97ce None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:12:48.585492 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-09b500de-456b-4a82-969d-2a50472e97ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:12:48.593692 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 784/1563] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 04:12:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:12:48.643550 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276257c-90f3-4c79-94e0-009c069d4ca1 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:48.643838 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276257c-90f3-4c79-94e0-009c069d4ca1 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:48.644119 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276257c-90f3-4c79-94e0-009c069d4ca1 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:48.645884 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 780/1564] 10.222.0.54 () {54 vars in 963 bytes} [Tue Nov 23 04:12:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:12:48.651080 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b4891-2c46-42f9-bf49-7a703a697123 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:48.651400 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b4891-2c46-42f9-bf49-7a703a697123 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:48.651679 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b4891-2c46-42f9-bf49-7a703a697123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:48.670066 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-816b4891-2c46-42f9-bf49-7a703a697123 None None] MFA Rules not processed for user `3dd4736db18940b8961c73142381cee7`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:12:48.671262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-816b4891-2c46-42f9-bf49-7a703a697123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:12:48.678027 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 785/1565] 10.222.0.54 () {58 vars in 1060 bytes} [Tue Nov 23 04:12:48 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:12:48.687703 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276257c-90f3-4c79-94e0-009c069d4ca1 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:12:48.698065 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276257c-90f3-4c79-94e0-009c069d4ca1 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:12:48.702149 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90443797-8043-4a2d-895c-b81bb2cfc2c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:12:48.702813 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90443797-8043-4a2d-895c-b81bb2cfc2c4 service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:12:48.703052 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90443797-8043-4a2d-895c-b81bb2cfc2c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:12:48.703360 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90443797-8043-4a2d-895c-b81bb2cfc2c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:12:48.712011 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90443797-8043-4a2d-895c-b81bb2cfc2c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:12:48.713463 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90443797-8043-4a2d-895c-b81bb2cfc2c4 service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:12:48.723337 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 781/1566] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:12:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:11.110176 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453c082-983c-43ec-a9ad-81640b3a8e38 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:11.110760 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453c082-983c-43ec-a9ad-81640b3a8e38 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:11.110760 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453c082-983c-43ec-a9ad-81640b3a8e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:11.136224 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-c453c082-983c-43ec-a9ad-81640b3a8e38 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:11.137603 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-c453c082-983c-43ec-a9ad-81640b3a8e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:11.148373 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 786/1567] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:11.158309 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a71c0-b5eb-43e5-ae64-af74fc32acc0 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:11.159330 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a71c0-b5eb-43e5-ae64-af74fc32acc0 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:11.159846 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a71c0-b5eb-43e5-ae64-af74fc32acc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:11.183418 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-887a71c0-b5eb-43e5-ae64-af74fc32acc0 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:11.185542 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-887a71c0-b5eb-43e5-ae64-af74fc32acc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:11.208428 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 782/1568] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:11.210373 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453c082-983c-43ec-a9ad-81640b3a8e38 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:11.242485 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453c082-983c-43ec-a9ad-81640b3a8e38 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:11.262402 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b4203-8e18-4aec-b669-f96bc5a2db90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:11.263078 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b4203-8e18-4aec-b669-f96bc5a2db90 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:11.263405 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b4203-8e18-4aec-b669-f96bc5a2db90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:11.263654 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b4203-8e18-4aec-b669-f96bc5a2db90 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:11.264398 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b4203-8e18-4aec-b669-f96bc5a2db90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:14:11.264719 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b4203-8e18-4aec-b669-f96bc5a2db90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:11.266311 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b4203-8e18-4aec-b669-f96bc5a2db90 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:11.288502 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 787/1569] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:14:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:14:11.290214 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a2ae8-9d6f-45d0-a86d-2d5ebb53f4d5 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:11.291008 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a2ae8-9d6f-45d0-a86d-2d5ebb53f4d5 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:11.291552 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a2ae8-9d6f-45d0-a86d-2d5ebb53f4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:11.319357 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b4203-8e18-4aec-b669-f96bc5a2db90 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:11.327189 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-800a2ae8-9d6f-45d0-a86d-2d5ebb53f4d5 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:11.328753 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-800a2ae8-9d6f-45d0-a86d-2d5ebb53f4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:11.335304 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b4203-8e18-4aec-b669-f96bc5a2db90 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:11.347353 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 783/1570] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:11.356011 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5856bc-8285-431c-86c3-56f3dd353a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:11.357249 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5856bc-8285-431c-86c3-56f3dd353a9e admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:11.357536 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5856bc-8285-431c-86c3-56f3dd353a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:11.357812 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5856bc-8285-431c-86c3-56f3dd353a9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:11.358528 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5856bc-8285-431c-86c3-56f3dd353a9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:11.359169 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dc52d-8c28-4996-a72b-44075568bd1c None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:11.359711 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dc52d-8c28-4996-a72b-44075568bd1c None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:11.360215 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dc52d-8c28-4996-a72b-44075568bd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:11.360454 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5856bc-8285-431c-86c3-56f3dd353a9e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:11.386223 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-ca5dc52d-8c28-4996-a72b-44075568bd1c None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:11.395338 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-ca5dc52d-8c28-4996-a72b-44075568bd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:11.399946 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 784/1571] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:11.404647 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dc52d-8c28-4996-a72b-44075568bd1c None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:11.414202 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dc52d-8c28-4996-a72b-44075568bd1c None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:11.420162 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17d673-cc62-4c2f-a4f8-f7678f299948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:11.421073 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17d673-cc62-4c2f-a4f8-f7678f299948 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:11.421558 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17d673-cc62-4c2f-a4f8-f7678f299948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:11.422018 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17d673-cc62-4c2f-a4f8-f7678f299948 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:11.422978 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17d673-cc62-4c2f-a4f8-f7678f299948 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:14:11.423561 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17d673-cc62-4c2f-a4f8-f7678f299948 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:11.425370 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17d673-cc62-4c2f-a4f8-f7678f299948 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:11.438444 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 785/1572] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:14:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 04:14:11.446495 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17d673-cc62-4c2f-a4f8-f7678f299948 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:11.457354 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17d673-cc62-4c2f-a4f8-f7678f299948 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:11.462754 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c82ca7-ee55-4914-a073-59d92059846c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:11.467937 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c82ca7-ee55-4914-a073-59d92059846c admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:11.468446 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c82ca7-ee55-4914-a073-59d92059846c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:11.468946 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c82ca7-ee55-4914-a073-59d92059846c admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:11.469866 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c82ca7-ee55-4914-a073-59d92059846c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:11.472002 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c82ca7-ee55-4914-a073-59d92059846c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:11.852452 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 786/1574] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:11 2021] POST /identity/v3/projects => generated 383 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:14:11.858327 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 788/1574] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:11 2021] POST /identity/v3/projects => generated 373 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:11.858465 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c21e7-f88d-4bb2-a46f-23460596b4ea None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:11.858568 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45073f02-83af-48e5-ae13-d712cab09cf0 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:11.858664 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c21e7-f88d-4bb2-a46f-23460596b4ea None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:11.858759 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45073f02-83af-48e5-ae13-d712cab09cf0 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:11.858861 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c21e7-f88d-4bb2-a46f-23460596b4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:11.858960 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45073f02-83af-48e5-ae13-d712cab09cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:11.875878 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-45073f02-83af-48e5-ae13-d712cab09cf0 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:11.876943 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-b69c21e7-f88d-4bb2-a46f-23460596b4ea None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:11.877084 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-45073f02-83af-48e5-ae13-d712cab09cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:11.878110 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-b69c21e7-f88d-4bb2-a46f-23460596b4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:11.944680 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 789/1575] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:11.944895 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 787/1576] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:11.945007 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe0389-c52a-40c8-8527-3da334b5c10c None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:11.945007 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe0389-c52a-40c8-8527-3da334b5c10c None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:11.945220 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6718607-15f7-4185-bc7c-ada437796aa8 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:11.945326 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe0389-c52a-40c8-8527-3da334b5c10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:11.945424 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6718607-15f7-4185-bc7c-ada437796aa8 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:11.945424 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6718607-15f7-4185-bc7c-ada437796aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:11.962139 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-e6718607-15f7-4185-bc7c-ada437796aa8 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:11.963131 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-e1fe0389-c52a-40c8-8527-3da334b5c10c None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:11.963369 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-e6718607-15f7-4185-bc7c-ada437796aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:11.964469 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e1fe0389-c52a-40c8-8527-3da334b5c10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:11.971155 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 788/1577] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:11.972394 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 790/1578] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:11.973540 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c22875-1fe8-401f-ab68-3a42561880a1 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:11.973834 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c22875-1fe8-401f-ab68-3a42561880a1 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:11.974110 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c22875-1fe8-401f-ab68-3a42561880a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:11.976985 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d55dc-a3af-4740-b1bf-2a1f8bdbe8f8 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:11.977585 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d55dc-a3af-4740-b1bf-2a1f8bdbe8f8 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:11.978054 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d55dc-a3af-4740-b1bf-2a1f8bdbe8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:11.993247 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-b6c22875-1fe8-401f-ab68-3a42561880a1 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:11.994431 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-b6c22875-1fe8-401f-ab68-3a42561880a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:11.996619 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-6d4d55dc-a3af-4740-b1bf-2a1f8bdbe8f8 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:11.998320 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-6d4d55dc-a3af-4740-b1bf-2a1f8bdbe8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:12.002770 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 791/1579] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:12.003572 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c22875-1fe8-401f-ab68-3a42561880a1 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:12.015554 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 789/1580] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:12.015554 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d55dc-a3af-4740-b1bf-2a1f8bdbe8f8 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:12.018706 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c22875-1fe8-401f-ab68-3a42561880a1 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:12.019938 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d55dc-a3af-4740-b1bf-2a1f8bdbe8f8 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:12.023303 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3ef7c-0036-4efb-85b3-42c23ad595e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:12.023978 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3ef7c-0036-4efb-85b3-42c23ad595e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.024263 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3ef7c-0036-4efb-85b3-42c23ad595e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.024537 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3ef7c-0036-4efb-85b3-42c23ad595e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.024670 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bf843-6349-4c27-b5a1-e30038e98532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:12.025240 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3ef7c-0036-4efb-85b3-42c23ad595e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:12.025357 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bf843-6349-4c27-b5a1-e30038e98532 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.025592 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bf843-6349-4c27-b5a1-e30038e98532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.025865 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bf843-6349-4c27-b5a1-e30038e98532 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.026557 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957bf843-6349-4c27-b5a1-e30038e98532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:12.027379 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3ef7c-0036-4efb-85b3-42c23ad595e9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:12.028486 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957bf843-6349-4c27-b5a1-e30038e98532 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:12.111736 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 792/1581] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:12 2021] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:12.111736 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb427d62-9c6c-4f4a-bb70-04c3ee1685a1 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.111736 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb427d62-9c6c-4f4a-bb70-04c3ee1685a1 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.111736 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb427d62-9c6c-4f4a-bb70-04c3ee1685a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.125515 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 790/1582] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:12 2021] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:12.126791 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c98042-f982-4081-b05f-e0490889f336 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.127158 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c98042-f982-4081-b05f-e0490889f336 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.127393 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c98042-f982-4081-b05f-e0490889f336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.128208 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-eb427d62-9c6c-4f4a-bb70-04c3ee1685a1 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:12.129418 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-eb427d62-9c6c-4f4a-bb70-04c3ee1685a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:12.138812 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 793/1583] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:12.140141 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652da8e-e41f-4358-b032-56704cb5415d None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.140431 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652da8e-e41f-4358-b032-56704cb5415d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.140715 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652da8e-e41f-4358-b032-56704cb5415d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.149311 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-e8c98042-f982-4081-b05f-e0490889f336 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:12.150525 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-e8c98042-f982-4081-b05f-e0490889f336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:12.158685 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-5652da8e-e41f-4358-b032-56704cb5415d None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:12.159888 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-5652da8e-e41f-4358-b032-56704cb5415d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:12.160403 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 791/1584] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:12.162156 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22937b8f-5c00-4461-ab54-91b6582e2411 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.162578 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22937b8f-5c00-4461-ab54-91b6582e2411 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.162993 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22937b8f-5c00-4461-ab54-91b6582e2411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.171917 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 794/1585] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:12.173187 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46b86b-e23f-43cf-9861-644683fffd9a None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.173480 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46b86b-e23f-43cf-9861-644683fffd9a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.173766 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46b86b-e23f-43cf-9861-644683fffd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.182497 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-22937b8f-5c00-4461-ab54-91b6582e2411 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:12.183774 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-22937b8f-5c00-4461-ab54-91b6582e2411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:12.190871 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-db46b86b-e23f-43cf-9861-644683fffd9a None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:12.191503 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 792/1586] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:12.192056 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-db46b86b-e23f-43cf-9861-644683fffd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:12.192719 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179fea9-c1cd-4fce-8ac2-22ac2ed7fe74 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.193006 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179fea9-c1cd-4fce-8ac2-22ac2ed7fe74 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.193281 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179fea9-c1cd-4fce-8ac2-22ac2ed7fe74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.203149 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 795/1587] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:12.203610 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46b86b-e23f-43cf-9861-644683fffd9a None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:12.211288 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-0179fea9-c1cd-4fce-8ac2-22ac2ed7fe74 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:12.212464 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-0179fea9-c1cd-4fce-8ac2-22ac2ed7fe74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:12.215320 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46b86b-e23f-43cf-9861-644683fffd9a None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:12.220717 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ff9dc-1b9a-4464-9f98-92b8dfed43ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:12.220916 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 793/1588] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:12.221676 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ff9dc-1b9a-4464-9f98-92b8dfed43ac admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.221793 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179fea9-c1cd-4fce-8ac2-22ac2ed7fe74 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:12.221927 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ff9dc-1b9a-4464-9f98-92b8dfed43ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.222237 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ff9dc-1b9a-4464-9f98-92b8dfed43ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.222974 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ff9dc-1b9a-4464-9f98-92b8dfed43ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:12.224587 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ff9dc-1b9a-4464-9f98-92b8dfed43ac admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:12.234300 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179fea9-c1cd-4fce-8ac2-22ac2ed7fe74 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:12.238010 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 796/1589] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:12 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:12.238010 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ff9dc-1b9a-4464-9f98-92b8dfed43ac admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:12.241686 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041a51a-1adc-4b48-a087-4e69629c07c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:12.242334 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041a51a-1adc-4b48-a087-4e69629c07c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.242612 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041a51a-1adc-4b48-a087-4e69629c07c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.242887 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041a51a-1adc-4b48-a087-4e69629c07c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.243775 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041a51a-1adc-4b48-a087-4e69629c07c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:12.245342 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041a51a-1adc-4b48-a087-4e69629c07c2 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:12.246880 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ff9dc-1b9a-4464-9f98-92b8dfed43ac admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:12.251434 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc4e96-7c71-4845-9c45-747ab4f4b152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:12.252067 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc4e96-7c71-4845-9c45-747ab4f4b152 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.252351 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc4e96-7c71-4845-9c45-747ab4f4b152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.252730 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc4e96-7c71-4845-9c45-747ab4f4b152 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.253345 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc4e96-7c71-4845-9c45-747ab4f4b152 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:14:12.253651 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc4e96-7c71-4845-9c45-747ab4f4b152 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:12.255204 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc4e96-7c71-4845-9c45-747ab4f4b152 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:12.256040 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 794/1590] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:12 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:12.257030 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041a51a-1adc-4b48-a087-4e69629c07c2 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:12.266657 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041a51a-1adc-4b48-a087-4e69629c07c2 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:12.267143 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 797/1591] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:14:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:14:12.267868 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc4e96-7c71-4845-9c45-747ab4f4b152 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:12.271597 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff8eac-d4bd-4fe5-91a9-c48368d7c514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:12.272231 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff8eac-d4bd-4fe5-91a9-c48368d7c514 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.272609 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff8eac-d4bd-4fe5-91a9-c48368d7c514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.272780 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff8eac-d4bd-4fe5-91a9-c48368d7c514 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.273499 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff8eac-d4bd-4fe5-91a9-c48368d7c514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:14:12.273806 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff8eac-d4bd-4fe5-91a9-c48368d7c514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:12.275495 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff8eac-d4bd-4fe5-91a9-c48368d7c514 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:12.277489 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc4e96-7c71-4845-9c45-747ab4f4b152 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:12.282574 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf37f52-3822-4ef5-b279-f6cb83d8c8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:12.283262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf37f52-3822-4ef5-b279-f6cb83d8c8dd admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.283548 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf37f52-3822-4ef5-b279-f6cb83d8c8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.283826 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf37f52-3822-4ef5-b279-f6cb83d8c8dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.284547 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf37f52-3822-4ef5-b279-f6cb83d8c8dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:14:12.284858 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf37f52-3822-4ef5-b279-f6cb83d8c8dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:12.286421 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf37f52-3822-4ef5-b279-f6cb83d8c8dd admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:12.288047 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 795/1592] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:14:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:14:12.288995 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff8eac-d4bd-4fe5-91a9-c48368d7c514 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:12.299291 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff8eac-d4bd-4fe5-91a9-c48368d7c514 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:12.302019 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 798/1593] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:14:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:14:12.302785 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf37f52-3822-4ef5-b279-f6cb83d8c8dd admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:12.309877 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832787e-9ca9-44cc-b208-ecb4a793252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:12.310632 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832787e-9ca9-44cc-b208-ecb4a793252e admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.310918 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832787e-9ca9-44cc-b208-ecb4a793252e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.311193 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832787e-9ca9-44cc-b208-ecb4a793252e admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.311956 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832787e-9ca9-44cc-b208-ecb4a793252e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:14:12.312261 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832787e-9ca9-44cc-b208-ecb4a793252e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:12.312357 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf37f52-3822-4ef5-b279-f6cb83d8c8dd admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:12.314085 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832787e-9ca9-44cc-b208-ecb4a793252e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:12.318293 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3789c0-30c7-4317-b6be-37010d4cc414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:12.318941 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3789c0-30c7-4317-b6be-37010d4cc414 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.319283 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3789c0-30c7-4317-b6be-37010d4cc414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.319567 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3789c0-30c7-4317-b6be-37010d4cc414 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.320313 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3789c0-30c7-4317-b6be-37010d4cc414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:14:12.320606 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3789c0-30c7-4317-b6be-37010d4cc414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:12.322191 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3789c0-30c7-4317-b6be-37010d4cc414 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:12.326255 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 796/1594] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:14:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:14:12.327113 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832787e-9ca9-44cc-b208-ecb4a793252e admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:12.335242 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 799/1595] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:14:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:14:12.335242 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3789c0-30c7-4317-b6be-37010d4cc414 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:12.342545 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832787e-9ca9-44cc-b208-ecb4a793252e admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:12.344876 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3789c0-30c7-4317-b6be-37010d4cc414 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:12.347174 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14f1bc-8b70-411a-8d2c-47bbc917c9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:12.347845 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14f1bc-8b70-411a-8d2c-47bbc917c9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.348131 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14f1bc-8b70-411a-8d2c-47bbc917c9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.348405 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14f1bc-8b70-411a-8d2c-47bbc917c9f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.349133 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14f1bc-8b70-411a-8d2c-47bbc917c9f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:14:12.349362 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc979f85-ab51-4cc1-9ca5-7946ec340b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:12.349476 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14f1bc-8b70-411a-8d2c-47bbc917c9f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:12.349996 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc979f85-ab51-4cc1-9ca5-7946ec340b1b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.350275 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc979f85-ab51-4cc1-9ca5-7946ec340b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.350548 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc979f85-ab51-4cc1-9ca5-7946ec340b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.351001 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14f1bc-8b70-411a-8d2c-47bbc917c9f7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:12.351295 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc979f85-ab51-4cc1-9ca5-7946ec340b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:12.352872 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc979f85-ab51-4cc1-9ca5-7946ec340b1b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:12.363063 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 800/1596] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:12 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:12.363949 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc979f85-ab51-4cc1-9ca5-7946ec340b1b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:12.364173 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 797/1597] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:14:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:14:12.364946 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14f1bc-8b70-411a-8d2c-47bbc917c9f7 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:12.375257 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14f1bc-8b70-411a-8d2c-47bbc917c9f7 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:12.377330 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc979f85-ab51-4cc1-9ca5-7946ec340b1b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:12.379739 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6bb6e-ae56-4e97-83cb-e49299413556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:12.380371 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6bb6e-ae56-4e97-83cb-e49299413556 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.380655 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6bb6e-ae56-4e97-83cb-e49299413556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.380931 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6bb6e-ae56-4e97-83cb-e49299413556 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.381624 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6bb6e-ae56-4e97-83cb-e49299413556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:12.381952 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ef35b-4eac-43df-a57b-17fb8e5b0469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:12.382587 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ef35b-4eac-43df-a57b-17fb8e5b0469 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.382866 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ef35b-4eac-43df-a57b-17fb8e5b0469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.383137 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ef35b-4eac-43df-a57b-17fb8e5b0469 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.383555 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6bb6e-ae56-4e97-83cb-e49299413556 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:12.383889 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ef35b-4eac-43df-a57b-17fb8e5b0469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:12.385453 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ef35b-4eac-43df-a57b-17fb8e5b0469 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:12.398425 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 801/1598] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:12 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:12.398425 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ef35b-4eac-43df-a57b-17fb8e5b0469 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:12.407329 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ef35b-4eac-43df-a57b-17fb8e5b0469 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:12.411714 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cee22-0a43-44fe-a050-f094c54db8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:12.412527 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cee22-0a43-44fe-a050-f094c54db8b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.412821 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cee22-0a43-44fe-a050-f094c54db8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.413098 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cee22-0a43-44fe-a050-f094c54db8b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.413811 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cee22-0a43-44fe-a050-f094c54db8b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:12.415926 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cee22-0a43-44fe-a050-f094c54db8b4 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:12.476725 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 798/1599] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:12 2021] POST /identity/v3/projects => generated 405 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:12.476725 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6bb6e-ae56-4e97-83cb-e49299413556 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:12.504766 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 802/1600] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:12 2021] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:12.504766 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cee22-0a43-44fe-a050-f094c54db8b4 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:12.537102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6bb6e-ae56-4e97-83cb-e49299413556 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:12.564961 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cee22-0a43-44fe-a050-f094c54db8b4 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:12.569519 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de9f32-e69e-450f-ac03-7b8090b416fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:12.570172 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de9f32-e69e-450f-ac03-7b8090b416fa admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.570455 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de9f32-e69e-450f-ac03-7b8090b416fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.570733 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de9f32-e69e-450f-ac03-7b8090b416fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.571461 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de9f32-e69e-450f-ac03-7b8090b416fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:12.573354 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de9f32-e69e-450f-ac03-7b8090b416fa admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:12.590301 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76f708-ce13-4276-8143-eb7a94e4b3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:12.591780 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76f708-ce13-4276-8143-eb7a94e4b3da admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.592162 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76f708-ce13-4276-8143-eb7a94e4b3da admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.597987 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76f708-ce13-4276-8143-eb7a94e4b3da admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.597987 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76f708-ce13-4276-8143-eb7a94e4b3da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:12.597987 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76f708-ce13-4276-8143-eb7a94e4b3da admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:12.679255 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 803/1601] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:12 2021] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:12.680087 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de9f32-e69e-450f-ac03-7b8090b416fa admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:12.692262 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 799/1602] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:12 2021] POST /identity/v3/projects => generated 373 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:12.692262 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76f708-ce13-4276-8143-eb7a94e4b3da admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:12.743614 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de9f32-e69e-450f-ac03-7b8090b416fa admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:12.748875 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaf478-cc8c-481c-93f6-80de0e9e19b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:12.749578 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaf478-cc8c-481c-93f6-80de0e9e19b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.749708 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76f708-ce13-4276-8143-eb7a94e4b3da admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:12.749868 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaf478-cc8c-481c-93f6-80de0e9e19b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.750140 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaf478-cc8c-481c-93f6-80de0e9e19b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.750843 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdaf478-cc8c-481c-93f6-80de0e9e19b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:12.752769 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdaf478-cc8c-481c-93f6-80de0e9e19b8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:12.754243 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bafc0e-58f8-4f72-8efd-c76f654f221e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:12.755138 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bafc0e-58f8-4f72-8efd-c76f654f221e admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.755474 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bafc0e-58f8-4f72-8efd-c76f654f221e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.755738 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bafc0e-58f8-4f72-8efd-c76f654f221e admin admin] PATH_INFO: `/v3/projects/dc51e914f5e74ceca4086caa5a05b8f0/users/882a63823deb40dcb93ddc76f81ab9d0/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.771522 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bafc0e-58f8-4f72-8efd-c76f654f221e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc51e914f5e74ceca4086caa5a05b8f0, user_id=882a63823deb40dcb93ddc76f81ab9d0, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:12.774156 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bafc0e-58f8-4f72-8efd-c76f654f221e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:12.833745 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 804/1603] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:12 2021] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:12.834605 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaf478-cc8c-481c-93f6-80de0e9e19b8 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:12.856690 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 800/1604] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:12 2021] PUT /identity/v3/projects/dc51e914f5e74ceca4086caa5a05b8f0/users/882a63823deb40dcb93ddc76f81ab9d0/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:12.857623 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bafc0e-58f8-4f72-8efd-c76f654f221e admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:12.895280 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaf478-cc8c-481c-93f6-80de0e9e19b8 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:12.923491 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bafc0e-58f8-4f72-8efd-c76f654f221e admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:12.927929 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57417b-b56f-4397-9862-fe0b87c5d5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:12.928889 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57417b-b56f-4397-9862-fe0b87c5d5b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.929167 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57417b-b56f-4397-9862-fe0b87c5d5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.929436 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57417b-b56f-4397-9862-fe0b87c5d5b2 admin admin] PATH_INFO: `/v3/projects/20d6b836bad84f94b912abfa13f5f3e7/users/0e40a9461975424ab1166ff50aaa9aca/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.943556 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57417b-b56f-4397-9862-fe0b87c5d5b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d6b836bad84f94b912abfa13f5f3e7, user_id=0e40a9461975424ab1166ff50aaa9aca, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:12.946257 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57417b-b56f-4397-9862-fe0b87c5d5b2 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:12.950923 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f167f13-a729-4c61-936c-321475c723ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:12.951679 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f167f13-a729-4c61-936c-321475c723ef admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:12.951964 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f167f13-a729-4c61-936c-321475c723ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:12.952240 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f167f13-a729-4c61-936c-321475c723ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:12.952968 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f167f13-a729-4c61-936c-321475c723ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:12.954862 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f167f13-a729-4c61-936c-321475c723ef admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:13.049180 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 801/1605] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:12 2021] PUT /identity/v3/projects/20d6b836bad84f94b912abfa13f5f3e7/users/0e40a9461975424ab1166ff50aaa9aca/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:13.049902 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57417b-b56f-4397-9862-fe0b87c5d5b2 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:13.075902 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 805/1606] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:12 2021] POST /identity/v3/projects => generated 391 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:13.077058 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f167f13-a729-4c61-936c-321475c723ef admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:13.110136 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57417b-b56f-4397-9862-fe0b87c5d5b2 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:13.134406 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f167f13-a729-4c61-936c-321475c723ef admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:13.139734 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f13af-d568-4cf8-89d8-ad9c4badbc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:13.140391 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f13af-d568-4cf8-89d8-ad9c4badbc6d admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.140673 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f13af-d568-4cf8-89d8-ad9c4badbc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.140945 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f13af-d568-4cf8-89d8-ad9c4badbc6d admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.141639 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f13af-d568-4cf8-89d8-ad9c4badbc6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:13.143549 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f13af-d568-4cf8-89d8-ad9c4badbc6d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:13.164275 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e2076-92a3-48f8-b19d-35e8e0d9ae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:13.164939 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e2076-92a3-48f8-b19d-35e8e0d9ae1e admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.165223 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e2076-92a3-48f8-b19d-35e8e0d9ae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.165756 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e2076-92a3-48f8-b19d-35e8e0d9ae1e admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.166451 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e2076-92a3-48f8-b19d-35e8e0d9ae1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:13.168388 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e2076-92a3-48f8-b19d-35e8e0d9ae1e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:13.245156 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 806/1607] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:13 2021] POST /identity/v3/users => generated 295 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:13.245961 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f13af-d568-4cf8-89d8-ad9c4badbc6d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:13.256066 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f13af-d568-4cf8-89d8-ad9c4badbc6d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:13.260620 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b8477-7fd1-4570-991c-ee67990e6ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:13.261262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b8477-7fd1-4570-991c-ee67990e6ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.261577 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b8477-7fd1-4570-991c-ee67990e6ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.261856 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b8477-7fd1-4570-991c-ee67990e6ae0 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.262626 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b8477-7fd1-4570-991c-ee67990e6ae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:13.264647 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b8477-7fd1-4570-991c-ee67990e6ae0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:13.273887 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 802/1608] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:13 2021] POST /identity/v3/users => generated 303 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:13.274737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e2076-92a3-48f8-b19d-35e8e0d9ae1e admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:13.284065 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e2076-92a3-48f8-b19d-35e8e0d9ae1e admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:13.288622 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f2126-57dd-4d7f-bcb0-9783f05edf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:13.289623 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f2126-57dd-4d7f-bcb0-9783f05edf87 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.289745 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f2126-57dd-4d7f-bcb0-9783f05edf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.289942 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f2126-57dd-4d7f-bcb0-9783f05edf87 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.290917 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f2126-57dd-4d7f-bcb0-9783f05edf87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:13.292844 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f2126-57dd-4d7f-bcb0-9783f05edf87 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:13.363609 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 807/1609] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:13 2021] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:13.364486 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b8477-7fd1-4570-991c-ee67990e6ae0 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:13.373685 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b8477-7fd1-4570-991c-ee67990e6ae0 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:13.378118 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8063c9-baa1-4e49-8efa-b3a58e42ffa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:13.378769 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8063c9-baa1-4e49-8efa-b3a58e42ffa4 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.379150 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8063c9-baa1-4e49-8efa-b3a58e42ffa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.379452 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8063c9-baa1-4e49-8efa-b3a58e42ffa4 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.380144 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8063c9-baa1-4e49-8efa-b3a58e42ffa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:13.382138 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8063c9-baa1-4e49-8efa-b3a58e42ffa4 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:13.388311 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 803/1610] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:13 2021] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:13.390573 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d35a3-60ec-4ad3-ab16-3a24dcc1ed5c None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.390573 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d35a3-60ec-4ad3-ab16-3a24dcc1ed5c None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.390573 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d35a3-60ec-4ad3-ab16-3a24dcc1ed5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.406455 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-6e7d35a3-60ec-4ad3-ab16-3a24dcc1ed5c None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:13.407689 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-6e7d35a3-60ec-4ad3-ab16-3a24dcc1ed5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:13.414998 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 804/1611] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:13.419363 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190b146-f924-4218-b8d8-23145ee769be None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.419363 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190b146-f924-4218-b8d8-23145ee769be None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.419363 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190b146-f924-4218-b8d8-23145ee769be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.441947 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-7190b146-f924-4218-b8d8-23145ee769be None None] MFA Rules not processed for user `0e40a9461975424ab1166ff50aaa9aca`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:13.443293 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-7190b146-f924-4218-b8d8-23145ee769be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:13.461720 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 808/1612] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:13 2021] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:13.465232 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8063c9-baa1-4e49-8efa-b3a58e42ffa4 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:13.473029 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8063c9-baa1-4e49-8efa-b3a58e42ffa4 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:13.477647 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55657b-de5e-4c5c-8272-e1a41652b8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:13.478288 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55657b-de5e-4c5c-8272-e1a41652b8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.478570 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55657b-de5e-4c5c-8272-e1a41652b8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.478844 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55657b-de5e-4c5c-8272-e1a41652b8a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.479580 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55657b-de5e-4c5c-8272-e1a41652b8a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:13.482117 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55657b-de5e-4c5c-8272-e1a41652b8a2 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:13.506966 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 805/1613] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:13 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:13.508005 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190b146-f924-4218-b8d8-23145ee769be None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:13.518452 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190b146-f924-4218-b8d8-23145ee769be None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:13.522869 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35c959-61fd-4279-83fe-8dc3bb870dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:13.523534 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35c959-61fd-4279-83fe-8dc3bb870dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.523814 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35c959-61fd-4279-83fe-8dc3bb870dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.524093 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35c959-61fd-4279-83fe-8dc3bb870dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.524819 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35c959-61fd-4279-83fe-8dc3bb870dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:13.526393 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35c959-61fd-4279-83fe-8dc3bb870dc0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:13.536562 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 806/1614] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:13.537457 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35c959-61fd-4279-83fe-8dc3bb870dc0 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:13.546709 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35c959-61fd-4279-83fe-8dc3bb870dc0 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:13.551091 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af244d-3e14-4b25-b2a0-568ba55bf924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:13.551727 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af244d-3e14-4b25-b2a0-568ba55bf924 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.552013 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af244d-3e14-4b25-b2a0-568ba55bf924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.552289 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af244d-3e14-4b25-b2a0-568ba55bf924 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.552996 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af244d-3e14-4b25-b2a0-568ba55bf924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:13.554499 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af244d-3e14-4b25-b2a0-568ba55bf924 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:13.563952 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 807/1615] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:13 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:13.565554 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af244d-3e14-4b25-b2a0-568ba55bf924 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:13.569275 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 809/1616] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:13 2021] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:13.569968 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55657b-de5e-4c5c-8272-e1a41652b8a2 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:13.575632 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af244d-3e14-4b25-b2a0-568ba55bf924 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:13.580019 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55657b-de5e-4c5c-8272-e1a41652b8a2 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:13.580332 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db16469-036b-4e34-8f66-2f7f53974af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:13.580979 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db16469-036b-4e34-8f66-2f7f53974af7 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.581266 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db16469-036b-4e34-8f66-2f7f53974af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.581544 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db16469-036b-4e34-8f66-2f7f53974af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.582305 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db16469-036b-4e34-8f66-2f7f53974af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:13.583939 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db16469-036b-4e34-8f66-2f7f53974af7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:13.584794 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4b2cd-c3c5-41b2-b1f0-0d6c03669164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:13.585427 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4b2cd-c3c5-41b2-b1f0-0d6c03669164 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.585709 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4b2cd-c3c5-41b2-b1f0-0d6c03669164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.585983 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4b2cd-c3c5-41b2-b1f0-0d6c03669164 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.586754 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4b2cd-c3c5-41b2-b1f0-0d6c03669164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:13.588341 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4b2cd-c3c5-41b2-b1f0-0d6c03669164 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:13.595340 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 808/1617] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:13.595970 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db16469-036b-4e34-8f66-2f7f53974af7 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:13.600165 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 810/1618] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:13.603735 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4b2cd-c3c5-41b2-b1f0-0d6c03669164 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:13.613198 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4b2cd-c3c5-41b2-b1f0-0d6c03669164 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:13.618112 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78b0fe-5b44-4ee4-b8a0-39b4e8814815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:13.619252 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78b0fe-5b44-4ee4-b8a0-39b4e8814815 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.619538 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78b0fe-5b44-4ee4-b8a0-39b4e8814815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.619815 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78b0fe-5b44-4ee4-b8a0-39b4e8814815 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.620536 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78b0fe-5b44-4ee4-b8a0-39b4e8814815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:13.622672 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78b0fe-5b44-4ee4-b8a0-39b4e8814815 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:13.632898 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 811/1619] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:13.633674 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78b0fe-5b44-4ee4-b8a0-39b4e8814815 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:13.643675 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78b0fe-5b44-4ee4-b8a0-39b4e8814815 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:13.648179 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ee935-d16b-4669-b3a1-86e59158ed62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:13.648803 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ee935-d16b-4669-b3a1-86e59158ed62 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.649085 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ee935-d16b-4669-b3a1-86e59158ed62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.649358 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ee935-d16b-4669-b3a1-86e59158ed62 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.650052 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ee935-d16b-4669-b3a1-86e59158ed62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:13.651928 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ee935-d16b-4669-b3a1-86e59158ed62 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:13.652552 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db16469-036b-4e34-8f66-2f7f53974af7 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:13.656325 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d7282-730c-4bd7-af28-224fd78fe32f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:13.656962 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d7282-730c-4bd7-af28-224fd78fe32f service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.657244 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d7282-730c-4bd7-af28-224fd78fe32f service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.657547 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d7282-730c-4bd7-af28-224fd78fe32f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.666772 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d7282-730c-4bd7-af28-224fd78fe32f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:13.668222 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d7282-730c-4bd7-af28-224fd78fe32f service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:13.677858 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 809/1620] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:13.678721 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d7282-730c-4bd7-af28-224fd78fe32f service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:13.688515 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d7282-730c-4bd7-af28-224fd78fe32f service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:13.693307 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5243e7a-4e92-4477-a481-5184972d3c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:13.693950 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5243e7a-4e92-4477-a481-5184972d3c6e admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.694230 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5243e7a-4e92-4477-a481-5184972d3c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.694506 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5243e7a-4e92-4477-a481-5184972d3c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.695272 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5243e7a-4e92-4477-a481-5184972d3c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:13.696957 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5243e7a-4e92-4477-a481-5184972d3c6e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:13.707595 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 810/1621] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:13.712786 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5243e7a-4e92-4477-a481-5184972d3c6e admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:13.717495 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5243e7a-4e92-4477-a481-5184972d3c6e admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:13.721974 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64d4a9-24f2-44b3-91a0-ce56d7896acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:13.722584 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64d4a9-24f2-44b3-91a0-ce56d7896acf admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.722863 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64d4a9-24f2-44b3-91a0-ce56d7896acf admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.723137 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64d4a9-24f2-44b3-91a0-ce56d7896acf admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.723921 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64d4a9-24f2-44b3-91a0-ce56d7896acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:13.725457 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64d4a9-24f2-44b3-91a0-ce56d7896acf admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:13.738218 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 811/1622] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:13 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:13.738218 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64d4a9-24f2-44b3-91a0-ce56d7896acf admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:13.745460 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64d4a9-24f2-44b3-91a0-ce56d7896acf admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:13.747366 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 812/1623] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:13 2021] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:13.747989 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ee935-d16b-4669-b3a1-86e59158ed62 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:13.807111 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4c422-911d-42ac-aedf-88ffb006c99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:13.810306 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4c422-911d-42ac-aedf-88ffb006c99d admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.810306 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4c422-911d-42ac-aedf-88ffb006c99d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.810306 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4c422-911d-42ac-aedf-88ffb006c99d admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.810306 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4c422-911d-42ac-aedf-88ffb006c99d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:13.810841 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ee935-d16b-4669-b3a1-86e59158ed62 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:13.811259 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4c422-911d-42ac-aedf-88ffb006c99d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:13.815487 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194d722-1a91-416f-bea9-617929950cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:13.816164 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194d722-1a91-416f-bea9-617929950cdc admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.816449 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194d722-1a91-416f-bea9-617929950cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.816741 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194d722-1a91-416f-bea9-617929950cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.817486 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194d722-1a91-416f-bea9-617929950cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:13.819079 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194d722-1a91-416f-bea9-617929950cdc admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:13.826902 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 812/1624] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:13 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:13.826902 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4c422-911d-42ac-aedf-88ffb006c99d admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:13.832730 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 813/1625] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:13 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:13.836731 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194d722-1a91-416f-bea9-617929950cdc admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:13.839551 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4c422-911d-42ac-aedf-88ffb006c99d admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:13.844956 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e954fa1-3c21-4c2e-b717-6c4368374534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:13.845620 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e954fa1-3c21-4c2e-b717-6c4368374534 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.846239 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e954fa1-3c21-4c2e-b717-6c4368374534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.846239 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e954fa1-3c21-4c2e-b717-6c4368374534 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.846907 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e954fa1-3c21-4c2e-b717-6c4368374534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:13.847820 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194d722-1a91-416f-bea9-617929950cdc admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:13.848592 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e954fa1-3c21-4c2e-b717-6c4368374534 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:13.853068 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c9c13-5373-45c9-bbf0-9f953dc846ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:13.853874 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c9c13-5373-45c9-bbf0-9f953dc846ab admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.854165 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c9c13-5373-45c9-bbf0-9f953dc846ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.854452 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c9c13-5373-45c9-bbf0-9f953dc846ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.855270 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c9c13-5373-45c9-bbf0-9f953dc846ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:13.857337 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c9c13-5373-45c9-bbf0-9f953dc846ab admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:13.860345 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 813/1626] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:13 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:13.861375 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e954fa1-3c21-4c2e-b717-6c4368374534 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:13.873345 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 814/1627] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:13 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:13.873345 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c9c13-5373-45c9-bbf0-9f953dc846ab admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:13.877842 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e954fa1-3c21-4c2e-b717-6c4368374534 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:13.881183 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c9c13-5373-45c9-bbf0-9f953dc846ab admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:13.883706 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80931bfe-870d-4c79-b150-34981f3e94ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:13.884984 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80931bfe-870d-4c79-b150-34981f3e94ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.885522 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80931bfe-870d-4c79-b150-34981f3e94ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.885859 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dcded2-66f1-43b6-971e-7e1b7803e7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:13.886209 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80931bfe-870d-4c79-b150-34981f3e94ed admin admin] PATH_INFO: `/v3/projects/891dccdfaeb440dd89a185b6d130b3f0/users/1009c9c7798f48f6ad891766711d0c0f/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.886730 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcded2-66f1-43b6-971e-7e1b7803e7bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:13.887021 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcded2-66f1-43b6-971e-7e1b7803e7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:13.887434 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcded2-66f1-43b6-971e-7e1b7803e7bc admin admin] PATH_INFO: `/v3/projects/32028919ab4740118fb1de464a23602b/users/1b376902b54d46b2a8d16f3f789aa171/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:13.902674 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dcded2-66f1-43b6-971e-7e1b7803e7bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=32028919ab4740118fb1de464a23602b, user_id=1b376902b54d46b2a8d16f3f789aa171, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:13.906685 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80931bfe-870d-4c79-b150-34981f3e94ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=891dccdfaeb440dd89a185b6d130b3f0, user_id=1009c9c7798f48f6ad891766711d0c0f, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:13.906800 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dcded2-66f1-43b6-971e-7e1b7803e7bc admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:13.906893 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80931bfe-870d-4c79-b150-34981f3e94ed admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:13.983775 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 815/1629] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:13 2021] PUT /identity/v3/projects/32028919ab4740118fb1de464a23602b/users/1b376902b54d46b2a8d16f3f789aa171/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:13.985874 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dcded2-66f1-43b6-971e-7e1b7803e7bc admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:13.988039 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 814/1629] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:13 2021] PUT /identity/v3/projects/891dccdfaeb440dd89a185b6d130b3f0/users/1009c9c7798f48f6ad891766711d0c0f/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:13.988999 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80931bfe-870d-4c79-b150-34981f3e94ed admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:14.060287 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80931bfe-870d-4c79-b150-34981f3e94ed admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:14.065509 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dcded2-66f1-43b6-971e-7e1b7803e7bc admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:14.065956 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff30b0-5c09-47db-b4be-5fc304a6a45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:14.066853 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff30b0-5c09-47db-b4be-5fc304a6a45a admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:14.067450 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff30b0-5c09-47db-b4be-5fc304a6a45a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:14.071836 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff30b0-5c09-47db-b4be-5fc304a6a45a admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:14.071836 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff30b0-5c09-47db-b4be-5fc304a6a45a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:14.071836 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff30b0-5c09-47db-b4be-5fc304a6a45a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:14.072167 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20532e-b6db-4aa5-9d32-8830ddbf6864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:14.072167 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20532e-b6db-4aa5-9d32-8830ddbf6864 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:14.072167 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20532e-b6db-4aa5-9d32-8830ddbf6864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:14.072167 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20532e-b6db-4aa5-9d32-8830ddbf6864 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:14.072512 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20532e-b6db-4aa5-9d32-8830ddbf6864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:14.074307 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20532e-b6db-4aa5-9d32-8830ddbf6864 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:14.081383 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 815/1630] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:13 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:14.082469 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff30b0-5c09-47db-b4be-5fc304a6a45a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:14.092843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff30b0-5c09-47db-b4be-5fc304a6a45a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:14.097486 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d7e05-5e61-4411-91da-de7c72ef09d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:14.100460 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d7e05-5e61-4411-91da-de7c72ef09d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:14.100460 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d7e05-5e61-4411-91da-de7c72ef09d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:14.100460 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d7e05-5e61-4411-91da-de7c72ef09d1 admin admin] PATH_INFO: `/v3/projects/04145637610344c69dd78ebf3ecd92ed/users/9c04ecf61bb2468a99223a57cb41fd18/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:14.114717 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d7e05-5e61-4411-91da-de7c72ef09d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04145637610344c69dd78ebf3ecd92ed, user_id=9c04ecf61bb2468a99223a57cb41fd18, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:14.117386 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d7e05-5e61-4411-91da-de7c72ef09d1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:14.206370 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 816/1631] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:13 2021] POST /identity/v3/users => generated 292 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:14.207301 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20532e-b6db-4aa5-9d32-8830ddbf6864 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:14.219615 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20532e-b6db-4aa5-9d32-8830ddbf6864 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:14.225921 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 816/1632] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:14 2021] PUT /identity/v3/projects/04145637610344c69dd78ebf3ecd92ed/users/9c04ecf61bb2468a99223a57cb41fd18/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:14.226612 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d7e05-5e61-4411-91da-de7c72ef09d1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:14.296122 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d7e05-5e61-4411-91da-de7c72ef09d1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:14.299034 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5815116-299f-4627-9427-98ab4f995f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:14.300048 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5815116-299f-4627-9427-98ab4f995f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:14.300392 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5815116-299f-4627-9427-98ab4f995f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:14.300729 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93541baf-7dce-4c72-9305-fccebd8e0e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:14.300868 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5815116-299f-4627-9427-98ab4f995f72 admin admin] PATH_INFO: `/v3/projects/7c7f4b2ad4b446c1b655678ebee9c509/users/81c37feecf7e4e8b9d2d1db0998f4f2a/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:14.303797 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93541baf-7dce-4c72-9305-fccebd8e0e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:14.304101 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93541baf-7dce-4c72-9305-fccebd8e0e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:14.304384 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93541baf-7dce-4c72-9305-fccebd8e0e1c admin admin] PATH_INFO: `/v3/projects/19b745e2285646b395e26a0479a5d48b/users/4415187cb3684c578b5702d9d6bb6ce7/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:14.317858 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5815116-299f-4627-9427-98ab4f995f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7f4b2ad4b446c1b655678ebee9c509, user_id=81c37feecf7e4e8b9d2d1db0998f4f2a, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:14.320622 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5815116-299f-4627-9427-98ab4f995f72 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:14.321248 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93541baf-7dce-4c72-9305-fccebd8e0e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b745e2285646b395e26a0479a5d48b, user_id=4415187cb3684c578b5702d9d6bb6ce7, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:14.324804 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93541baf-7dce-4c72-9305-fccebd8e0e1c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:14.377240 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 817/1633] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:14 2021] PUT /identity/v3/projects/7c7f4b2ad4b446c1b655678ebee9c509/users/81c37feecf7e4e8b9d2d1db0998f4f2a/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:14.378904 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dcf0f-b820-4fb4-8a61-a157dad5288f None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:14.379410 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dcf0f-b820-4fb4-8a61-a157dad5288f None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:14.383426 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dcf0f-b820-4fb4-8a61-a157dad5288f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:14.396909 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 817/1634] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:14 2021] PUT /identity/v3/projects/19b745e2285646b395e26a0479a5d48b/users/4415187cb3684c578b5702d9d6bb6ce7/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:14.398420 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3bc42-3c4a-43a8-a473-3edab72a8cbf None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:14.398647 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3bc42-3c4a-43a8-a473-3edab72a8cbf None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:14.398929 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3bc42-3c4a-43a8-a473-3edab72a8cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:14.399339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-827dcf0f-b820-4fb4-8a61-a157dad5288f None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:14.400892 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-827dcf0f-b820-4fb4-8a61-a157dad5288f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:14.419645 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-46b3bc42-3c4a-43a8-a473-3edab72a8cbf None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:14.420860 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-46b3bc42-3c4a-43a8-a473-3edab72a8cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:14.468553 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 818/1635] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:14.469516 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827dcf0f-b820-4fb4-8a61-a157dad5288f None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:14.478593 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827dcf0f-b820-4fb4-8a61-a157dad5288f None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:14.483700 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10004545-d912-43e9-9fa0-70a2116a6e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:14.484585 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10004545-d912-43e9-9fa0-70a2116a6e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:14.484869 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10004545-d912-43e9-9fa0-70a2116a6e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:14.485169 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10004545-d912-43e9-9fa0-70a2116a6e5c admin admin] PATH_INFO: `/v3/projects/79d1a358755a4113b0a35cf50d3cc95a/users/9477961ce0bc4164be46f0a54a309d7c/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:14.486859 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 818/1636] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:14.488854 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3bc42-3c4a-43a8-a473-3edab72a8cbf None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:14.502222 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3bc42-3c4a-43a8-a473-3edab72a8cbf None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:14.503497 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10004545-d912-43e9-9fa0-70a2116a6e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d1a358755a4113b0a35cf50d3cc95a, user_id=9477961ce0bc4164be46f0a54a309d7c, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:14.507145 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10004545-d912-43e9-9fa0-70a2116a6e5c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:14.507292 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975db7a-a0bf-4a87-a5e2-39bf5db0834a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:14.507519 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975db7a-a0bf-4a87-a5e2-39bf5db0834a admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:14.507822 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975db7a-a0bf-4a87-a5e2-39bf5db0834a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:14.508076 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975db7a-a0bf-4a87-a5e2-39bf5db0834a admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:14.508811 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975db7a-a0bf-4a87-a5e2-39bf5db0834a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:14.510491 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975db7a-a0bf-4a87-a5e2-39bf5db0834a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:14.520933 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 819/1637] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:14 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:14.522143 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5d2f1-ae15-47ab-ac7e-c607f2f45da7 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:14.522482 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5d2f1-ae15-47ab-ac7e-c607f2f45da7 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:14.522694 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5d2f1-ae15-47ab-ac7e-c607f2f45da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:14.539904 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-38a5d2f1-ae15-47ab-ac7e-c607f2f45da7 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:14.541347 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-38a5d2f1-ae15-47ab-ac7e-c607f2f45da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:14.549563 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 820/1638] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:14.550810 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327902d-5669-4c8d-8fbe-f7be1aa42be7 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:14.551093 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327902d-5669-4c8d-8fbe-f7be1aa42be7 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:14.551504 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327902d-5669-4c8d-8fbe-f7be1aa42be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:14.577255 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-5327902d-5669-4c8d-8fbe-f7be1aa42be7 None None] MFA Rules not processed for user `81c37feecf7e4e8b9d2d1db0998f4f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:14.578418 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-5327902d-5669-4c8d-8fbe-f7be1aa42be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:14.594916 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 819/1639] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:14 2021] PUT /identity/v3/projects/79d1a358755a4113b0a35cf50d3cc95a/users/9477961ce0bc4164be46f0a54a309d7c/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:14.597269 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0b04b-1c7d-4b67-81c7-f682c875ccaa None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:14.597269 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0b04b-1c7d-4b67-81c7-f682c875ccaa None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:14.597269 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0b04b-1c7d-4b67-81c7-f682c875ccaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:14.625490 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-1bc0b04b-1c7d-4b67-81c7-f682c875ccaa None None] MFA Rules not processed for user `4415187cb3684c578b5702d9d6bb6ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:14.627924 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-1bc0b04b-1c7d-4b67-81c7-f682c875ccaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:14.651047 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 821/1640] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:14 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:14.651975 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327902d-5669-4c8d-8fbe-f7be1aa42be7 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:14.696432 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 820/1641] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:14 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:14.697800 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0b04b-1c7d-4b67-81c7-f682c875ccaa None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:14.699488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-1bc0b04b-1c7d-4b67-81c7-f682c875ccaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:14.709758 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327902d-5669-4c8d-8fbe-f7be1aa42be7 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:14.757152 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0b04b-1c7d-4b67-81c7-f682c875ccaa None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:14.758322 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7fae2-36b8-47e4-8869-258511bdc543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:14.758973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7fae2-36b8-47e4-8869-258511bdc543 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:14.759284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7fae2-36b8-47e4-8869-258511bdc543 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:14.759565 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7fae2-36b8-47e4-8869-258511bdc543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:14.760891 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276dce7-b79c-46f6-8a91-a7f49cfc4d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:14.761542 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276dce7-b79c-46f6-8a91-a7f49cfc4d27 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:14.761834 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276dce7-b79c-46f6-8a91-a7f49cfc4d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:14.762113 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276dce7-b79c-46f6-8a91-a7f49cfc4d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:14.819316 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7fae2-36b8-47e4-8869-258511bdc543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:14.820755 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7fae2-36b8-47e4-8869-258511bdc543 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:14.823968 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276dce7-b79c-46f6-8a91-a7f49cfc4d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:14.825903 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276dce7-b79c-46f6-8a91-a7f49cfc4d27 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:14.830550 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 822/1642] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:14.831342 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7fae2-36b8-47e4-8869-258511bdc543 service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:14.835792 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 821/1643] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:14.838059 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276dce7-b79c-46f6-8a91-a7f49cfc4d27 service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:14.845069 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276dce7-b79c-46f6-8a91-a7f49cfc4d27 service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:14.848708 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7fae2-36b8-47e4-8869-258511bdc543 service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:14.848923 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3939c4-6f1b-4b1a-b567-df9414604850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:14.849543 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3939c4-6f1b-4b1a-b567-df9414604850 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:14.849829 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3939c4-6f1b-4b1a-b567-df9414604850 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:14.850105 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3939c4-6f1b-4b1a-b567-df9414604850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:14.855157 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09921fb-cadb-4dfd-846b-fcff086a99d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:14.856194 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09921fb-cadb-4dfd-846b-fcff086a99d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:14.856806 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09921fb-cadb-4dfd-846b-fcff086a99d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:14.857093 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09921fb-cadb-4dfd-846b-fcff086a99d7 admin admin] PATH_INFO: `/v3/projects/1352f0cb379b4fccb0d0f3d11d767aa9/users/05ce7c7c660448aeab0af5cef8e24e17/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:14.859940 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3939c4-6f1b-4b1a-b567-df9414604850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:14.861445 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3939c4-6f1b-4b1a-b567-df9414604850 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:14.871448 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 822/1644] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:14.873117 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504aefd-8a3b-48d2-8ca4-27be62baa0b6 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:14.873582 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504aefd-8a3b-48d2-8ca4-27be62baa0b6 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:14.875882 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504aefd-8a3b-48d2-8ca4-27be62baa0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:14.876053 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09921fb-cadb-4dfd-846b-fcff086a99d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1352f0cb379b4fccb0d0f3d11d767aa9, user_id=05ce7c7c660448aeab0af5cef8e24e17, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:14.879982 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09921fb-cadb-4dfd-846b-fcff086a99d7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:14.892947 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-8504aefd-8a3b-48d2-8ca4-27be62baa0b6 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:14.894158 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-8504aefd-8a3b-48d2-8ca4-27be62baa0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:14.904488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 823/1645] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:14.904488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc2a57-48ea-4a0a-b4ef-1e8e75d52768 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:14.904488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc2a57-48ea-4a0a-b4ef-1e8e75d52768 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:14.904488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc2a57-48ea-4a0a-b4ef-1e8e75d52768 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:14.906002 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 824/1646] 10.222.0.54 () {54 vars in 961 bytes} [Tue Nov 23 04:14:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:14:14.907145 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab4c55-be4c-4bfa-aedd-640932f11b23 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:14.907455 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab4c55-be4c-4bfa-aedd-640932f11b23 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:14.907731 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab4c55-be4c-4bfa-aedd-640932f11b23 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:14.909594 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 825/1647] 10.222.0.54 () {54 vars in 961 bytes} [Tue Nov 23 04:14:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:14:14.915749 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1b4d7-afbd-4021-92cb-74be4f7711fa None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:14.916045 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1b4d7-afbd-4021-92cb-74be4f7711fa None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:14.916307 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1b4d7-afbd-4021-92cb-74be4f7711fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:14.936616 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-e4d1b4d7-afbd-4021-92cb-74be4f7711fa None None] MFA Rules not processed for user `35e14131fb22470cba63cd5e8db359e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:14.938117 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e4d1b4d7-afbd-4021-92cb-74be4f7711fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:14.995012 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 823/1648] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:14 2021] PUT /identity/v3/projects/1352f0cb379b4fccb0d0f3d11d767aa9/users/05ce7c7c660448aeab0af5cef8e24e17/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:14.997898 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5bd06-71bf-4bcf-a55d-b3a7adf3dca2 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:14.998580 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5bd06-71bf-4bcf-a55d-b3a7adf3dca2 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:14.998704 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5bd06-71bf-4bcf-a55d-b3a7adf3dca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:15.023837 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-08e5bd06-71bf-4bcf-a55d-b3a7adf3dca2 None None] MFA Rules not processed for user `35e14131fb22470cba63cd5e8db359e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:15.025524 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-08e5bd06-71bf-4bcf-a55d-b3a7adf3dca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:15.056702 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 826/1649] 10.222.0.54 () {58 vars in 1058 bytes} [Tue Nov 23 04:14:14 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:15.057723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1b4d7-afbd-4021-92cb-74be4f7711fa None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:15.069596 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1b4d7-afbd-4021-92cb-74be4f7711fa None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:15.119049 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 824/1650] 10.222.0.54 () {58 vars in 1058 bytes} [Tue Nov 23 04:14:14 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:15.120720 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5bd06-71bf-4bcf-a55d-b3a7adf3dca2 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:15.163307 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e5358-8911-463d-848b-c749c8bcdf56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:15.172132 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e5358-8911-463d-848b-c749c8bcdf56 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:15.173149 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e5358-8911-463d-848b-c749c8bcdf56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:15.174595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e5358-8911-463d-848b-c749c8bcdf56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:15.260711 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5bd06-71bf-4bcf-a55d-b3a7adf3dca2 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:15.273831 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412339c0-beb4-4dfd-a5f7-ea891e0350f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:15.276867 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412339c0-beb4-4dfd-a5f7-ea891e0350f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:15.276867 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412339c0-beb4-4dfd-a5f7-ea891e0350f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:15.276867 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412339c0-beb4-4dfd-a5f7-ea891e0350f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:15.276867 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412339c0-beb4-4dfd-a5f7-ea891e0350f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:15.277671 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412339c0-beb4-4dfd-a5f7-ea891e0350f9 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:15.302356 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 825/1651] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:15 2021] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:15.305600 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412339c0-beb4-4dfd-a5f7-ea891e0350f9 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:15.317502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412339c0-beb4-4dfd-a5f7-ea891e0350f9 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:15.319398 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e5358-8911-463d-848b-c749c8bcdf56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:15.320857 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e5358-8911-463d-848b-c749c8bcdf56 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:15.325979 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db864b77-2c7d-4c03-bdec-66a43eb9b6cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:15.326750 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db864b77-2c7d-4c03-bdec-66a43eb9b6cf service nova] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:15.326965 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db864b77-2c7d-4c03-bdec-66a43eb9b6cf service nova] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:15.327326 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db864b77-2c7d-4c03-bdec-66a43eb9b6cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:15.331785 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 827/1652] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:15.338539 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e5358-8911-463d-848b-c749c8bcdf56 service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:15.346005 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e5358-8911-463d-848b-c749c8bcdf56 service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:15.354009 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fff77-9fc0-4f28-9386-c37e1c86e51a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:15.355131 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fff77-9fc0-4f28-9386-c37e1c86e51a service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:15.355468 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fff77-9fc0-4f28-9386-c37e1c86e51a service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:15.355873 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fff77-9fc0-4f28-9386-c37e1c86e51a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:15.407642 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db864b77-2c7d-4c03-bdec-66a43eb9b6cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:15.409241 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db864b77-2c7d-4c03-bdec-66a43eb9b6cf service nova] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:15.419759 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 826/1653] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:15 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:15.421176 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dba89-560e-494a-a1d2-ca6d1a11472a None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:15.421466 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dba89-560e-494a-a1d2-ca6d1a11472a None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:15.421857 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dba89-560e-494a-a1d2-ca6d1a11472a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:15.442098 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fff77-9fc0-4f28-9386-c37e1c86e51a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:15.443785 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fff77-9fc0-4f28-9386-c37e1c86e51a service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:15.465504 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 828/1654] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:15 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:15.468400 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fff77-9fc0-4f28-9386-c37e1c86e51a service nova] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:15.469064 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-458dba89-560e-494a-a1d2-ca6d1a11472a None None] MFA Rules not processed for user `882a63823deb40dcb93ddc76f81ab9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:15.470315 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-458dba89-560e-494a-a1d2-ca6d1a11472a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:15.488858 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fff77-9fc0-4f28-9386-c37e1c86e51a service nova] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:15.505460 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaadb4-239d-4bdc-8c0d-14d40a548019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:15.506359 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaadb4-239d-4bdc-8c0d-14d40a548019 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:15.506651 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaadb4-239d-4bdc-8c0d-14d40a548019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:15.507002 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaadb4-239d-4bdc-8c0d-14d40a548019 admin admin] PATH_INFO: `/v3/projects/1352f0cb379b4fccb0d0f3d11d767aa9/users/05ce7c7c660448aeab0af5cef8e24e17/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:15.509205 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daaadb4-239d-4bdc-8c0d-14d40a548019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1352f0cb379b4fccb0d0f3d11d767aa9, user_id=05ce7c7c660448aeab0af5cef8e24e17, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:15.512065 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daaadb4-239d-4bdc-8c0d-14d40a548019 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:15.540343 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 829/1655] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:15 2021] PUT /identity/v3/projects/1352f0cb379b4fccb0d0f3d11d767aa9/users/05ce7c7c660448aeab0af5cef8e24e17/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:15.555902 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 827/1656] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:15 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:15.556783 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bf31f-4d06-4a7f-9a23-06553c653f86 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:15.556783 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bf31f-4d06-4a7f-9a23-06553c653f86 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:15.556783 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bf31f-4d06-4a7f-9a23-06553c653f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:15.569147 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6c7f6-3791-4e80-bfb7-4d3e7903b4c9 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:15.569147 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6c7f6-3791-4e80-bfb7-4d3e7903b4c9 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:15.569147 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6c7f6-3791-4e80-bfb7-4d3e7903b4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:15.588551 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-809bf31f-4d06-4a7f-9a23-06553c653f86 None None] MFA Rules not processed for user `882a63823deb40dcb93ddc76f81ab9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:15.589793 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-809bf31f-4d06-4a7f-9a23-06553c653f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:15.617537 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-18e6c7f6-3791-4e80-bfb7-4d3e7903b4c9 None None] MFA Rules not processed for user `05ce7c7c660448aeab0af5cef8e24e17`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:15.619773 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-18e6c7f6-3791-4e80-bfb7-4d3e7903b4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:15.709854 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 830/1657] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:15 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:15.727546 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 828/1658] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:15 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:14:15.740371 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bf31f-4d06-4a7f-9a23-06553c653f86 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:15.815148 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9713-26fa-4a71-b8fa-7b47a89f0c0e None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:15.816041 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9713-26fa-4a71-b8fa-7b47a89f0c0e None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:15.816340 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9713-26fa-4a71-b8fa-7b47a89f0c0e None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:15.818416 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 829/1659] 10.222.0.54 () {54 vars in 912 bytes} [Tue Nov 23 04:14:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:14:15.820235 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac9713-26fa-4a71-b8fa-7b47a89f0c0e None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:15.833183 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bf31f-4d06-4a7f-9a23-06553c653f86 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:15.838292 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa82ffa-b826-45e6-9c78-f0fa502ea2fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:15.839263 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa82ffa-b826-45e6-9c78-f0fa502ea2fc service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:15.839567 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa82ffa-b826-45e6-9c78-f0fa502ea2fc service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:15.839817 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa82ffa-b826-45e6-9c78-f0fa502ea2fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:15.851629 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa82ffa-b826-45e6-9c78-f0fa502ea2fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:15.853112 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa82ffa-b826-45e6-9c78-f0fa502ea2fc service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:15.881935 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 831/1660] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:15 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:15.883738 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb4971-59a7-4805-ac73-f73b7132b66c None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:15.886350 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb4971-59a7-4805-ac73-f73b7132b66c None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:15.886350 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb4971-59a7-4805-ac73-f73b7132b66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:15.912130 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-2afb4971-59a7-4805-ac73-f73b7132b66c None None] MFA Rules not processed for user `35e14131fb22470cba63cd5e8db359e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:15.913353 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-2afb4971-59a7-4805-ac73-f73b7132b66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:15.916276 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac9713-26fa-4a71-b8fa-7b47a89f0c0e None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:15.927309 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9893a6-6cea-41bb-a6b8-ba9ccda1de8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:15.927525 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 832/1661] 10.222.0.54 () {58 vars in 1009 bytes} [Tue Nov 23 04:14:15 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:15.927987 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9893a6-6cea-41bb-a6b8-ba9ccda1de8b service nova] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:15.928323 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9893a6-6cea-41bb-a6b8-ba9ccda1de8b service nova] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:15.928611 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9893a6-6cea-41bb-a6b8-ba9ccda1de8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:15.942787 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9893a6-6cea-41bb-a6b8-ba9ccda1de8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:15.942983 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb4971-59a7-4805-ac73-f73b7132b66c None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:15.943088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9893a6-6cea-41bb-a6b8-ba9ccda1de8b service nova] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:15.951737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb4971-59a7-4805-ac73-f73b7132b66c None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:15.956006 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 830/1662] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:15 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:15.964384 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815f2fb-6742-4054-a4dc-6ce01909f3ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:15.965055 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815f2fb-6742-4054-a4dc-6ce01909f3ff service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:15.965863 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815f2fb-6742-4054-a4dc-6ce01909f3ff service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:15.966254 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815f2fb-6742-4054-a4dc-6ce01909f3ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:16.004103 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815f2fb-6742-4054-a4dc-6ce01909f3ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:16.005854 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815f2fb-6742-4054-a4dc-6ce01909f3ff service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:16.034937 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 833/1663] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:15 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:14:16.085853 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02ecf7-4a7e-4c70-ae43-7854ef0ea272 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:16.086150 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02ecf7-4a7e-4c70-ae43-7854ef0ea272 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:16.086651 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02ecf7-4a7e-4c70-ae43-7854ef0ea272 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:16.088706 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 831/1664] 10.222.0.54 () {54 vars in 912 bytes} [Tue Nov 23 04:14:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:14:16.110434 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f132ef-f50a-4784-8bac-1b88a7cf77a5 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:16.110726 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f132ef-f50a-4784-8bac-1b88a7cf77a5 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:16.111010 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f132ef-f50a-4784-8bac-1b88a7cf77a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:16.139873 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02ecf7-4a7e-4c70-ae43-7854ef0ea272 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:16.142892 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-51f132ef-f50a-4784-8bac-1b88a7cf77a5 None None] MFA Rules not processed for user `35e14131fb22470cba63cd5e8db359e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:16.144232 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-51f132ef-f50a-4784-8bac-1b88a7cf77a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:16.153930 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02ecf7-4a7e-4c70-ae43-7854ef0ea272 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:16.155512 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 834/1665] 10.222.0.54 () {58 vars in 1009 bytes} [Tue Nov 23 04:14:16 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:16.162615 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7edc8-1663-4b2f-8093-a120088cdaf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:16.163280 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7edc8-1663-4b2f-8093-a120088cdaf4 service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:16.163575 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7edc8-1663-4b2f-8093-a120088cdaf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:16.163853 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7edc8-1663-4b2f-8093-a120088cdaf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:16.171235 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f132ef-f50a-4784-8bac-1b88a7cf77a5 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:16.172638 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-51f132ef-f50a-4784-8bac-1b88a7cf77a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:16.238711 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f132ef-f50a-4784-8bac-1b88a7cf77a5 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:16.241790 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7edc8-1663-4b2f-8093-a120088cdaf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:16.242268 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7edc8-1663-4b2f-8093-a120088cdaf4 service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:16.243737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadaef26-017c-433d-9a6d-18ada486cb23 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f52add52aa4586aee0b801ceffd764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:16.244586 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadaef26-017c-433d-9a6d-18ada486cb23 service glance] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:16.244959 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadaef26-017c-433d-9a6d-18ada486cb23 service glance] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:16.245332 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadaef26-017c-433d-9a6d-18ada486cb23 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:16.253234 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 832/1666] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:16 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:14:16.264215 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadaef26-017c-433d-9a6d-18ada486cb23 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:16.266312 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadaef26-017c-433d-9a6d-18ada486cb23 service glance] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:16.318382 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 835/1667] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:16 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:14:16.675556 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75672e5-e76a-4567-a70c-9403f843be52 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:16.676107 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75672e5-e76a-4567-a70c-9403f843be52 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:16.677160 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75672e5-e76a-4567-a70c-9403f843be52 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:16.682034 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 833/1668] 10.222.0.54 () {54 vars in 912 bytes} [Tue Nov 23 04:14:16 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:14:16.699569 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff99882-0da4-4ba9-9008-3619dd8cf698 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:16.701467 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff99882-0da4-4ba9-9008-3619dd8cf698 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:16.701467 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff99882-0da4-4ba9-9008-3619dd8cf698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:16.765004 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-dff99882-0da4-4ba9-9008-3619dd8cf698 None None] MFA Rules not processed for user `5c06e29d656f48c99caeb193975b5b91`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:16.766795 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-dff99882-0da4-4ba9-9008-3619dd8cf698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:16.878727 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43474cb8-ad57-4d67-beb3-4e82d13bc066 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:16.879782 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43474cb8-ad57-4d67-beb3-4e82d13bc066 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:16.880497 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43474cb8-ad57-4d67-beb3-4e82d13bc066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:16.912294 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 836/1669] 10.222.0.54 () {58 vars in 1009 bytes} [Tue Nov 23 04:14:16 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:16.924295 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-43474cb8-ad57-4d67-beb3-4e82d13bc066 None None] MFA Rules not processed for user `1b376902b54d46b2a8d16f3f789aa171`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:16.925953 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-43474cb8-ad57-4d67-beb3-4e82d13bc066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:17.010355 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 834/1670] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:16 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:14:17.011431 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff99882-0da4-4ba9-9008-3619dd8cf698 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:17.036944 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43474cb8-ad57-4d67-beb3-4e82d13bc066 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:17.050431 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43474cb8-ad57-4d67-beb3-4e82d13bc066 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:17.055543 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d07d78-ed1f-4994-9185-5e812b060496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:17.056306 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d07d78-ed1f-4994-9185-5e812b060496 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:17.056662 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d07d78-ed1f-4994-9185-5e812b060496 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:17.057008 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d07d78-ed1f-4994-9185-5e812b060496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:17.068492 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d07d78-ed1f-4994-9185-5e812b060496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:17.070385 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d07d78-ed1f-4994-9185-5e812b060496 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:17.088257 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 835/1671] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:17 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:17.149051 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff99882-0da4-4ba9-9008-3619dd8cf698 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:17.160055 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eec483-468c-4d48-bb99-4bdb7af1ef06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:17.161393 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eec483-468c-4d48-bb99-4bdb7af1ef06 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:17.161954 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eec483-468c-4d48-bb99-4bdb7af1ef06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:17.162162 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eec483-468c-4d48-bb99-4bdb7af1ef06 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:17.163048 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eec483-468c-4d48-bb99-4bdb7af1ef06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:17.165977 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eec483-468c-4d48-bb99-4bdb7af1ef06 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:17.319204 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 837/1672] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:17 2021] POST /identity/v3/projects => generated 405 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:14:17.323959 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d07d78-ed1f-4994-9185-5e812b060496 service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:17.345188 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d07d78-ed1f-4994-9185-5e812b060496 service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:17.438405 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f32ec-02ff-4575-99c6-fc74d09fb9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:17.439112 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f32ec-02ff-4575-99c6-fc74d09fb9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:17.439432 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f32ec-02ff-4575-99c6-fc74d09fb9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:17.439716 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f32ec-02ff-4575-99c6-fc74d09fb9e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:17.441618 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f32ec-02ff-4575-99c6-fc74d09fb9e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:17.443964 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f32ec-02ff-4575-99c6-fc74d09fb9e6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:17.620798 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 836/1673] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:17 2021] POST /identity/v3/users => generated 309 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:17.622932 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eec483-468c-4d48-bb99-4bdb7af1ef06 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:17.640818 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eec483-468c-4d48-bb99-4bdb7af1ef06 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:17.647348 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5af05-ebf0-4f09-8d0b-69feb991e260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:17.649877 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5af05-ebf0-4f09-8d0b-69feb991e260 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:17.649877 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5af05-ebf0-4f09-8d0b-69feb991e260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:17.649877 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5af05-ebf0-4f09-8d0b-69feb991e260 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:17.650917 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5af05-ebf0-4f09-8d0b-69feb991e260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:17.654386 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5af05-ebf0-4f09-8d0b-69feb991e260 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:17.666864 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 838/1674] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:17 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:14:17.671309 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f32ec-02ff-4575-99c6-fc74d09fb9e6 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:17.683609 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f32ec-02ff-4575-99c6-fc74d09fb9e6 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:17.689160 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ef1b5-06b3-4c08-8db0-2ed2b7530658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:17.690843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ef1b5-06b3-4c08-8db0-2ed2b7530658 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:17.690843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ef1b5-06b3-4c08-8db0-2ed2b7530658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:17.691055 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ef1b5-06b3-4c08-8db0-2ed2b7530658 admin admin] PATH_INFO: `/v3/projects/bda0b53fb44048c3bdaeeffad1494b52/users/a86286d23a36496099a183773919f079/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:17.714757 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5af05-ebf0-4f09-8d0b-69feb991e260 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:17.722064 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ef1b5-06b3-4c08-8db0-2ed2b7530658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bda0b53fb44048c3bdaeeffad1494b52, user_id=a86286d23a36496099a183773919f079, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:17.724810 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ef1b5-06b3-4c08-8db0-2ed2b7530658 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:17.727420 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5af05-ebf0-4f09-8d0b-69feb991e260 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:17.734260 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544913b-e3c9-48e7-8fa7-5d80c88c8a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:17.735138 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544913b-e3c9-48e7-8fa7-5d80c88c8a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:17.735565 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544913b-e3c9-48e7-8fa7-5d80c88c8a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:17.735849 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544913b-e3c9-48e7-8fa7-5d80c88c8a52 admin admin] PATH_INFO: `/v3/users/4415187cb3684c578b5702d9d6bb6ce7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:17.737095 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544913b-e3c9-48e7-8fa7-5d80c88c8a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4415187cb3684c578b5702d9d6bb6ce7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:17.738101 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: WARNING py.warnings [None req-1544913b-e3c9-48e7-8fa7-5d80c88c8a52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:14:17.738101 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: warnings.warn(msg) Nov 23 04:14:17.738101 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: Nov 23 04:14:17.739344 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544913b-e3c9-48e7-8fa7-5d80c88c8a52 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:17.881335 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 837/1675] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:17 2021] PUT /identity/v3/projects/bda0b53fb44048c3bdaeeffad1494b52/users/a86286d23a36496099a183773919f079/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:14:17.886269 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ef1b5-06b3-4c08-8db0-2ed2b7530658 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:18.021392 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-1544913b-e3c9-48e7-8fa7-5d80c88c8a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4415187cb3684c578b5702d9d6bb6ce7'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:18.049449 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ef1b5-06b3-4c08-8db0-2ed2b7530658 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:18.068851 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564a4ad-77e1-46ac-b484-2ed7f691749c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:18.070037 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564a4ad-77e1-46ac-b484-2ed7f691749c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:18.070999 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564a4ad-77e1-46ac-b484-2ed7f691749c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:18.071675 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564a4ad-77e1-46ac-b484-2ed7f691749c admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:18.072598 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564a4ad-77e1-46ac-b484-2ed7f691749c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:18.083843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564a4ad-77e1-46ac-b484-2ed7f691749c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:18.097700 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 838/1676] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:17 2021] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:14:18.107426 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564a4ad-77e1-46ac-b484-2ed7f691749c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:18.181454 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564a4ad-77e1-46ac-b484-2ed7f691749c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:18.186880 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa8d41-efc2-4b66-9bff-c0c644b83554 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23c3a2a6cfd4492b7d8eaa62dacec94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:18.187489 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa8d41-efc2-4b66-9bff-c0c644b83554 service placement] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:18.187785 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa8d41-efc2-4b66-9bff-c0c644b83554 service placement] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:18.188059 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa8d41-efc2-4b66-9bff-c0c644b83554 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:18.189218 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-1544913b-e3c9-48e7-8fa7-5d80c88c8a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4415187cb3684c578b5702d9d6bb6ce7'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:18.189869 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-ccfa8d41-efc2-4b66-9bff-c0c644b83554 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:18.202319 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa8d41-efc2-4b66-9bff-c0c644b83554 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:18.207524 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa8d41-efc2-4b66-9bff-c0c644b83554 service placement] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:18.213868 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-1544913b-e3c9-48e7-8fa7-5d80c88c8a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4415187cb3684c578b5702d9d6bb6ce7'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:18.214945 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-1544913b-e3c9-48e7-8fa7-5d80c88c8a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4415187cb3684c578b5702d9d6bb6ce7'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:18.215934 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 839/1677] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:18 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:18.217633 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf12988-4515-44da-b564-7c4b90f2e786 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:18.217929 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf12988-4515-44da-b564-7c4b90f2e786 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:18.218210 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf12988-4515-44da-b564-7c4b90f2e786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:18.252339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-1544913b-e3c9-48e7-8fa7-5d80c88c8a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4415187cb3684c578b5702d9d6bb6ce7'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:18.257731 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-ebf12988-4515-44da-b564-7c4b90f2e786 None None] MFA Rules not processed for user `9c04ecf61bb2468a99223a57cb41fd18`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:18.259000 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-ebf12988-4515-44da-b564-7c4b90f2e786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:18.263045 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 839/1678] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:14:17 2021] DELETE /identity/v3/users/4415187cb3684c578b5702d9d6bb6ce7 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:14:18.268052 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544913b-e3c9-48e7-8fa7-5d80c88c8a52 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:18.268052 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-1544913b-e3c9-48e7-8fa7-5d80c88c8a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:18.350455 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544913b-e3c9-48e7-8fa7-5d80c88c8a52 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:18.359983 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f60738-24c4-4467-bb1c-86ebea702ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:18.368278 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 840/1679] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:18 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:18.368591 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f60738-24c4-4467-bb1c-86ebea702ace admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:18.368591 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f60738-24c4-4467-bb1c-86ebea702ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:18.368591 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f60738-24c4-4467-bb1c-86ebea702ace admin admin] PATH_INFO: `/v3/projects/bda0b53fb44048c3bdaeeffad1494b52/users/a86286d23a36496099a183773919f079/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:18.368862 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb055191-3aa3-40ca-a26e-60fe4bc0e5fd None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:18.368862 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb055191-3aa3-40ca-a26e-60fe4bc0e5fd None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:18.368862 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb055191-3aa3-40ca-a26e-60fe4bc0e5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:18.369139 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f60738-24c4-4467-bb1c-86ebea702ace admin admin] RBAC: Authorizing `identity:create_grant(project_id=bda0b53fb44048c3bdaeeffad1494b52, user_id=a86286d23a36496099a183773919f079, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:18.370882 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f60738-24c4-4467-bb1c-86ebea702ace admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:18.386988 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-eb055191-3aa3-40ca-a26e-60fe4bc0e5fd None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:18.389455 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-eb055191-3aa3-40ca-a26e-60fe4bc0e5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:18.390647 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 840/1680] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:18 2021] PUT /identity/v3/projects/bda0b53fb44048c3bdaeeffad1494b52/users/a86286d23a36496099a183773919f079/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:18.392162 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430ec57-a9cd-41e5-87fc-a38f5f8f6c4d None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:18.392615 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430ec57-a9cd-41e5-87fc-a38f5f8f6c4d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:18.393091 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430ec57-a9cd-41e5-87fc-a38f5f8f6c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:18.413450 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-8430ec57-a9cd-41e5-87fc-a38f5f8f6c4d None None] MFA Rules not processed for user `9c04ecf61bb2468a99223a57cb41fd18`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:18.416073 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-8430ec57-a9cd-41e5-87fc-a38f5f8f6c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:18.486735 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 841/1681] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:18 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:18.497921 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430ec57-a9cd-41e5-87fc-a38f5f8f6c4d None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:18.499704 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-8430ec57-a9cd-41e5-87fc-a38f5f8f6c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:18.599968 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430ec57-a9cd-41e5-87fc-a38f5f8f6c4d None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:18.605720 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca022e-832f-4675-bf8b-b97f99140c3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:18.607343 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca022e-832f-4675-bf8b-b97f99140c3c service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:18.607632 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca022e-832f-4675-bf8b-b97f99140c3c service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:18.607927 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca022e-832f-4675-bf8b-b97f99140c3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:18.610048 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 841/1682] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:18.623385 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca022e-832f-4675-bf8b-b97f99140c3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:18.623385 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca022e-832f-4675-bf8b-b97f99140c3c service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:18.632539 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 842/1683] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:18 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:14:18.669893 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb055191-3aa3-40ca-a26e-60fe4bc0e5fd None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:18.671594 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-eb055191-3aa3-40ca-a26e-60fe4bc0e5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:18.754886 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb055191-3aa3-40ca-a26e-60fe4bc0e5fd None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:18.757837 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bb960-4d06-4a63-97fa-0dda22daeb24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:18.758485 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bb960-4d06-4a63-97fa-0dda22daeb24 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:18.758775 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bb960-4d06-4a63-97fa-0dda22daeb24 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:18.759053 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bb960-4d06-4a63-97fa-0dda22daeb24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:18.770032 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bb960-4d06-4a63-97fa-0dda22daeb24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:18.771740 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bb960-4d06-4a63-97fa-0dda22daeb24 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:18.784224 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 842/1684] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:19.433825 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083a755-f1b6-458f-878b-758c3a2b9b09 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:19.440399 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083a755-f1b6-458f-878b-758c3a2b9b09 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:19.440399 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083a755-f1b6-458f-878b-758c3a2b9b09 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:19.440399 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 843/1685] 10.222.0.54 () {54 vars in 912 bytes} [Tue Nov 23 04:14:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:14:19.443607 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3e9f0-d6f6-4698-a770-fad0e708fd4d None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:19.444793 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3e9f0-d6f6-4698-a770-fad0e708fd4d None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:19.445282 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3e9f0-d6f6-4698-a770-fad0e708fd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:19.470859 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-fce3e9f0-d6f6-4698-a770-fad0e708fd4d None None] MFA Rules not processed for user `5c06e29d656f48c99caeb193975b5b91`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:19.472325 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-fce3e9f0-d6f6-4698-a770-fad0e708fd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:19.502838 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 843/1686] 10.222.0.54 () {58 vars in 1009 bytes} [Tue Nov 23 04:14:19 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:19.608708 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083a755-f1b6-458f-878b-758c3a2b9b09 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:19.608708 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083a755-f1b6-458f-878b-758c3a2b9b09 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:19.608708 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f5d1e-ab0d-4205-bbb2-439395d1e64b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:19.608708 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f5d1e-ab0d-4205-bbb2-439395d1e64b service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:19.623005 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f5d1e-ab0d-4205-bbb2-439395d1e64b service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:19.623005 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f5d1e-ab0d-4205-bbb2-439395d1e64b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:19.623005 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f5d1e-ab0d-4205-bbb2-439395d1e64b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:19.623005 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f5d1e-ab0d-4205-bbb2-439395d1e64b service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:19.638084 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 844/1687] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:19 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:20.350395 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3e9f0-d6f6-4698-a770-fad0e708fd4d None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:20.353447 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-fce3e9f0-d6f6-4698-a770-fad0e708fd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:20.390693 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3e9f0-d6f6-4698-a770-fad0e708fd4d None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:20.398341 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ebd8f-6c53-4e61-97a1-384f5f67cc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:20.403487 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ebd8f-6c53-4e61-97a1-384f5f67cc01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:20.403487 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ebd8f-6c53-4e61-97a1-384f5f67cc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:20.403487 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ebd8f-6c53-4e61-97a1-384f5f67cc01 admin admin] PATH_INFO: `/v3/projects/19b745e2285646b395e26a0479a5d48b` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:20.403487 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ebd8f-6c53-4e61-97a1-384f5f67cc01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b745e2285646b395e26a0479a5d48b)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:20.403487 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: WARNING py.warnings [None req-b19ebd8f-6c53-4e61-97a1-384f5f67cc01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:14:20.403487 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: warnings.warn(msg) Nov 23 04:14:20.403487 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: Nov 23 04:14:20.405583 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ebd8f-6c53-4e61-97a1-384f5f67cc01 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:20.633819 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-b19ebd8f-6c53-4e61-97a1-384f5f67cc01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b745e2285646b395e26a0479a5d48b', 'request_id': 'req-b19ebd8f-6c53-4e61-97a1-384f5f67cc01'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:20.654136 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-b19ebd8f-6c53-4e61-97a1-384f5f67cc01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b745e2285646b395e26a0479a5d48b', 'request_id': 'req-b19ebd8f-6c53-4e61-97a1-384f5f67cc01'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:20.662425 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-b19ebd8f-6c53-4e61-97a1-384f5f67cc01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b745e2285646b395e26a0479a5d48b', 'request_id': 'req-b19ebd8f-6c53-4e61-97a1-384f5f67cc01'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:20.756640 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-b19ebd8f-6c53-4e61-97a1-384f5f67cc01 admin admin] The token cache is being invalidate because project 19b745e2285646b395e26a0479a5d48b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:14:20.757289 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-b19ebd8f-6c53-4e61-97a1-384f5f67cc01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:20.759593 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-b19ebd8f-6c53-4e61-97a1-384f5f67cc01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:20.762789 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 844/1688] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:14:20 2021] DELETE /identity/v3/projects/19b745e2285646b395e26a0479a5d48b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:20.769213 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3185c4-2373-4838-97c2-8caeb9e4a980 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:20.770189 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3185c4-2373-4838-97c2-8caeb9e4a980 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:20.770578 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3185c4-2373-4838-97c2-8caeb9e4a980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:20.804258 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-aa3185c4-2373-4838-97c2-8caeb9e4a980 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:20.805752 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-aa3185c4-2373-4838-97c2-8caeb9e4a980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:20.957271 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 845/1689] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:20.967040 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82575c31-d31b-406f-9411-f8cf2be86f7b None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:20.967853 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82575c31-d31b-406f-9411-f8cf2be86f7b None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:20.968347 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82575c31-d31b-406f-9411-f8cf2be86f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:21.008765 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-82575c31-d31b-406f-9411-f8cf2be86f7b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:21.011563 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-82575c31-d31b-406f-9411-f8cf2be86f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:21.036215 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 845/1690] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:21.040253 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3185c4-2373-4838-97c2-8caeb9e4a980 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:21.053525 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3185c4-2373-4838-97c2-8caeb9e4a980 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:21.085079 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c1721-f4c8-4227-a69e-e24173b5803b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:21.092090 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c1721-f4c8-4227-a69e-e24173b5803b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:21.093654 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c1721-f4c8-4227-a69e-e24173b5803b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:21.094306 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c1721-f4c8-4227-a69e-e24173b5803b admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:21.097649 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c1721-f4c8-4227-a69e-e24173b5803b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:14:21.100578 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c1721-f4c8-4227-a69e-e24173b5803b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:21.107463 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c1721-f4c8-4227-a69e-e24173b5803b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:21.157525 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 846/1691] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:14:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:14:21.157844 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82575c31-d31b-406f-9411-f8cf2be86f7b None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:21.169315 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82575c31-d31b-406f-9411-f8cf2be86f7b None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:21.187994 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd9dcf-55a9-484c-9acc-8802bc351796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:21.190391 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd9dcf-55a9-484c-9acc-8802bc351796 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:21.190880 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd9dcf-55a9-484c-9acc-8802bc351796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:21.191331 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd9dcf-55a9-484c-9acc-8802bc351796 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:21.192228 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd9dcf-55a9-484c-9acc-8802bc351796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:21.195614 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd9dcf-55a9-484c-9acc-8802bc351796 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:21.282740 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c1721-f4c8-4227-a69e-e24173b5803b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:21.284634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-587c1721-f4c8-4227-a69e-e24173b5803b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:21.306807 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c1721-f4c8-4227-a69e-e24173b5803b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:21.327145 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f52e1-ab6d-4392-8251-b9386ebcfaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:21.343791 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f52e1-ab6d-4392-8251-b9386ebcfaa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:21.344595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f52e1-ab6d-4392-8251-b9386ebcfaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:21.344595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f52e1-ab6d-4392-8251-b9386ebcfaa6 admin admin] PATH_INFO: `/v3/users/81c37feecf7e4e8b9d2d1db0998f4f2a` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:21.352422 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f52e1-ab6d-4392-8251-b9386ebcfaa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81c37feecf7e4e8b9d2d1db0998f4f2a)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:21.354372 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f52e1-ab6d-4392-8251-b9386ebcfaa6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:21.362093 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 846/1692] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:21 2021] POST /identity/v3/projects => generated 357 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:21.363268 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd9dcf-55a9-484c-9acc-8802bc351796 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:21.531724 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd9dcf-55a9-484c-9acc-8802bc351796 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:21.537952 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496bdfa-eb4c-488d-a96a-05f9a99aa2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:21.538887 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496bdfa-eb4c-488d-a96a-05f9a99aa2ce admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:21.539406 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496bdfa-eb4c-488d-a96a-05f9a99aa2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:21.539854 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496bdfa-eb4c-488d-a96a-05f9a99aa2ce admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:21.549910 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496bdfa-eb4c-488d-a96a-05f9a99aa2ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:21.552145 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496bdfa-eb4c-488d-a96a-05f9a99aa2ce admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:21.695558 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 847/1693] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:21 2021] POST /identity/v3/users => generated 279 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:21.704497 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496bdfa-eb4c-488d-a96a-05f9a99aa2ce admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:21.727058 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496bdfa-eb4c-488d-a96a-05f9a99aa2ce admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:21.761585 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c98f52e1-ab6d-4392-8251-b9386ebcfaa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81c37feecf7e4e8b9d2d1db0998f4f2a'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:21.767586 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d08c4b-38de-4894-bb37-0e806762cc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:21.767586 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d08c4b-38de-4894-bb37-0e806762cc31 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:21.767586 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d08c4b-38de-4894-bb37-0e806762cc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:21.767586 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d08c4b-38de-4894-bb37-0e806762cc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:21.767973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d08c4b-38de-4894-bb37-0e806762cc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:21.780399 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d08c4b-38de-4894-bb37-0e806762cc31 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:21.820990 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 848/1694] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:21 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:14:21.824090 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d08c4b-38de-4894-bb37-0e806762cc31 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:21.849581 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d08c4b-38de-4894-bb37-0e806762cc31 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:21.860479 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6c1d8-3a42-4538-9062-1942d8410d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:21.862432 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6c1d8-3a42-4538-9062-1942d8410d70 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:21.862886 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6c1d8-3a42-4538-9062-1942d8410d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:21.863242 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c98f52e1-ab6d-4392-8251-b9386ebcfaa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81c37feecf7e4e8b9d2d1db0998f4f2a'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:21.863767 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6c1d8-3a42-4538-9062-1942d8410d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:21.864159 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6c1d8-3a42-4538-9062-1942d8410d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:21.870161 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6c1d8-3a42-4538-9062-1942d8410d70 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:21.878176 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c98f52e1-ab6d-4392-8251-b9386ebcfaa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81c37feecf7e4e8b9d2d1db0998f4f2a'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:21.878941 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c98f52e1-ab6d-4392-8251-b9386ebcfaa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81c37feecf7e4e8b9d2d1db0998f4f2a'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:21.909651 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c98f52e1-ab6d-4392-8251-b9386ebcfaa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81c37feecf7e4e8b9d2d1db0998f4f2a'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:21.928415 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 847/1695] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:14:21 2021] DELETE /identity/v3/users/81c37feecf7e4e8b9d2d1db0998f4f2a => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:21.930872 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac2cd0-e707-438d-b6bb-8f5fa22d9f6e None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:21.931391 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac2cd0-e707-438d-b6bb-8f5fa22d9f6e None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:21.931554 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 849/1696] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:21 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:21.931686 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac2cd0-e707-438d-b6bb-8f5fa22d9f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:21.932746 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6c1d8-3a42-4538-9062-1942d8410d70 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:21.937395 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-63e6c1d8-3a42-4538-9062-1942d8410d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:21.971771 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-f2ac2cd0-e707-438d-b6bb-8f5fa22d9f6e None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:21.975398 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-f2ac2cd0-e707-438d-b6bb-8f5fa22d9f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:21.978609 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6c1d8-3a42-4538-9062-1942d8410d70 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:22.102272 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 848/1697] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:14:22.105529 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaf4b0-2c5f-41f7-9731-b3502cf226cb None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:22.108509 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaf4b0-2c5f-41f7-9731-b3502cf226cb None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:22.108509 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaf4b0-2c5f-41f7-9731-b3502cf226cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:22.110120 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb7c85-5ee9-4021-aea5-448bd50ed35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:22.111623 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb7c85-5ee9-4021-aea5-448bd50ed35b admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:22.112436 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb7c85-5ee9-4021-aea5-448bd50ed35b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:22.112723 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb7c85-5ee9-4021-aea5-448bd50ed35b admin admin] PATH_INFO: `/v3/projects/97f06799b3a44c2a926bec02e238dd3b/users/b999989d76854d3d89ae0bb94046d38a/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:22.142440 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb7c85-5ee9-4021-aea5-448bd50ed35b admin admin] RBAC: Authorizing `identity:create_grant(project_id=97f06799b3a44c2a926bec02e238dd3b, user_id=b999989d76854d3d89ae0bb94046d38a, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:22.145115 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb7c85-5ee9-4021-aea5-448bd50ed35b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:22.170261 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-10eaf4b0-2c5f-41f7-9731-b3502cf226cb None None] MFA Rules not processed for user `a86286d23a36496099a183773919f079`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:22.172234 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-10eaf4b0-2c5f-41f7-9731-b3502cf226cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:22.243289 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 850/1698] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:21 2021] PUT /identity/v3/projects/97f06799b3a44c2a926bec02e238dd3b/users/b999989d76854d3d89ae0bb94046d38a/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:22.243289 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb7c85-5ee9-4021-aea5-448bd50ed35b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:22.256525 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-defb7c85-5ee9-4021-aea5-448bd50ed35b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:22.367623 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 849/1699] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:22 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:22.367623 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee92c1-c82d-41c0-8356-3cc8207eb489 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:22.367623 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee92c1-c82d-41c0-8356-3cc8207eb489 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:22.367623 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee92c1-c82d-41c0-8356-3cc8207eb489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:22.406883 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb7c85-5ee9-4021-aea5-448bd50ed35b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:22.430271 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48a4a5-3998-40e5-8129-4c9016f04a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:22.430271 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48a4a5-3998-40e5-8129-4c9016f04a6e service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:22.430271 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48a4a5-3998-40e5-8129-4c9016f04a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:22.430271 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48a4a5-3998-40e5-8129-4c9016f04a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:22.455149 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-d7ee92c1-c82d-41c0-8356-3cc8207eb489 None None] MFA Rules not processed for user `b999989d76854d3d89ae0bb94046d38a`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:22.456618 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-d7ee92c1-c82d-41c0-8356-3cc8207eb489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:22.784379 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48a4a5-3998-40e5-8129-4c9016f04a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:22.784379 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48a4a5-3998-40e5-8129-4c9016f04a6e service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:22.784379 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 851/1700] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:22.786106 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 850/1701] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:22 2021] POST /identity/v3/auth/tokens => generated 3224 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:22.786473 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48a4a5-3998-40e5-8129-4c9016f04a6e service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:22.786473 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48a4a5-3998-40e5-8129-4c9016f04a6e service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:22.786473 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ddb65-e2b9-487c-9c65-c32e910508cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:22.786473 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ddb65-e2b9-487c-9c65-c32e910508cb admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:22.786900 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ddb65-e2b9-487c-9c65-c32e910508cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:22.786900 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ddb65-e2b9-487c-9c65-c32e910508cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:22.786900 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ddb65-e2b9-487c-9c65-c32e910508cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:22.786900 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ddb65-e2b9-487c-9c65-c32e910508cb admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:22.890693 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 852/1702] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:22 2021] POST /identity/v3/projects => generated 357 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:22.894667 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee92c1-c82d-41c0-8356-3cc8207eb489 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:22.908594 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee92c1-c82d-41c0-8356-3cc8207eb489 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:23.110492 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09fe55-2ed7-4cb5-8519-3677cc403370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:23.110492 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09fe55-2ed7-4cb5-8519-3677cc403370 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:23.110492 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09fe55-2ed7-4cb5-8519-3677cc403370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:23.110492 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09fe55-2ed7-4cb5-8519-3677cc403370 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:23.111048 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09fe55-2ed7-4cb5-8519-3677cc403370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:23.111048 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09fe55-2ed7-4cb5-8519-3677cc403370 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:23.304992 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 851/1703] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:22 2021] POST /identity/v3/users => generated 285 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:14:23.308709 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ddb65-e2b9-487c-9c65-c32e910508cb admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:23.335919 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ddb65-e2b9-487c-9c65-c32e910508cb admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:23.355589 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf3d1b-ba04-49fe-83c5-e27e451f5ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:23.357989 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf3d1b-ba04-49fe-83c5-e27e451f5ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:23.358391 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf3d1b-ba04-49fe-83c5-e27e451f5ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:23.358794 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf3d1b-ba04-49fe-83c5-e27e451f5ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:23.359714 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf3d1b-ba04-49fe-83c5-e27e451f5ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:23.369162 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf3d1b-ba04-49fe-83c5-e27e451f5ea7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:23.385669 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 853/1704] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:23 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:23.389641 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09fe55-2ed7-4cb5-8519-3677cc403370 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:23.407549 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09fe55-2ed7-4cb5-8519-3677cc403370 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:23.421371 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a1bc9-1bc1-4ff9-a569-56f817d580b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:23.424379 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a1bc9-1bc1-4ff9-a569-56f817d580b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:23.424675 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a1bc9-1bc1-4ff9-a569-56f817d580b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:23.424987 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a1bc9-1bc1-4ff9-a569-56f817d580b3 admin admin] PATH_INFO: `/v3/projects/28f49a7fd77b43dbb2980ab9d4114306/users/11a2fd5de80c42c783d9172aff43c3da/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:23.502369 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a1bc9-1bc1-4ff9-a569-56f817d580b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28f49a7fd77b43dbb2980ab9d4114306, user_id=11a2fd5de80c42c783d9172aff43c3da, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:23.514440 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a1bc9-1bc1-4ff9-a569-56f817d580b3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:23.546653 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf3d1b-ba04-49fe-83c5-e27e451f5ea7 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:23.549262 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-f5bf3d1b-ba04-49fe-83c5-e27e451f5ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:23.580349 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf3d1b-ba04-49fe-83c5-e27e451f5ea7 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:23.592722 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49c56e-f75a-4631-8526-d3d86ff76076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:23.594133 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49c56e-f75a-4631-8526-d3d86ff76076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:23.596251 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49c56e-f75a-4631-8526-d3d86ff76076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:23.596730 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49c56e-f75a-4631-8526-d3d86ff76076 admin admin] PATH_INFO: `/v3/projects/7c7f4b2ad4b446c1b655678ebee9c509` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:23.600671 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49c56e-f75a-4631-8526-d3d86ff76076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c7f4b2ad4b446c1b655678ebee9c509)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:23.602141 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 852/1705] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:23 2021] PUT /identity/v3/projects/28f49a7fd77b43dbb2980ab9d4114306/users/11a2fd5de80c42c783d9172aff43c3da/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:23.607442 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49c56e-f75a-4631-8526-d3d86ff76076 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:23.608638 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a1bc9-1bc1-4ff9-a569-56f817d580b3 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:23.748921 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a1bc9-1bc1-4ff9-a569-56f817d580b3 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:23.777809 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2b49c56e-f75a-4631-8526-d3d86ff76076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c7f4b2ad4b446c1b655678ebee9c509', 'request_id': 'req-2b49c56e-f75a-4631-8526-d3d86ff76076'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:23.812747 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2b49c56e-f75a-4631-8526-d3d86ff76076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c7f4b2ad4b446c1b655678ebee9c509', 'request_id': 'req-2b49c56e-f75a-4631-8526-d3d86ff76076'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:23.823628 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2b49c56e-f75a-4631-8526-d3d86ff76076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c7f4b2ad4b446c1b655678ebee9c509', 'request_id': 'req-2b49c56e-f75a-4631-8526-d3d86ff76076'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:23.845433 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1bd0b-94ca-4e58-82eb-c5c2f7359057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:23.846121 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1bd0b-94ca-4e58-82eb-c5c2f7359057 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:23.846406 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1bd0b-94ca-4e58-82eb-c5c2f7359057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:23.846688 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1bd0b-94ca-4e58-82eb-c5c2f7359057 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:23.847532 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1bd0b-94ca-4e58-82eb-c5c2f7359057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:23.849282 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1bd0b-94ca-4e58-82eb-c5c2f7359057 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:23.869087 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 853/1706] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:23 2021] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:14:23.870113 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1bd0b-94ca-4e58-82eb-c5c2f7359057 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:23.881717 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1bd0b-94ca-4e58-82eb-c5c2f7359057 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:23.886819 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5474fc6-09b9-454d-9b67-69e1adf36bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:23.888977 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5474fc6-09b9-454d-9b67-69e1adf36bee admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:23.888977 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5474fc6-09b9-454d-9b67-69e1adf36bee admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:23.888977 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5474fc6-09b9-454d-9b67-69e1adf36bee admin admin] PATH_INFO: `/v3/projects/28f49a7fd77b43dbb2980ab9d4114306/users/11a2fd5de80c42c783d9172aff43c3da/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:23.891290 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5474fc6-09b9-454d-9b67-69e1adf36bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=28f49a7fd77b43dbb2980ab9d4114306, user_id=11a2fd5de80c42c783d9172aff43c3da, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:23.894276 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5474fc6-09b9-454d-9b67-69e1adf36bee admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:23.917187 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 854/1707] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:23 2021] PUT /identity/v3/projects/28f49a7fd77b43dbb2980ab9d4114306/users/11a2fd5de80c42c783d9172aff43c3da/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:23.917985 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2b49c56e-f75a-4631-8526-d3d86ff76076 admin admin] The token cache is being invalidate because project 7c7f4b2ad4b446c1b655678ebee9c509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:14:23.918825 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2b49c56e-f75a-4631-8526-d3d86ff76076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:23.920217 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2b49c56e-f75a-4631-8526-d3d86ff76076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:23.920658 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937de52-d0ad-4f66-823c-fafc0aa0626d None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:23.921101 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937de52-d0ad-4f66-823c-fafc0aa0626d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:23.921512 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937de52-d0ad-4f66-823c-fafc0aa0626d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:23.921904 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 854/1708] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:14:23 2021] DELETE /identity/v3/projects/7c7f4b2ad4b446c1b655678ebee9c509 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:14:23.935202 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7bd05-b4fd-4c3b-ba1c-ecf7f4eae943 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:23.935748 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7bd05-b4fd-4c3b-ba1c-ecf7f4eae943 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:23.936195 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7bd05-b4fd-4c3b-ba1c-ecf7f4eae943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:23.958663 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-9937de52-d0ad-4f66-823c-fafc0aa0626d None None] MFA Rules not processed for user `11a2fd5de80c42c783d9172aff43c3da`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:23.960015 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-9937de52-d0ad-4f66-823c-fafc0aa0626d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:23.970622 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-e4e7bd05-b4fd-4c3b-ba1c-ecf7f4eae943 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:23.972125 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-e4e7bd05-b4fd-4c3b-ba1c-ecf7f4eae943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:24.056356 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 855/1709] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:23 2021] POST /identity/v3/auth/tokens => generated 3291 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:24.057282 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937de52-d0ad-4f66-823c-fafc0aa0626d None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:24.058837 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-9937de52-d0ad-4f66-823c-fafc0aa0626d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:24.123322 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937de52-d0ad-4f66-823c-fafc0aa0626d None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:24.129744 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 855/1710] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:24.131453 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44604f-d81b-4ea9-bbd9-54615046a365 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:24.132349 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44604f-d81b-4ea9-bbd9-54615046a365 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:24.132723 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44604f-d81b-4ea9-bbd9-54615046a365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:24.134793 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7175f-296a-46bd-8410-5319d26104fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:24.135674 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7175f-296a-46bd-8410-5319d26104fa service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:24.136112 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7175f-296a-46bd-8410-5319d26104fa service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:24.136617 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7175f-296a-46bd-8410-5319d26104fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:24.147639 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7175f-296a-46bd-8410-5319d26104fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:24.149308 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7175f-296a-46bd-8410-5319d26104fa service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:24.175676 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 856/1711] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:24 2021] GET /identity/v3/auth/tokens => generated 3291 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:24.197124 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-7b44604f-d81b-4ea9-bbd9-54615046a365 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:24.199965 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-7b44604f-d81b-4ea9-bbd9-54615046a365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:24.220846 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 856/1712] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:24.221999 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7175f-296a-46bd-8410-5319d26104fa service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:24.234433 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7175f-296a-46bd-8410-5319d26104fa service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:24.239598 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae364848-d189-4420-955d-35ada3609666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:24.240415 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae364848-d189-4420-955d-35ada3609666 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:24.240771 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae364848-d189-4420-955d-35ada3609666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:24.241204 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae364848-d189-4420-955d-35ada3609666 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:24.242021 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae364848-d189-4420-955d-35ada3609666 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:14:24.242335 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae364848-d189-4420-955d-35ada3609666 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:24.244128 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae364848-d189-4420-955d-35ada3609666 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:24.262933 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 857/1713] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:14:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:14:24.264255 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44604f-d81b-4ea9-bbd9-54615046a365 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:24.277497 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44604f-d81b-4ea9-bbd9-54615046a365 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:24.292762 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b65be-8274-4615-a04c-1177477a89a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:24.309660 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b65be-8274-4615-a04c-1177477a89a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:24.309660 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b65be-8274-4615-a04c-1177477a89a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:24.309660 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b65be-8274-4615-a04c-1177477a89a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:24.309660 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b65be-8274-4615-a04c-1177477a89a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:24.312915 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b65be-8274-4615-a04c-1177477a89a6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:24.439576 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae364848-d189-4420-955d-35ada3609666 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:24.451721 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae364848-d189-4420-955d-35ada3609666 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:24.456044 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc41a77-ea7d-4f4d-b856-da58bd5c730e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:24.456706 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc41a77-ea7d-4f4d-b856-da58bd5c730e service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:24.456992 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc41a77-ea7d-4f4d-b856-da58bd5c730e service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:24.457271 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc41a77-ea7d-4f4d-b856-da58bd5c730e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:24.459241 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-0dc41a77-ea7d-4f4d-b856-da58bd5c730e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:24.466256 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 857/1714] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:24 2021] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:24.469938 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b65be-8274-4615-a04c-1177477a89a6 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:24.596283 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b65be-8274-4615-a04c-1177477a89a6 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:24.612109 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51caa92d-c2ac-41cb-8eb6-e6d5f2940da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:24.613044 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51caa92d-c2ac-41cb-8eb6-e6d5f2940da7 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:24.613469 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51caa92d-c2ac-41cb-8eb6-e6d5f2940da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:24.613943 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51caa92d-c2ac-41cb-8eb6-e6d5f2940da7 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:24.614809 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51caa92d-c2ac-41cb-8eb6-e6d5f2940da7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:24.618394 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc41a77-ea7d-4f4d-b856-da58bd5c730e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:24.618815 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51caa92d-c2ac-41cb-8eb6-e6d5f2940da7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:24.619753 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc41a77-ea7d-4f4d-b856-da58bd5c730e service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:24.653732 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 858/1715] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:24 2021] GET /identity/v3/auth/tokens => generated 3224 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:24.738711 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 858/1716] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:24 2021] POST /identity/v3/users => generated 290 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:24.742603 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc41a77-ea7d-4f4d-b856-da58bd5c730e service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:24.756262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc41a77-ea7d-4f4d-b856-da58bd5c730e service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:24.762483 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d405d-508b-444b-921d-736ca6ae6c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:24.763453 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d405d-508b-444b-921d-736ca6ae6c5c admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:24.763453 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d405d-508b-444b-921d-736ca6ae6c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:24.765515 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d405d-508b-444b-921d-736ca6ae6c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:24.765515 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d405d-508b-444b-921d-736ca6ae6c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:24.767941 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d405d-508b-444b-921d-736ca6ae6c5c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:24.782223 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 859/1717] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:24 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:14:24.784172 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51caa92d-c2ac-41cb-8eb6-e6d5f2940da7 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:24.798591 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51caa92d-c2ac-41cb-8eb6-e6d5f2940da7 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:24.804532 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae4150-8d3b-4de4-95b8-072500194422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:24.806053 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae4150-8d3b-4de4-95b8-072500194422 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:24.806882 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae4150-8d3b-4de4-95b8-072500194422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:24.807161 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae4150-8d3b-4de4-95b8-072500194422 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:24.807933 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae4150-8d3b-4de4-95b8-072500194422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:24.810110 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae4150-8d3b-4de4-95b8-072500194422 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:24.822483 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 859/1718] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:24 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:24.828401 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d405d-508b-444b-921d-736ca6ae6c5c admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:24.844174 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d405d-508b-444b-921d-736ca6ae6c5c admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:24.851447 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2db970-9bbe-4dd2-bcf9-f5459f75a3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:24.852545 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db970-9bbe-4dd2-bcf9-f5459f75a3e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:24.852724 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db970-9bbe-4dd2-bcf9-f5459f75a3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:24.853009 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db970-9bbe-4dd2-bcf9-f5459f75a3e6 admin admin] PATH_INFO: `/v3/projects/03cd3c8951924869a8e23fe9a5d39b41/users/4819638d6f674e0082d1ee5efef332e6/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:24.870200 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2db970-9bbe-4dd2-bcf9-f5459f75a3e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03cd3c8951924869a8e23fe9a5d39b41, user_id=4819638d6f674e0082d1ee5efef332e6, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:24.874099 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2db970-9bbe-4dd2-bcf9-f5459f75a3e6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:24.947315 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 860/1719] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:24 2021] PUT /identity/v3/projects/03cd3c8951924869a8e23fe9a5d39b41/users/4819638d6f674e0082d1ee5efef332e6/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:24.998996 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e496f7-6780-4597-a09b-63f83d145050 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:25.001830 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e496f7-6780-4597-a09b-63f83d145050 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:25.001830 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e496f7-6780-4597-a09b-63f83d145050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:25.051680 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df418689-39c9-498b-a9c2-f951f205d887 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:25.053270 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df418689-39c9-498b-a9c2-f951f205d887 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:25.054365 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df418689-39c9-498b-a9c2-f951f205d887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:25.101675 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-f8e496f7-6780-4597-a09b-63f83d145050 None None] MFA Rules not processed for user `4819638d6f674e0082d1ee5efef332e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:25.102836 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-f8e496f7-6780-4597-a09b-63f83d145050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:25.142322 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-df418689-39c9-498b-a9c2-f951f205d887 None None] MFA Rules not processed for user `1009c9c7798f48f6ad891766711d0c0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:25.143982 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-df418689-39c9-498b-a9c2-f951f205d887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:25.288422 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 860/1720] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:24 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:25.293823 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e496f7-6780-4597-a09b-63f83d145050 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:25.316988 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 861/1721] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:25 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:14:25.352753 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df418689-39c9-498b-a9c2-f951f205d887 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:25.355254 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-df418689-39c9-498b-a9c2-f951f205d887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:25.488505 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e496f7-6780-4597-a09b-63f83d145050 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:25.497177 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ace5f-1a6d-49cc-90d0-77d9c501add1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:25.498391 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ace5f-1a6d-49cc-90d0-77d9c501add1 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:25.498862 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ace5f-1a6d-49cc-90d0-77d9c501add1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:25.499372 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ace5f-1a6d-49cc-90d0-77d9c501add1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:25.501105 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ace5f-1a6d-49cc-90d0-77d9c501add1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:25.502231 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df418689-39c9-498b-a9c2-f951f205d887 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:25.503769 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ace5f-1a6d-49cc-90d0-77d9c501add1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:25.527336 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dcac1-b76f-4ca4-aea8-91606a53af41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:25.528426 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dcac1-b76f-4ca4-aea8-91606a53af41 service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:25.528715 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dcac1-b76f-4ca4-aea8-91606a53af41 service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:25.529138 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dcac1-b76f-4ca4-aea8-91606a53af41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:25.551862 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695dcac1-b76f-4ca4-aea8-91606a53af41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:25.554556 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695dcac1-b76f-4ca4-aea8-91606a53af41 service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:25.602923 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 862/1722] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:25 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:14:25.690646 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 861/1723] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:25 2021] POST /identity/v3/projects => generated 379 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:25.694776 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dcac1-b76f-4ca4-aea8-91606a53af41 service nova] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:25.710349 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dcac1-b76f-4ca4-aea8-91606a53af41 service nova] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:25.889413 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4f2b9-5f42-44dc-b82f-71e6fabe5ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:25.890460 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4f2b9-5f42-44dc-b82f-71e6fabe5ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:25.891105 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4f2b9-5f42-44dc-b82f-71e6fabe5ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:25.891564 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4f2b9-5f42-44dc-b82f-71e6fabe5ed7 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:25.892490 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4f2b9-5f42-44dc-b82f-71e6fabe5ed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:25.894576 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4f2b9-5f42-44dc-b82f-71e6fabe5ed7 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:26.042658 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 863/1724] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:25 2021] POST /identity/v3/users => generated 296 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:26.046532 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ace5f-1a6d-49cc-90d0-77d9c501add1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:26.063645 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ace5f-1a6d-49cc-90d0-77d9c501add1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:26.076449 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d9107-3db3-4a00-8b6a-abd73b34df76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:26.080249 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d9107-3db3-4a00-8b6a-abd73b34df76 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:26.080566 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d9107-3db3-4a00-8b6a-abd73b34df76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:26.081237 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d9107-3db3-4a00-8b6a-abd73b34df76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:26.082610 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d9107-3db3-4a00-8b6a-abd73b34df76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:26.088440 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d9107-3db3-4a00-8b6a-abd73b34df76 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:26.117300 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 862/1725] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:26 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:26.118625 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4f2b9-5f42-44dc-b82f-71e6fabe5ed7 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:26.134780 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4f2b9-5f42-44dc-b82f-71e6fabe5ed7 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:26.156228 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbc34b-4827-41ec-87ef-5e2f63519e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:26.158603 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbc34b-4827-41ec-87ef-5e2f63519e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:26.160247 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbc34b-4827-41ec-87ef-5e2f63519e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:26.161318 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbc34b-4827-41ec-87ef-5e2f63519e3d admin admin] PATH_INFO: `/v3/projects/32d042f2f0324f20a1e6235d14920d0e/users/91b95c08f4f04e4a8d9b68471ddc3bce/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:26.197521 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bbc34b-4827-41ec-87ef-5e2f63519e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d042f2f0324f20a1e6235d14920d0e, user_id=91b95c08f4f04e4a8d9b68471ddc3bce, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:26.206283 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bbc34b-4827-41ec-87ef-5e2f63519e3d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:26.306215 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 864/1726] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:26 2021] PUT /identity/v3/projects/32d042f2f0324f20a1e6235d14920d0e/users/91b95c08f4f04e4a8d9b68471ddc3bce/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:26.311503 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d9107-3db3-4a00-8b6a-abd73b34df76 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:26.339574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d9107-3db3-4a00-8b6a-abd73b34df76 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:26.567186 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfeeda-17c4-4cf1-8de2-e2492573ef89 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:26.567732 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfeeda-17c4-4cf1-8de2-e2492573ef89 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:26.568141 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfeeda-17c4-4cf1-8de2-e2492573ef89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:26.604332 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-0edfeeda-17c4-4cf1-8de2-e2492573ef89 None None] MFA Rules not processed for user `b68d0745d9cb49a5bd9331148967764a`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:26.608542 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-0edfeeda-17c4-4cf1-8de2-e2492573ef89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:26.614453 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46390186-e94b-4713-9176-f9fd56b76da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:26.616244 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46390186-e94b-4713-9176-f9fd56b76da4 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:26.621202 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46390186-e94b-4713-9176-f9fd56b76da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:26.621842 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46390186-e94b-4713-9176-f9fd56b76da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:26.624500 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46390186-e94b-4713-9176-f9fd56b76da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:26.629542 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46390186-e94b-4713-9176-f9fd56b76da4 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:26.654084 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 863/1727] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:26 2021] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:26.655619 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46390186-e94b-4713-9176-f9fd56b76da4 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:26.715020 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46390186-e94b-4713-9176-f9fd56b76da4 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:26.722991 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5fe76b-c623-4d68-a50f-19deb2cfacb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:26.726958 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fe76b-c623-4d68-a50f-19deb2cfacb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:26.726958 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fe76b-c623-4d68-a50f-19deb2cfacb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:26.726958 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fe76b-c623-4d68-a50f-19deb2cfacb7 admin admin] PATH_INFO: `/v3/projects/32d042f2f0324f20a1e6235d14920d0e/users/91b95c08f4f04e4a8d9b68471ddc3bce/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:26.729087 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5fe76b-c623-4d68-a50f-19deb2cfacb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d042f2f0324f20a1e6235d14920d0e, user_id=91b95c08f4f04e4a8d9b68471ddc3bce, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:26.736149 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5fe76b-c623-4d68-a50f-19deb2cfacb7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:26.757261 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 864/1728] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:26 2021] PUT /identity/v3/projects/32d042f2f0324f20a1e6235d14920d0e/users/91b95c08f4f04e4a8d9b68471ddc3bce/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:26.783660 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725193e6-86df-4a94-a197-373fb3d82fc5 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:26.786704 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725193e6-86df-4a94-a197-373fb3d82fc5 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:26.788309 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725193e6-86df-4a94-a197-373fb3d82fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:26.820527 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 865/1729] 10.222.0.54 () {58 vars in 1009 bytes} [Tue Nov 23 04:14:26 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:14:26.870584 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-725193e6-86df-4a94-a197-373fb3d82fc5 None None] MFA Rules not processed for user `91b95c08f4f04e4a8d9b68471ddc3bce`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:26.871536 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-725193e6-86df-4a94-a197-373fb3d82fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:27.027540 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfeeda-17c4-4cf1-8de2-e2492573ef89 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:27.029215 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-0edfeeda-17c4-4cf1-8de2-e2492573ef89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:27.054501 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfeeda-17c4-4cf1-8de2-e2492573ef89 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:27.072791 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 865/1730] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:26 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:27.093054 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725193e6-86df-4a94-a197-373fb3d82fc5 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:27.230428 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa8c07-f7f9-4016-8c11-dc7e686ff877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:27.231915 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa8c07-f7f9-4016-8c11-dc7e686ff877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:27.232345 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa8c07-f7f9-4016-8c11-dc7e686ff877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:27.232759 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa8c07-f7f9-4016-8c11-dc7e686ff877 admin admin] PATH_INFO: `/v3/users/1b376902b54d46b2a8d16f3f789aa171` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:27.234616 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa8c07-f7f9-4016-8c11-dc7e686ff877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b376902b54d46b2a8d16f3f789aa171)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:27.253061 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa8c07-f7f9-4016-8c11-dc7e686ff877 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:27.261287 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725193e6-86df-4a94-a197-373fb3d82fc5 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:27.275958 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4565f5a-9692-43c6-b1a4-d0688ef4148a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:27.276949 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4565f5a-9692-43c6-b1a4-d0688ef4148a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:27.281685 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4565f5a-9692-43c6-b1a4-d0688ef4148a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:27.281685 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4565f5a-9692-43c6-b1a4-d0688ef4148a admin admin] PATH_INFO: `/v3/users/4819638d6f674e0082d1ee5efef332e6` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:27.291339 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4565f5a-9692-43c6-b1a4-d0688ef4148a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4819638d6f674e0082d1ee5efef332e6)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:27.301984 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4565f5a-9692-43c6-b1a4-d0688ef4148a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:27.589228 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ddfa8c07-f7f9-4016-8c11-dc7e686ff877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b376902b54d46b2a8d16f3f789aa171'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:27.629978 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f4565f5a-9692-43c6-b1a4-d0688ef4148a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4819638d6f674e0082d1ee5efef332e6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:27.691676 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ddfa8c07-f7f9-4016-8c11-dc7e686ff877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b376902b54d46b2a8d16f3f789aa171'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:27.706258 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ddfa8c07-f7f9-4016-8c11-dc7e686ff877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b376902b54d46b2a8d16f3f789aa171'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:27.707227 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ddfa8c07-f7f9-4016-8c11-dc7e686ff877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b376902b54d46b2a8d16f3f789aa171'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:27.734300 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ddfa8c07-f7f9-4016-8c11-dc7e686ff877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b376902b54d46b2a8d16f3f789aa171'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:27.761328 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 866/1731] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:14:27 2021] DELETE /identity/v3/users/1b376902b54d46b2a8d16f3f789aa171 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:14:27.766691 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa8c07-f7f9-4016-8c11-dc7e686ff877 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:27.771734 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-ddfa8c07-f7f9-4016-8c11-dc7e686ff877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:27.823473 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f4565f5a-9692-43c6-b1a4-d0688ef4148a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4819638d6f674e0082d1ee5efef332e6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:27.826621 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f4565f5a-9692-43c6-b1a4-d0688ef4148a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4819638d6f674e0082d1ee5efef332e6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:27.828878 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f4565f5a-9692-43c6-b1a4-d0688ef4148a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4819638d6f674e0082d1ee5efef332e6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:27.881528 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f4565f5a-9692-43c6-b1a4-d0688ef4148a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4819638d6f674e0082d1ee5efef332e6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:27.898655 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 866/1732] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:14:27 2021] DELETE /identity/v3/users/4819638d6f674e0082d1ee5efef332e6 => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:27.904556 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa8c07-f7f9-4016-8c11-dc7e686ff877 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:27.906846 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea71b0-9e64-4479-a74e-f7105ebd2ae2 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:27.907348 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea71b0-9e64-4479-a74e-f7105ebd2ae2 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:27.909163 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea71b0-9e64-4479-a74e-f7105ebd2ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:27.951909 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-28ea71b0-9e64-4479-a74e-f7105ebd2ae2 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:27.955646 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-28ea71b0-9e64-4479-a74e-f7105ebd2ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:28.071157 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e28c9-7f52-4197-8b5a-07f3c2be422c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd439c1f0764f4cac7eb641a485937a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:28.071854 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e28c9-7f52-4197-8b5a-07f3c2be422c service swift] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:28.072293 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e28c9-7f52-4197-8b5a-07f3c2be422c service swift] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:28.072717 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e28c9-7f52-4197-8b5a-07f3c2be422c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:28.079825 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-4b3e28c9-7f52-4197-8b5a-07f3c2be422c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:28.117642 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 867/1733] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:28.162214 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea71b0-9e64-4479-a74e-f7105ebd2ae2 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:28.163642 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-28ea71b0-9e64-4479-a74e-f7105ebd2ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:28.172789 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e28c9-7f52-4197-8b5a-07f3c2be422c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:28.174385 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e28c9-7f52-4197-8b5a-07f3c2be422c service swift] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:28.200176 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 867/1734] 10.222.0.54 () {60 vars in 1384 bytes} [Tue Nov 23 04:14:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 04:14:28.350408 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea71b0-9e64-4479-a74e-f7105ebd2ae2 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:28.369601 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d37660-4870-4dd7-ad93-2e2edc2cc9ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:28.370400 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d37660-4870-4dd7-ad93-2e2edc2cc9ca service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:28.370691 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d37660-4870-4dd7-ad93-2e2edc2cc9ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:28.370973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d37660-4870-4dd7-ad93-2e2edc2cc9ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:28.419516 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d37660-4870-4dd7-ad93-2e2edc2cc9ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:28.419516 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d37660-4870-4dd7-ad93-2e2edc2cc9ca service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:28.473443 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 868/1735] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:29.699029 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e28c9-7f52-4197-8b5a-07f3c2be422c service swift] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:29.701512 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-4b3e28c9-7f52-4197-8b5a-07f3c2be422c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:29.733510 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e28c9-7f52-4197-8b5a-07f3c2be422c service swift] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:29.770022 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367aa79b-bebf-4903-a7a7-58ea6acb00f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:29.771311 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367aa79b-bebf-4903-a7a7-58ea6acb00f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:29.782391 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367aa79b-bebf-4903-a7a7-58ea6acb00f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:29.783043 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367aa79b-bebf-4903-a7a7-58ea6acb00f8 admin admin] PATH_INFO: `/v3/projects/32028919ab4740118fb1de464a23602b` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:29.784857 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367aa79b-bebf-4903-a7a7-58ea6acb00f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32028919ab4740118fb1de464a23602b)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:29.787052 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367aa79b-bebf-4903-a7a7-58ea6acb00f8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:30.261427 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-367aa79b-bebf-4903-a7a7-58ea6acb00f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32028919ab4740118fb1de464a23602b', 'request_id': 'req-367aa79b-bebf-4903-a7a7-58ea6acb00f8'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:30.298947 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b66795-d1b0-406f-be1e-0653a59d2435 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:30.299681 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-367aa79b-bebf-4903-a7a7-58ea6acb00f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32028919ab4740118fb1de464a23602b', 'request_id': 'req-367aa79b-bebf-4903-a7a7-58ea6acb00f8'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:30.300242 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b66795-d1b0-406f-be1e-0653a59d2435 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:30.300766 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b66795-d1b0-406f-be1e-0653a59d2435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:30.329730 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-367aa79b-bebf-4903-a7a7-58ea6acb00f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32028919ab4740118fb1de464a23602b', 'request_id': 'req-367aa79b-bebf-4903-a7a7-58ea6acb00f8'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:30.348216 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-c7b66795-d1b0-406f-be1e-0653a59d2435 None None] MFA Rules not processed for user `5c06e29d656f48c99caeb193975b5b91`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:30.350742 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c7b66795-d1b0-406f-be1e-0653a59d2435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:30.499858 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 869/1736] 10.222.0.50 () {58 vars in 1015 bytes} [Tue Nov 23 04:14:30 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:30.510435 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-367aa79b-bebf-4903-a7a7-58ea6acb00f8 admin admin] The token cache is being invalidate because project 32028919ab4740118fb1de464a23602b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:14:30.510980 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-367aa79b-bebf-4903-a7a7-58ea6acb00f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:30.513613 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-367aa79b-bebf-4903-a7a7-58ea6acb00f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:30.516780 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 868/1737] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:14:29 2021] DELETE /identity/v3/projects/32028919ab4740118fb1de464a23602b => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:30.520923 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b66795-d1b0-406f-be1e-0653a59d2435 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:30.649759 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367aa79b-bebf-4903-a7a7-58ea6acb00f8 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:30.654699 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-367aa79b-bebf-4903-a7a7-58ea6acb00f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:30.656684 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b66795-d1b0-406f-be1e-0653a59d2435 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:30.673125 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0b45b-6c54-45be-9b84-5f59038d94e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:30.674168 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0b45b-6c54-45be-9b84-5f59038d94e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:30.674503 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0b45b-6c54-45be-9b84-5f59038d94e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:30.674830 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0b45b-6c54-45be-9b84-5f59038d94e8 admin admin] PATH_INFO: `/v3/users/a86286d23a36496099a183773919f079` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:30.679886 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0b45b-6c54-45be-9b84-5f59038d94e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a86286d23a36496099a183773919f079)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:30.682088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0b45b-6c54-45be-9b84-5f59038d94e8 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:30.694337 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367aa79b-bebf-4903-a7a7-58ea6acb00f8 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:30.707139 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d5fb8-7861-46ca-a81d-ddb4fbcd9fa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:30.708438 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d5fb8-7861-46ca-a81d-ddb4fbcd9fa4 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:30.708438 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d5fb8-7861-46ca-a81d-ddb4fbcd9fa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:30.708606 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d5fb8-7861-46ca-a81d-ddb4fbcd9fa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:30.714772 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-ea4d5fb8-7861-46ca-a81d-ddb4fbcd9fa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:30.759304 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d5fb8-7861-46ca-a81d-ddb4fbcd9fa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:30.765363 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d5fb8-7861-46ca-a81d-ddb4fbcd9fa4 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:30.792200 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 869/1738] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:30 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:30.967632 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-41f0b45b-6c54-45be-9b84-5f59038d94e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a86286d23a36496099a183773919f079'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:31.047020 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-41f0b45b-6c54-45be-9b84-5f59038d94e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a86286d23a36496099a183773919f079'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:31.070874 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-41f0b45b-6c54-45be-9b84-5f59038d94e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a86286d23a36496099a183773919f079'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:31.071759 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-41f0b45b-6c54-45be-9b84-5f59038d94e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a86286d23a36496099a183773919f079'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:31.109818 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-41f0b45b-6c54-45be-9b84-5f59038d94e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a86286d23a36496099a183773919f079'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:31.125766 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 870/1739] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:14:30 2021] DELETE /identity/v3/users/a86286d23a36496099a183773919f079 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:31.342353 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d5fb8-7861-46ca-a81d-ddb4fbcd9fa4 service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:31.346254 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-ea4d5fb8-7861-46ca-a81d-ddb4fbcd9fa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:31.370896 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d5fb8-7861-46ca-a81d-ddb4fbcd9fa4 service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:31.556569 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e269e0-ee9c-4508-b734-0dbabe16a9aa None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:31.557110 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e269e0-ee9c-4508-b734-0dbabe16a9aa None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:31.557317 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e269e0-ee9c-4508-b734-0dbabe16a9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:31.608994 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fbeb4-4107-4f77-93c7-f5a49d95b5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:31.610245 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fbeb4-4107-4f77-93c7-f5a49d95b5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:31.610722 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fbeb4-4107-4f77-93c7-f5a49d95b5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:31.611164 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fbeb4-4107-4f77-93c7-f5a49d95b5bb admin admin] PATH_INFO: `/v3/projects/03cd3c8951924869a8e23fe9a5d39b41` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:31.613810 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845fbeb4-4107-4f77-93c7-f5a49d95b5bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=03cd3c8951924869a8e23fe9a5d39b41)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:31.617487 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845fbeb4-4107-4f77-93c7-f5a49d95b5bb admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:31.639034 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-40e269e0-ee9c-4508-b734-0dbabe16a9aa None None] MFA Rules not processed for user `9477961ce0bc4164be46f0a54a309d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:31.642408 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-40e269e0-ee9c-4508-b734-0dbabe16a9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:31.806389 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 871/1740] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:31 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:31.810744 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ca77f-7e4a-469b-928d-a5b680f16e5c None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:31.815979 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ca77f-7e4a-469b-928d-a5b680f16e5c None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:31.815979 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ca77f-7e4a-469b-928d-a5b680f16e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:31.834840 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-2e3ca77f-7e4a-469b-928d-a5b680f16e5c None None] MFA Rules not processed for user `9477961ce0bc4164be46f0a54a309d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:31.844428 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-2e3ca77f-7e4a-469b-928d-a5b680f16e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:31.862169 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 872/1741] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:31 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:14:31.867087 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-845fbeb4-4107-4f77-93c7-f5a49d95b5bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03cd3c8951924869a8e23fe9a5d39b41', 'request_id': 'req-845fbeb4-4107-4f77-93c7-f5a49d95b5bb'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:31.876244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-845fbeb4-4107-4f77-93c7-f5a49d95b5bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03cd3c8951924869a8e23fe9a5d39b41', 'request_id': 'req-845fbeb4-4107-4f77-93c7-f5a49d95b5bb'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:31.879955 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ca77f-7e4a-469b-928d-a5b680f16e5c None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:31.881856 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-2e3ca77f-7e4a-469b-928d-a5b680f16e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:31.904065 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-845fbeb4-4107-4f77-93c7-f5a49d95b5bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03cd3c8951924869a8e23fe9a5d39b41', 'request_id': 'req-845fbeb4-4107-4f77-93c7-f5a49d95b5bb'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:32.090571 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ca77f-7e4a-469b-928d-a5b680f16e5c None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:32.113834 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-845fbeb4-4107-4f77-93c7-f5a49d95b5bb admin admin] The token cache is being invalidate because project 03cd3c8951924869a8e23fe9a5d39b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:14:32.117232 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-845fbeb4-4107-4f77-93c7-f5a49d95b5bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:32.117232 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-845fbeb4-4107-4f77-93c7-f5a49d95b5bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:32.117232 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 870/1742] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:14:31 2021] DELETE /identity/v3/projects/03cd3c8951924869a8e23fe9a5d39b41 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:32.121070 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fbeb4-4107-4f77-93c7-f5a49d95b5bb admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:32.127234 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-845fbeb4-4107-4f77-93c7-f5a49d95b5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:32.243376 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc8eca-631e-4b20-99e8-47fa9f619277 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:32.244146 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc8eca-631e-4b20-99e8-47fa9f619277 service nova] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:32.244531 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc8eca-631e-4b20-99e8-47fa9f619277 service nova] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:32.244903 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc8eca-631e-4b20-99e8-47fa9f619277 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:32.247063 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-afbc8eca-631e-4b20-99e8-47fa9f619277 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:32.306702 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fbeb4-4107-4f77-93c7-f5a49d95b5bb admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:32.392579 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24c6cb-ab81-4265-9749-b62b755a6617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:32.392579 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24c6cb-ab81-4265-9749-b62b755a6617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:32.392579 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24c6cb-ab81-4265-9749-b62b755a6617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:32.392579 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24c6cb-ab81-4265-9749-b62b755a6617 admin admin] PATH_INFO: `/v3/users/91b95c08f4f04e4a8d9b68471ddc3bce` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:32.392853 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24c6cb-ab81-4265-9749-b62b755a6617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91b95c08f4f04e4a8d9b68471ddc3bce)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:32.392853 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24c6cb-ab81-4265-9749-b62b755a6617 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:32.392984 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc8eca-631e-4b20-99e8-47fa9f619277 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:32.392984 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc8eca-631e-4b20-99e8-47fa9f619277 service nova] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:32.392984 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 873/1743] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:31 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:32.657493 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc8eca-631e-4b20-99e8-47fa9f619277 service nova] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:32.659388 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-afbc8eca-631e-4b20-99e8-47fa9f619277 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:32.684859 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc8eca-631e-4b20-99e8-47fa9f619277 service nova] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:32.697892 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77871dd-94cc-4572-8f91-70c32731a874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:32.699159 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77871dd-94cc-4572-8f91-70c32731a874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:32.701892 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77871dd-94cc-4572-8f91-70c32731a874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:32.702387 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77871dd-94cc-4572-8f91-70c32731a874 admin admin] PATH_INFO: `/v3/projects/bda0b53fb44048c3bdaeeffad1494b52` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:32.705878 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77871dd-94cc-4572-8f91-70c32731a874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bda0b53fb44048c3bdaeeffad1494b52)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:32.713117 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77871dd-94cc-4572-8f91-70c32731a874 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:32.814655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-7f24c6cb-ab81-4265-9749-b62b755a6617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91b95c08f4f04e4a8d9b68471ddc3bce'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:32.879292 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f77871dd-94cc-4572-8f91-70c32731a874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bda0b53fb44048c3bdaeeffad1494b52', 'request_id': 'req-f77871dd-94cc-4572-8f91-70c32731a874'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:32.913974 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f77871dd-94cc-4572-8f91-70c32731a874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bda0b53fb44048c3bdaeeffad1494b52', 'request_id': 'req-f77871dd-94cc-4572-8f91-70c32731a874'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:32.920083 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f77871dd-94cc-4572-8f91-70c32731a874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bda0b53fb44048c3bdaeeffad1494b52', 'request_id': 'req-f77871dd-94cc-4572-8f91-70c32731a874'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:32.942841 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-7f24c6cb-ab81-4265-9749-b62b755a6617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91b95c08f4f04e4a8d9b68471ddc3bce'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:32.954713 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-7f24c6cb-ab81-4265-9749-b62b755a6617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91b95c08f4f04e4a8d9b68471ddc3bce'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:32.960506 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-7f24c6cb-ab81-4265-9749-b62b755a6617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91b95c08f4f04e4a8d9b68471ddc3bce'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:32.989232 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-7f24c6cb-ab81-4265-9749-b62b755a6617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91b95c08f4f04e4a8d9b68471ddc3bce'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:33.020355 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 871/1744] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:14:32 2021] DELETE /identity/v3/users/91b95c08f4f04e4a8d9b68471ddc3bce => generated 0 bytes in 896 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:33.046850 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f77871dd-94cc-4572-8f91-70c32731a874 admin admin] The token cache is being invalidate because project bda0b53fb44048c3bdaeeffad1494b52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:14:33.047945 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f77871dd-94cc-4572-8f91-70c32731a874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:33.050143 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f77871dd-94cc-4572-8f91-70c32731a874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:33.064027 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299c532-414b-4a54-bdf4-04993d4ce41d None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:33.068596 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299c532-414b-4a54-bdf4-04993d4ce41d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:33.068596 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299c532-414b-4a54-bdf4-04993d4ce41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:33.068782 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 874/1745] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:14:32 2021] DELETE /identity/v3/projects/bda0b53fb44048c3bdaeeffad1494b52 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:33.106959 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-5299c532-414b-4a54-bdf4-04993d4ce41d None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:33.109017 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-5299c532-414b-4a54-bdf4-04993d4ce41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:33.276093 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 872/1746] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:33.347386 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459a9b3-c1d0-4e56-8a67-089f4c0cf4c9 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:33.348483 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459a9b3-c1d0-4e56-8a67-089f4c0cf4c9 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:33.348984 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459a9b3-c1d0-4e56-8a67-089f4c0cf4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:33.390251 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-2459a9b3-c1d0-4e56-8a67-089f4c0cf4c9 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:33.397436 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-2459a9b3-c1d0-4e56-8a67-089f4c0cf4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:33.431539 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 875/1747] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:33.433784 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299c532-414b-4a54-bdf4-04993d4ce41d None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:33.446056 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299c532-414b-4a54-bdf4-04993d4ce41d None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:33.452296 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d5529-2ead-4b3b-a000-7b9e72447cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:33.453383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d5529-2ead-4b3b-a000-7b9e72447cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:33.454172 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d5529-2ead-4b3b-a000-7b9e72447cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:33.454682 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d5529-2ead-4b3b-a000-7b9e72447cc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:33.455905 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d5529-2ead-4b3b-a000-7b9e72447cc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:14:33.456402 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d5529-2ead-4b3b-a000-7b9e72447cc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:33.458940 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d5529-2ead-4b3b-a000-7b9e72447cc5 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:33.501534 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 873/1748] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:14:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:14:33.501857 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459a9b3-c1d0-4e56-8a67-089f4c0cf4c9 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:33.514910 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459a9b3-c1d0-4e56-8a67-089f4c0cf4c9 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:33.529832 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde86eba-4a5b-42fb-9050-328c3c39faf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:33.530612 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde86eba-4a5b-42fb-9050-328c3c39faf6 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:33.530989 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde86eba-4a5b-42fb-9050-328c3c39faf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:33.532477 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde86eba-4a5b-42fb-9050-328c3c39faf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:33.533223 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde86eba-4a5b-42fb-9050-328c3c39faf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:33.535153 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde86eba-4a5b-42fb-9050-328c3c39faf6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:33.708388 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 876/1749] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:33 2021] POST /identity/v3/projects => generated 365 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:33.713256 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d5529-2ead-4b3b-a000-7b9e72447cc5 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:33.739032 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d5529-2ead-4b3b-a000-7b9e72447cc5 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:33.852137 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241e6d4-504d-42b6-bac7-966ba221a4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:33.852137 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241e6d4-504d-42b6-bac7-966ba221a4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:33.852137 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241e6d4-504d-42b6-bac7-966ba221a4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:33.852137 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241e6d4-504d-42b6-bac7-966ba221a4c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:33.852494 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241e6d4-504d-42b6-bac7-966ba221a4c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:33.854638 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241e6d4-504d-42b6-bac7-966ba221a4c5 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:34.026540 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 874/1750] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:33 2021] POST /identity/v3/users => generated 283 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:34.031913 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde86eba-4a5b-42fb-9050-328c3c39faf6 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:34.047717 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde86eba-4a5b-42fb-9050-328c3c39faf6 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:34.065956 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c98e47-fd1f-4adb-9a2b-7f1752ba945b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:34.066980 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c98e47-fd1f-4adb-9a2b-7f1752ba945b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:34.067378 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c98e47-fd1f-4adb-9a2b-7f1752ba945b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:34.067662 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c98e47-fd1f-4adb-9a2b-7f1752ba945b admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:34.068522 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c98e47-fd1f-4adb-9a2b-7f1752ba945b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:34.070401 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c98e47-fd1f-4adb-9a2b-7f1752ba945b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:34.094956 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 877/1751] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:34 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:34.098923 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241e6d4-504d-42b6-bac7-966ba221a4c5 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:34.142749 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241e6d4-504d-42b6-bac7-966ba221a4c5 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:34.163751 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15104b-cff8-4985-b3d8-e344134f29c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:34.164639 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15104b-cff8-4985-b3d8-e344134f29c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:34.164825 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15104b-cff8-4985-b3d8-e344134f29c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:34.169951 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15104b-cff8-4985-b3d8-e344134f29c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:34.170686 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15104b-cff8-4985-b3d8-e344134f29c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:34.180486 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15104b-cff8-4985-b3d8-e344134f29c8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:34.308667 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 875/1752] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:34 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:34.310100 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c98e47-fd1f-4adb-9a2b-7f1752ba945b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:34.310100 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c98e47-fd1f-4adb-9a2b-7f1752ba945b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:34.310100 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a82c26-ad95-48e5-8a01-f58dcba23167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:34.310100 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a82c26-ad95-48e5-8a01-f58dcba23167 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:34.310631 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a82c26-ad95-48e5-8a01-f58dcba23167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:34.310631 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a82c26-ad95-48e5-8a01-f58dcba23167 admin admin] PATH_INFO: `/v3/projects/5fa9a525ea374057b6866f32dc67bfe2/users/6fb73b9cd74545349c8db8dd3258789f/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:34.311547 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a717500-2073-4ef1-a790-83910fc52020 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:34.311547 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a717500-2073-4ef1-a790-83910fc52020 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:34.311547 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a717500-2073-4ef1-a790-83910fc52020 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:34.311547 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 876/1753] 10.222.0.54 () {54 vars in 921 bytes} [Tue Nov 23 04:14:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:14:34.311547 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a09aa-bbef-4e80-ba85-e6a8904dedb6 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:34.311547 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a09aa-bbef-4e80-ba85-e6a8904dedb6 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:34.311966 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a09aa-bbef-4e80-ba85-e6a8904dedb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:34.328296 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a82c26-ad95-48e5-8a01-f58dcba23167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa9a525ea374057b6866f32dc67bfe2, user_id=6fb73b9cd74545349c8db8dd3258789f, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:34.332130 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a82c26-ad95-48e5-8a01-f58dcba23167 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:34.345752 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-421a09aa-bbef-4e80-ba85-e6a8904dedb6 None None] MFA Rules not processed for user `35e14131fb22470cba63cd5e8db359e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:34.354347 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-421a09aa-bbef-4e80-ba85-e6a8904dedb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:34.533304 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 877/1754] 10.222.0.54 () {58 vars in 1018 bytes} [Tue Nov 23 04:14:34 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:34.534790 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa90e1c-1a76-426f-a944-3610bd8081cc None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:34.535293 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa90e1c-1a76-426f-a944-3610bd8081cc None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:34.535617 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa90e1c-1a76-426f-a944-3610bd8081cc None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:34.537696 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 878/1755] 10.222.0.54 () {54 vars in 921 bytes} [Tue Nov 23 04:14:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:14:34.544029 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7d449-350f-4749-bc40-b0f80678c67a None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:34.544331 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7d449-350f-4749-bc40-b0f80678c67a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:34.544661 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7d449-350f-4749-bc40-b0f80678c67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:34.587313 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-e0a7d449-350f-4749-bc40-b0f80678c67a None None] MFA Rules not processed for user `35e14131fb22470cba63cd5e8db359e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:34.587313 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e0a7d449-350f-4749-bc40-b0f80678c67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:34.593055 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 879/1756] 10.222.0.54 () {58 vars in 1018 bytes} [Tue Nov 23 04:14:34 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:34.594622 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7d449-350f-4749-bc40-b0f80678c67a None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:34.596799 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e0a7d449-350f-4749-bc40-b0f80678c67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:34.615311 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7d449-350f-4749-bc40-b0f80678c67a None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:34.623198 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bd2a6-b495-4bd2-b8f0-3f7239dbe84e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:34.623894 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bd2a6-b495-4bd2-b8f0-3f7239dbe84e service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:34.624187 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bd2a6-b495-4bd2-b8f0-3f7239dbe84e service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:34.624465 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bd2a6-b495-4bd2-b8f0-3f7239dbe84e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:34.636466 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bd2a6-b495-4bd2-b8f0-3f7239dbe84e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:34.639445 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bd2a6-b495-4bd2-b8f0-3f7239dbe84e service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:34.654036 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 880/1757] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:34 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:34.784757 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bd2a6-b495-4bd2-b8f0-3f7239dbe84e service nova] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:34.796313 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bd2a6-b495-4bd2-b8f0-3f7239dbe84e service nova] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:34.803120 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bd550-be22-4331-8b40-dee0a761216f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:34.804241 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bd550-be22-4331-8b40-dee0a761216f service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:34.804778 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bd550-be22-4331-8b40-dee0a761216f service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:34.805343 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bd550-be22-4331-8b40-dee0a761216f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:34.821124 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bd550-be22-4331-8b40-dee0a761216f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:34.839322 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 878/1758] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:34 2021] PUT /identity/v3/projects/5fa9a525ea374057b6866f32dc67bfe2/users/6fb73b9cd74545349c8db8dd3258789f/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:34.839698 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bd550-be22-4331-8b40-dee0a761216f service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:34.842361 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe1a6c-d3d7-4aaf-afaf-e9b31e1ed92c None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:34.842687 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe1a6c-d3d7-4aaf-afaf-e9b31e1ed92c None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:34.843006 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe1a6c-d3d7-4aaf-afaf-e9b31e1ed92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:34.862179 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 881/1759] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:34 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:14:34.921653 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-37fe1a6c-d3d7-4aaf-afaf-e9b31e1ed92c None None] MFA Rules not processed for user `6fb73b9cd74545349c8db8dd3258789f`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:34.925460 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-37fe1a6c-d3d7-4aaf-afaf-e9b31e1ed92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:35.177013 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 879/1760] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:34 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:35.186562 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bd550-be22-4331-8b40-dee0a761216f service nova] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:35.186562 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-0a4bd550-be22-4331-8b40-dee0a761216f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:35.203998 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe1a6c-d3d7-4aaf-afaf-e9b31e1ed92c None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:35.273546 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bd550-be22-4331-8b40-dee0a761216f service nova] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:35.447887 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be6abf-cc31-4b5b-8c99-4775586d5087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:35.449251 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be6abf-cc31-4b5b-8c99-4775586d5087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:35.450273 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be6abf-cc31-4b5b-8c99-4775586d5087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:35.450273 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be6abf-cc31-4b5b-8c99-4775586d5087 admin admin] PATH_INFO: `/v3/projects/32d042f2f0324f20a1e6235d14920d0e` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:35.453936 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be6abf-cc31-4b5b-8c99-4775586d5087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32d042f2f0324f20a1e6235d14920d0e)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:35.457267 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be6abf-cc31-4b5b-8c99-4775586d5087 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:35.512197 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe1a6c-d3d7-4aaf-afaf-e9b31e1ed92c None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:35.523122 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08494c0-e962-4456-b14d-7801d4250e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:35.525343 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08494c0-e962-4456-b14d-7801d4250e6d admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:35.525343 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08494c0-e962-4456-b14d-7801d4250e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:35.525343 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08494c0-e962-4456-b14d-7801d4250e6d admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:35.527293 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08494c0-e962-4456-b14d-7801d4250e6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:35.533093 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08494c0-e962-4456-b14d-7801d4250e6d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:35.655753 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a3be6abf-cc31-4b5b-8c99-4775586d5087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32d042f2f0324f20a1e6235d14920d0e', 'request_id': 'req-a3be6abf-cc31-4b5b-8c99-4775586d5087'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:35.659196 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 880/1761] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:35 2021] POST /identity/v3/projects => generated 363 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:35.661443 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba357ff-d3a3-4fed-96e0-995fd52f47f2 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:35.663468 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba357ff-d3a3-4fed-96e0-995fd52f47f2 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:35.663757 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba357ff-d3a3-4fed-96e0-995fd52f47f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:35.691768 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a3be6abf-cc31-4b5b-8c99-4775586d5087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32d042f2f0324f20a1e6235d14920d0e', 'request_id': 'req-a3be6abf-cc31-4b5b-8c99-4775586d5087'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:35.724316 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a3be6abf-cc31-4b5b-8c99-4775586d5087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32d042f2f0324f20a1e6235d14920d0e', 'request_id': 'req-a3be6abf-cc31-4b5b-8c99-4775586d5087'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:35.735652 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-4ba357ff-d3a3-4fed-96e0-995fd52f47f2 None None] MFA Rules not processed for user `9477961ce0bc4164be46f0a54a309d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:35.748738 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-4ba357ff-d3a3-4fed-96e0-995fd52f47f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:35.952453 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 881/1762] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:35 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:35.958946 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba357ff-d3a3-4fed-96e0-995fd52f47f2 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:36.051095 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a3be6abf-cc31-4b5b-8c99-4775586d5087 admin admin] The token cache is being invalidate because project 32d042f2f0324f20a1e6235d14920d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:14:36.054214 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a3be6abf-cc31-4b5b-8c99-4775586d5087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:36.054214 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a3be6abf-cc31-4b5b-8c99-4775586d5087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:36.054214 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 882/1763] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:14:35 2021] DELETE /identity/v3/projects/32d042f2f0324f20a1e6235d14920d0e => generated 0 bytes in 886 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:36.060423 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c02ef8-7025-43a5-aaeb-494b06fd16b6 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:36.060842 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c02ef8-7025-43a5-aaeb-494b06fd16b6 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:36.061151 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c02ef8-7025-43a5-aaeb-494b06fd16b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:36.139753 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-52c02ef8-7025-43a5-aaeb-494b06fd16b6 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:36.149319 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-52c02ef8-7025-43a5-aaeb-494b06fd16b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:36.153844 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba357ff-d3a3-4fed-96e0-995fd52f47f2 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:36.171376 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 883/1764] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:36.179075 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f00ac0-1251-437a-adab-b0d4d651087c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:36.180260 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47711db8-cd50-4162-8562-50f8de3a3e44 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:36.180875 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47711db8-cd50-4162-8562-50f8de3a3e44 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:36.182199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47711db8-cd50-4162-8562-50f8de3a3e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:36.182341 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f00ac0-1251-437a-adab-b0d4d651087c admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:36.184370 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f00ac0-1251-437a-adab-b0d4d651087c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:36.184891 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f00ac0-1251-437a-adab-b0d4d651087c admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:36.186335 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f00ac0-1251-437a-adab-b0d4d651087c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:36.193780 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f00ac0-1251-437a-adab-b0d4d651087c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:36.234866 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-47711db8-cd50-4162-8562-50f8de3a3e44 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:36.234866 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-47711db8-cd50-4162-8562-50f8de3a3e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:36.247070 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 884/1765] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:36.292935 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47711db8-cd50-4162-8562-50f8de3a3e44 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:36.321371 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47711db8-cd50-4162-8562-50f8de3a3e44 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:36.335465 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f44246-8a54-420b-943d-d5531b0affb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:36.336417 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f44246-8a54-420b-943d-d5531b0affb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:36.337395 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f44246-8a54-420b-943d-d5531b0affb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:36.338014 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f44246-8a54-420b-943d-d5531b0affb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:36.338930 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f44246-8a54-420b-943d-d5531b0affb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:14:36.339408 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f44246-8a54-420b-943d-d5531b0affb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:36.349978 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f44246-8a54-420b-943d-d5531b0affb3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:36.370649 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 885/1766] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:14:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:14:36.375754 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f44246-8a54-420b-943d-d5531b0affb3 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:36.395480 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f44246-8a54-420b-943d-d5531b0affb3 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:36.402075 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd725683-91d2-4150-abf4-fb62bed51111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:36.403174 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd725683-91d2-4150-abf4-fb62bed51111 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:36.403663 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd725683-91d2-4150-abf4-fb62bed51111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:36.404170 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd725683-91d2-4150-abf4-fb62bed51111 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:36.405049 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd725683-91d2-4150-abf4-fb62bed51111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:36.409063 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd725683-91d2-4150-abf4-fb62bed51111 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:36.508971 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 882/1767] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:35 2021] POST /identity/v3/users => generated 288 bytes in 548 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:36.510738 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f00ac0-1251-437a-adab-b0d4d651087c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:36.520097 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c7f00ac0-1251-437a-adab-b0d4d651087c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:36.580913 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 886/1768] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:36 2021] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:14:36.591280 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd725683-91d2-4150-abf4-fb62bed51111 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:36.607310 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f00ac0-1251-437a-adab-b0d4d651087c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:36.779821 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cdcff-1f7e-4131-b325-58f2aae57f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:36.781264 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cdcff-1f7e-4131-b325-58f2aae57f1f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:36.781547 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cdcff-1f7e-4131-b325-58f2aae57f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:36.781833 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cdcff-1f7e-4131-b325-58f2aae57f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:36.783484 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cdcff-1f7e-4131-b325-58f2aae57f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:36.786333 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cdcff-1f7e-4131-b325-58f2aae57f1f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:36.810585 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 883/1769] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:36 2021] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:36.811762 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cdcff-1f7e-4131-b325-58f2aae57f1f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:36.816557 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd725683-91d2-4150-abf4-fb62bed51111 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:36.826052 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cdcff-1f7e-4131-b325-58f2aae57f1f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:36.833765 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76485993-cc76-4185-924b-1a03f4590d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:36.834606 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff4b2b-d4a8-45e0-b24b-ecd970d829d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:36.835562 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76485993-cc76-4185-924b-1a03f4590d5a admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:36.837657 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76485993-cc76-4185-924b-1a03f4590d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:36.838043 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76485993-cc76-4185-924b-1a03f4590d5a admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:36.838389 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff4b2b-d4a8-45e0-b24b-ecd970d829d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:36.838976 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76485993-cc76-4185-924b-1a03f4590d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:36.839633 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff4b2b-d4a8-45e0-b24b-ecd970d829d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:36.840991 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff4b2b-d4a8-45e0-b24b-ecd970d829d2 admin admin] PATH_INFO: `/v3/projects/95e46494d991436496d84a868b727a15/users/1ae37c48749e475f97fd568a343211dc/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:36.844509 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76485993-cc76-4185-924b-1a03f4590d5a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:36.896870 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff4b2b-d4a8-45e0-b24b-ecd970d829d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e46494d991436496d84a868b727a15, user_id=1ae37c48749e475f97fd568a343211dc, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:36.903758 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff4b2b-d4a8-45e0-b24b-ecd970d829d2 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:36.999518 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 887/1770] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:36 2021] POST /identity/v3/users => generated 293 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:37.000464 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76485993-cc76-4185-924b-1a03f4590d5a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:37.039880 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76485993-cc76-4185-924b-1a03f4590d5a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:37.045062 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456c04f-8225-4f37-ba80-d567a73f53ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:37.045868 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456c04f-8225-4f37-ba80-d567a73f53ab admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:37.046250 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456c04f-8225-4f37-ba80-d567a73f53ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:37.046636 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456c04f-8225-4f37-ba80-d567a73f53ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:37.048206 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456c04f-8225-4f37-ba80-d567a73f53ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:37.050267 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456c04f-8225-4f37-ba80-d567a73f53ab admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:37.081661 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 888/1771] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:36 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:37.090932 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456c04f-8225-4f37-ba80-d567a73f53ab admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:37.126587 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 884/1772] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:36 2021] PUT /identity/v3/projects/95e46494d991436496d84a868b727a15/users/1ae37c48749e475f97fd568a343211dc/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:37.127489 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff4b2b-d4a8-45e0-b24b-ecd970d829d2 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:37.132562 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456c04f-8225-4f37-ba80-d567a73f53ab admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:37.279595 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff4b2b-d4a8-45e0-b24b-ecd970d829d2 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:37.288880 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527619b-eded-40fd-9b3f-5e29237ad7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:37.390437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527619b-eded-40fd-9b3f-5e29237ad7ba admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:37.390437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527619b-eded-40fd-9b3f-5e29237ad7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:37.390437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527619b-eded-40fd-9b3f-5e29237ad7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:37.390437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527619b-eded-40fd-9b3f-5e29237ad7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:37.390437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527619b-eded-40fd-9b3f-5e29237ad7ba admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:37.390437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 885/1773] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:37 2021] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:37.391399 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a270e26-b3d5-4d96-a3a8-963b82d0cb32 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:37.391399 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a270e26-b3d5-4d96-a3a8-963b82d0cb32 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:37.391399 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a270e26-b3d5-4d96-a3a8-963b82d0cb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:37.391595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d437b-79c4-40de-b258-2dee85f23c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:37.391595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d437b-79c4-40de-b258-2dee85f23c76 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:37.391595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d437b-79c4-40de-b258-2dee85f23c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:37.391595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d437b-79c4-40de-b258-2dee85f23c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:37.392227 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d437b-79c4-40de-b258-2dee85f23c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:37.392227 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d437b-79c4-40de-b258-2dee85f23c76 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:37.392374 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-8a270e26-b3d5-4d96-a3a8-963b82d0cb32 None None] MFA Rules not processed for user `1009c9c7798f48f6ad891766711d0c0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:37.392374 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-8a270e26-b3d5-4d96-a3a8-963b82d0cb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:37.392513 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 889/1774] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:37 2021] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:14:37.392513 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d437b-79c4-40de-b258-2dee85f23c76 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:37.412966 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d437b-79c4-40de-b258-2dee85f23c76 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:37.425689 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9d2ff-591f-48b9-8d3b-107944086739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:37.426831 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9d2ff-591f-48b9-8d3b-107944086739 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:37.427120 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9d2ff-591f-48b9-8d3b-107944086739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:37.427516 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9d2ff-591f-48b9-8d3b-107944086739 admin admin] PATH_INFO: `/v3/projects/95e46494d991436496d84a868b727a15/users/1ae37c48749e475f97fd568a343211dc/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:37.432599 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9d2ff-591f-48b9-8d3b-107944086739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e46494d991436496d84a868b727a15, user_id=1ae37c48749e475f97fd568a343211dc, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:37.436834 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9d2ff-591f-48b9-8d3b-107944086739 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:37.510301 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 886/1775] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:37 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:37.511277 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a270e26-b3d5-4d96-a3a8-963b82d0cb32 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:37.537055 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a270e26-b3d5-4d96-a3a8-963b82d0cb32 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:37.550806 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6540825-c1a1-4c5d-9e51-7a01d284df24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:37.550806 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6540825-c1a1-4c5d-9e51-7a01d284df24 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:37.550806 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6540825-c1a1-4c5d-9e51-7a01d284df24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:37.550806 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6540825-c1a1-4c5d-9e51-7a01d284df24 admin admin] PATH_INFO: `/v3/projects/4852746b9ca04bbe9aa7ff8ceb7fb9eb/users/8662c6c6f0c9426798398880de455395/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:37.582765 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 890/1776] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:37 2021] PUT /identity/v3/projects/95e46494d991436496d84a868b727a15/users/1ae37c48749e475f97fd568a343211dc/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:37.594062 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852c315-3838-45e2-966d-271eb893a843 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:37.594062 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852c315-3838-45e2-966d-271eb893a843 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:37.594339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852c315-3838-45e2-966d-271eb893a843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:37.595409 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6540825-c1a1-4c5d-9e51-7a01d284df24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4852746b9ca04bbe9aa7ff8ceb7fb9eb, user_id=8662c6c6f0c9426798398880de455395, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:37.598616 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6540825-c1a1-4c5d-9e51-7a01d284df24 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:37.644424 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-3852c315-3838-45e2-966d-271eb893a843 None None] MFA Rules not processed for user `1ae37c48749e475f97fd568a343211dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:37.645601 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-3852c315-3838-45e2-966d-271eb893a843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:37.807050 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 887/1777] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:37 2021] PUT /identity/v3/projects/4852746b9ca04bbe9aa7ff8ceb7fb9eb/users/8662c6c6f0c9426798398880de455395/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:37.824092 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730d5c3-f124-46ae-a9c0-d93fd7532dd5 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:37.824466 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 891/1778] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:37 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:14:37.824561 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730d5c3-f124-46ae-a9c0-d93fd7532dd5 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:37.824561 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730d5c3-f124-46ae-a9c0-d93fd7532dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:37.842957 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852c315-3838-45e2-966d-271eb893a843 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:37.844471 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-3852c315-3838-45e2-966d-271eb893a843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:37.870231 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-6730d5c3-f124-46ae-a9c0-d93fd7532dd5 None None] MFA Rules not processed for user `8662c6c6f0c9426798398880de455395`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:37.871663 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-6730d5c3-f124-46ae-a9c0-d93fd7532dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:37.975984 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852c315-3838-45e2-966d-271eb893a843 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:38.047361 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 888/1779] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:37 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:14:38.067768 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730d5c3-f124-46ae-a9c0-d93fd7532dd5 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:38.116061 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8ba8c-6fef-40a9-a17d-14764f2acf51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:38.116061 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8ba8c-6fef-40a9-a17d-14764f2acf51 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:38.116061 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8ba8c-6fef-40a9-a17d-14764f2acf51 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:38.116061 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8ba8c-6fef-40a9-a17d-14764f2acf51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:38.204189 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730d5c3-f124-46ae-a9c0-d93fd7532dd5 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:38.218462 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68eaf8-aec1-4936-8cd1-c5f86add828d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:38.219321 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68eaf8-aec1-4936-8cd1-c5f86add828d admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:38.219571 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68eaf8-aec1-4936-8cd1-c5f86add828d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:38.220497 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68eaf8-aec1-4936-8cd1-c5f86add828d admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:38.221332 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68eaf8-aec1-4936-8cd1-c5f86add828d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:38.228839 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68eaf8-aec1-4936-8cd1-c5f86add828d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:38.244448 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8ba8c-6fef-40a9-a17d-14764f2acf51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:38.249568 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8ba8c-6fef-40a9-a17d-14764f2acf51 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:38.266366 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 892/1780] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:37 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:14:38.778340 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 889/1781] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:38 2021] POST /identity/v3/projects => generated 385 bytes in 731 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:38.780596 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8ba8c-6fef-40a9-a17d-14764f2acf51 service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:38.802867 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8ba8c-6fef-40a9-a17d-14764f2acf51 service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:38.910910 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e372401-1ae4-47a4-9cca-4cc2490a5714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:38.913072 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e372401-1ae4-47a4-9cca-4cc2490a5714 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:38.913072 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e372401-1ae4-47a4-9cca-4cc2490a5714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:38.913072 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e372401-1ae4-47a4-9cca-4cc2490a5714 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:38.914059 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e372401-1ae4-47a4-9cca-4cc2490a5714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:38.919649 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e372401-1ae4-47a4-9cca-4cc2490a5714 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:39.049853 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 893/1782] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:38 2021] POST /identity/v3/users => generated 299 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:39.053538 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68eaf8-aec1-4936-8cd1-c5f86add828d admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:39.064113 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68eaf8-aec1-4936-8cd1-c5f86add828d admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:39.079607 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdb712-07c9-4914-ae0b-e0d07caab7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:39.080911 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdb712-07c9-4914-ae0b-e0d07caab7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:39.081548 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdb712-07c9-4914-ae0b-e0d07caab7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:39.082420 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdb712-07c9-4914-ae0b-e0d07caab7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:39.083826 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdb712-07c9-4914-ae0b-e0d07caab7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:39.085904 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdb712-07c9-4914-ae0b-e0d07caab7a8 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:39.119405 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 890/1783] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:39 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:39.129804 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e372401-1ae4-47a4-9cca-4cc2490a5714 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:39.146662 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e372401-1ae4-47a4-9cca-4cc2490a5714 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:39.161068 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e675637-92e7-4272-8d0f-0024a4849bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:39.161995 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e675637-92e7-4272-8d0f-0024a4849bc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:39.162300 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e675637-92e7-4272-8d0f-0024a4849bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:39.162591 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e675637-92e7-4272-8d0f-0024a4849bc2 admin admin] PATH_INFO: `/v3/projects/7fa5e7493427493f92b658221eb83d9e/users/a597581b55c845519c67d59a745a3f98/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:39.188601 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e675637-92e7-4272-8d0f-0024a4849bc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fa5e7493427493f92b658221eb83d9e, user_id=a597581b55c845519c67d59a745a3f98, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:39.190534 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e675637-92e7-4272-8d0f-0024a4849bc2 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:39.608948 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdb712-07c9-4914-ae0b-e0d07caab7a8 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:39.624853 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdb712-07c9-4914-ae0b-e0d07caab7a8 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:39.644037 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 894/1784] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:39 2021] PUT /identity/v3/projects/7fa5e7493427493f92b658221eb83d9e/users/a597581b55c845519c67d59a745a3f98/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:39.644037 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e675637-92e7-4272-8d0f-0024a4849bc2 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:39.725231 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e675637-92e7-4272-8d0f-0024a4849bc2 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:39.733477 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18505c3-d153-4144-b6ec-7e542852924a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:39.734154 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18505c3-d153-4144-b6ec-7e542852924a admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:39.734438 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18505c3-d153-4144-b6ec-7e542852924a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:39.734671 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c3f18-6634-4564-b210-64295e2db4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:39.734787 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18505c3-d153-4144-b6ec-7e542852924a admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:39.735557 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c3f18-6634-4564-b210-64295e2db4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:39.735801 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18505c3-d153-4144-b6ec-7e542852924a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:39.735890 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c3f18-6634-4564-b210-64295e2db4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:39.736112 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c3f18-6634-4564-b210-64295e2db4fa admin admin] PATH_INFO: `/v3/users/6fb73b9cd74545349c8db8dd3258789f` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:39.737303 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18505c3-d153-4144-b6ec-7e542852924a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:39.737415 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c3f18-6634-4564-b210-64295e2db4fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fb73b9cd74545349c8db8dd3258789f)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:39.739272 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c3f18-6634-4564-b210-64295e2db4fa admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:39.749681 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 895/1785] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:39 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:14:39.753691 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18505c3-d153-4144-b6ec-7e542852924a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:39.764353 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18505c3-d153-4144-b6ec-7e542852924a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:39.770081 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926359a-4e7f-4ae1-8d30-7932a39177b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:39.778199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926359a-4e7f-4ae1-8d30-7932a39177b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:39.778199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926359a-4e7f-4ae1-8d30-7932a39177b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:39.778199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926359a-4e7f-4ae1-8d30-7932a39177b9 admin admin] PATH_INFO: `/v3/projects/7fa5e7493427493f92b658221eb83d9e/users/a597581b55c845519c67d59a745a3f98/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:39.778199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926359a-4e7f-4ae1-8d30-7932a39177b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fa5e7493427493f92b658221eb83d9e, user_id=a597581b55c845519c67d59a745a3f98, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:39.778199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926359a-4e7f-4ae1-8d30-7932a39177b9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:39.787514 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 896/1786] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:39 2021] PUT /identity/v3/projects/7fa5e7493427493f92b658221eb83d9e/users/a597581b55c845519c67d59a745a3f98/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:39.798713 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b9f64-6e34-46e1-b170-c49771b9bad9 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:39.799030 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b9f64-6e34-46e1-b170-c49771b9bad9 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:39.800211 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b9f64-6e34-46e1-b170-c49771b9bad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:39.867585 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-ed9b9f64-6e34-46e1-b170-c49771b9bad9 None None] MFA Rules not processed for user `a597581b55c845519c67d59a745a3f98`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:39.897255 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-ed9b9f64-6e34-46e1-b170-c49771b9bad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:39.992662 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 897/1787] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:39 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:40.032607 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b9f64-6e34-46e1-b170-c49771b9bad9 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:40.065744 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b9f64-6e34-46e1-b170-c49771b9bad9 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:40.070126 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b7abe-fe0c-4d56-89d4-6647ae1ca937 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:40.071014 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b7abe-fe0c-4d56-89d4-6647ae1ca937 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:40.071455 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b7abe-fe0c-4d56-89d4-6647ae1ca937 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:40.071867 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b7abe-fe0c-4d56-89d4-6647ae1ca937 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:40.084974 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b7abe-fe0c-4d56-89d4-6647ae1ca937 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:40.086480 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b7abe-fe0c-4d56-89d4-6647ae1ca937 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:40.097124 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 898/1788] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:40 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:14:40.190153 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b7abe-fe0c-4d56-89d4-6647ae1ca937 service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:40.270620 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b7abe-fe0c-4d56-89d4-6647ae1ca937 service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:40.279847 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5dc89f-02cd-4f6c-b249-6f67d3885fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:40.280839 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dc89f-02cd-4f6c-b249-6f67d3885fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:40.281199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dc89f-02cd-4f6c-b249-6f67d3885fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:40.281548 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dc89f-02cd-4f6c-b249-6f67d3885fb8 admin admin] PATH_INFO: `/v3/users/8662c6c6f0c9426798398880de455395` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:40.283031 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5dc89f-02cd-4f6c-b249-6f67d3885fb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8662c6c6f0c9426798398880de455395)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:40.285066 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5dc89f-02cd-4f6c-b249-6f67d3885fb8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:40.379913 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c02c3f18-6634-4564-b210-64295e2db4fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fb73b9cd74545349c8db8dd3258789f'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:40.682523 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c02c3f18-6634-4564-b210-64295e2db4fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fb73b9cd74545349c8db8dd3258789f'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:40.695909 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c02c3f18-6634-4564-b210-64295e2db4fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fb73b9cd74545349c8db8dd3258789f'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:40.695909 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c02c3f18-6634-4564-b210-64295e2db4fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fb73b9cd74545349c8db8dd3258789f'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:40.704285 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c02c3f18-6634-4564-b210-64295e2db4fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fb73b9cd74545349c8db8dd3258789f'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:40.710269 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 891/1789] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:14:39 2021] DELETE /identity/v3/users/6fb73b9cd74545349c8db8dd3258789f => generated 0 bytes in 1102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:14:40.714450 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2deb9f-e52e-4e59-80ba-93e133b98c42 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:40.715332 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2deb9f-e52e-4e59-80ba-93e133b98c42 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:40.716082 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2deb9f-e52e-4e59-80ba-93e133b98c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:40.735906 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-6b2deb9f-e52e-4e59-80ba-93e133b98c42 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:40.737156 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-6b2deb9f-e52e-4e59-80ba-93e133b98c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:40.745982 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-aa5dc89f-02cd-4f6c-b249-6f67d3885fb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8662c6c6f0c9426798398880de455395'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:40.804879 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 892/1790] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:14:40.816678 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2deb9f-e52e-4e59-80ba-93e133b98c42 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:40.818091 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-6b2deb9f-e52e-4e59-80ba-93e133b98c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:40.872973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2deb9f-e52e-4e59-80ba-93e133b98c42 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:40.876562 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98edfc-a918-499f-bd74-660eb44cbf70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:40.877201 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98edfc-a918-499f-bd74-660eb44cbf70 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:40.877486 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98edfc-a918-499f-bd74-660eb44cbf70 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:40.877763 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98edfc-a918-499f-bd74-660eb44cbf70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:40.886412 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98edfc-a918-499f-bd74-660eb44cbf70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:40.887914 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98edfc-a918-499f-bd74-660eb44cbf70 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:40.903423 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-aa5dc89f-02cd-4f6c-b249-6f67d3885fb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8662c6c6f0c9426798398880de455395'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:40.908173 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 893/1791] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:14:40.910405 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-aa5dc89f-02cd-4f6c-b249-6f67d3885fb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8662c6c6f0c9426798398880de455395'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:40.911132 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-aa5dc89f-02cd-4f6c-b249-6f67d3885fb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8662c6c6f0c9426798398880de455395'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:40.924465 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-aa5dc89f-02cd-4f6c-b249-6f67d3885fb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8662c6c6f0c9426798398880de455395'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:40.931244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 899/1792] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:14:40 2021] DELETE /identity/v3/users/8662c6c6f0c9426798398880de455395 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:14:40.935882 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff708d44-e143-4511-8e8a-d9e4d8dfe937 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:40.936259 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff708d44-e143-4511-8e8a-d9e4d8dfe937 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:40.936548 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff708d44-e143-4511-8e8a-d9e4d8dfe937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:40.954991 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-ff708d44-e143-4511-8e8a-d9e4d8dfe937 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:40.956244 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-ff708d44-e143-4511-8e8a-d9e4d8dfe937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:41.026184 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 894/1793] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:41.060253 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5dc89f-02cd-4f6c-b249-6f67d3885fb8 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:41.060253 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-aa5dc89f-02cd-4f6c-b249-6f67d3885fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:41.126977 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5dc89f-02cd-4f6c-b249-6f67d3885fb8 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:41.131750 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099a4bd-faa9-489a-af08-28e5007f13c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:41.132518 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099a4bd-faa9-489a-af08-28e5007f13c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:41.132904 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099a4bd-faa9-489a-af08-28e5007f13c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:41.133277 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099a4bd-faa9-489a-af08-28e5007f13c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:41.147125 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099a4bd-faa9-489a-af08-28e5007f13c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:41.148961 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099a4bd-faa9-489a-af08-28e5007f13c5 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:41.160205 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 900/1794] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:41.805431 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff708d44-e143-4511-8e8a-d9e4d8dfe937 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:41.816921 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-ff708d44-e143-4511-8e8a-d9e4d8dfe937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:41.819826 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff708d44-e143-4511-8e8a-d9e4d8dfe937 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:41.827462 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ae0c3-c4ce-40f3-83c1-4926ac015f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:41.828279 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ae0c3-c4ce-40f3-83c1-4926ac015f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:41.828568 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ae0c3-c4ce-40f3-83c1-4926ac015f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:41.828889 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ae0c3-c4ce-40f3-83c1-4926ac015f44 admin admin] PATH_INFO: `/v3/projects/4852746b9ca04bbe9aa7ff8ceb7fb9eb` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:41.830237 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ae0c3-c4ce-40f3-83c1-4926ac015f44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4852746b9ca04bbe9aa7ff8ceb7fb9eb)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:41.832124 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ae0c3-c4ce-40f3-83c1-4926ac015f44 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:41.878055 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099a4bd-faa9-489a-af08-28e5007f13c5 service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:41.879593 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-2099a4bd-faa9-489a-af08-28e5007f13c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:41.895461 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099a4bd-faa9-489a-af08-28e5007f13c5 service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:41.901741 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471dbf46-2622-4690-96bb-dddf7152b0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:41.903807 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dbf46-2622-4690-96bb-dddf7152b0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:41.904926 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dbf46-2622-4690-96bb-dddf7152b0df admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:41.905457 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dbf46-2622-4690-96bb-dddf7152b0df admin admin] PATH_INFO: `/v3/projects/5fa9a525ea374057b6866f32dc67bfe2` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:41.906945 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471dbf46-2622-4690-96bb-dddf7152b0df admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa9a525ea374057b6866f32dc67bfe2)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:41.909120 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471dbf46-2622-4690-96bb-dddf7152b0df admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:41.963279 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-283ae0c3-c4ce-40f3-83c1-4926ac015f44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4852746b9ca04bbe9aa7ff8ceb7fb9eb', 'request_id': 'req-283ae0c3-c4ce-40f3-83c1-4926ac015f44'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:41.973445 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-283ae0c3-c4ce-40f3-83c1-4926ac015f44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4852746b9ca04bbe9aa7ff8ceb7fb9eb', 'request_id': 'req-283ae0c3-c4ce-40f3-83c1-4926ac015f44'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:41.994288 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-283ae0c3-c4ce-40f3-83c1-4926ac015f44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4852746b9ca04bbe9aa7ff8ceb7fb9eb', 'request_id': 'req-283ae0c3-c4ce-40f3-83c1-4926ac015f44'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:42.075328 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-471dbf46-2622-4690-96bb-dddf7152b0df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa9a525ea374057b6866f32dc67bfe2', 'request_id': 'req-471dbf46-2622-4690-96bb-dddf7152b0df'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:42.082468 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-471dbf46-2622-4690-96bb-dddf7152b0df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa9a525ea374057b6866f32dc67bfe2', 'request_id': 'req-471dbf46-2622-4690-96bb-dddf7152b0df'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:42.091072 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-471dbf46-2622-4690-96bb-dddf7152b0df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa9a525ea374057b6866f32dc67bfe2', 'request_id': 'req-471dbf46-2622-4690-96bb-dddf7152b0df'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:42.093077 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-283ae0c3-c4ce-40f3-83c1-4926ac015f44 admin admin] The token cache is being invalidate because project 4852746b9ca04bbe9aa7ff8ceb7fb9eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:14:42.093429 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-283ae0c3-c4ce-40f3-83c1-4926ac015f44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:42.097038 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-283ae0c3-c4ce-40f3-83c1-4926ac015f44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:42.097038 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 895/1795] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:14:41 2021] DELETE /identity/v3/projects/4852746b9ca04bbe9aa7ff8ceb7fb9eb => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:42.100066 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ae0c3-c4ce-40f3-83c1-4926ac015f44 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:42.101641 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-283ae0c3-c4ce-40f3-83c1-4926ac015f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:42.190141 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ae0c3-c4ce-40f3-83c1-4926ac015f44 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:42.203577 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-471dbf46-2622-4690-96bb-dddf7152b0df admin admin] The token cache is being invalidate because project 5fa9a525ea374057b6866f32dc67bfe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:14:42.205713 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-471dbf46-2622-4690-96bb-dddf7152b0df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:42.205713 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-471dbf46-2622-4690-96bb-dddf7152b0df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:42.208957 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 901/1796] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:14:41 2021] DELETE /identity/v3/projects/5fa9a525ea374057b6866f32dc67bfe2 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:14:42.212920 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471dbf46-2622-4690-96bb-dddf7152b0df admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:42.214614 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-471dbf46-2622-4690-96bb-dddf7152b0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:42.258284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d9644-4806-4ba7-9a35-575e573a3070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:42.259194 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d9644-4806-4ba7-9a35-575e573a3070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:42.259722 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d9644-4806-4ba7-9a35-575e573a3070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:42.260071 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d9644-4806-4ba7-9a35-575e573a3070 admin admin] PATH_INFO: `/v3/users/a597581b55c845519c67d59a745a3f98` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:42.261348 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d9644-4806-4ba7-9a35-575e573a3070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a597581b55c845519c67d59a745a3f98)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:42.263882 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d9644-4806-4ba7-9a35-575e573a3070 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:42.298215 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471dbf46-2622-4690-96bb-dddf7152b0df admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:42.304484 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9da0fc-baef-4754-8c82-6fb847a36d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:42.305488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9da0fc-baef-4754-8c82-6fb847a36d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:42.305867 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9da0fc-baef-4754-8c82-6fb847a36d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:42.306237 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9da0fc-baef-4754-8c82-6fb847a36d75 admin admin] PATH_INFO: `/v3/users/1ae37c48749e475f97fd568a343211dc` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:42.307845 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9da0fc-baef-4754-8c82-6fb847a36d75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ae37c48749e475f97fd568a343211dc)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:42.310918 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9da0fc-baef-4754-8c82-6fb847a36d75 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:42.502939 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c49d9644-4806-4ba7-9a35-575e573a3070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a597581b55c845519c67d59a745a3f98'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:42.533951 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ea9da0fc-baef-4754-8c82-6fb847a36d75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ae37c48749e475f97fd568a343211dc'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:42.634112 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c49d9644-4806-4ba7-9a35-575e573a3070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a597581b55c845519c67d59a745a3f98'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:42.642237 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c49d9644-4806-4ba7-9a35-575e573a3070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a597581b55c845519c67d59a745a3f98'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:42.642957 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c49d9644-4806-4ba7-9a35-575e573a3070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a597581b55c845519c67d59a745a3f98'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:42.656328 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c49d9644-4806-4ba7-9a35-575e573a3070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a597581b55c845519c67d59a745a3f98'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:42.663054 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 896/1797] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:14:42 2021] DELETE /identity/v3/users/a597581b55c845519c67d59a745a3f98 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:42.743339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ea9da0fc-baef-4754-8c82-6fb847a36d75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ae37c48749e475f97fd568a343211dc'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:42.754453 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ea9da0fc-baef-4754-8c82-6fb847a36d75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ae37c48749e475f97fd568a343211dc'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:42.756270 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ea9da0fc-baef-4754-8c82-6fb847a36d75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ae37c48749e475f97fd568a343211dc'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:42.791034 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ea9da0fc-baef-4754-8c82-6fb847a36d75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ae37c48749e475f97fd568a343211dc'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:42.815530 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 902/1798] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:14:42 2021] DELETE /identity/v3/users/1ae37c48749e475f97fd568a343211dc => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:14:43.694681 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d9644-4806-4ba7-9a35-575e573a3070 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:43.696923 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c49d9644-4806-4ba7-9a35-575e573a3070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:43.704002 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9da0fc-baef-4754-8c82-6fb847a36d75 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:43.706262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-ea9da0fc-baef-4754-8c82-6fb847a36d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:43.794562 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d9644-4806-4ba7-9a35-575e573a3070 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:43.800012 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88019bcc-de76-4a74-ad3f-2d5359e92485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:43.800953 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88019bcc-de76-4a74-ad3f-2d5359e92485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:43.801405 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88019bcc-de76-4a74-ad3f-2d5359e92485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:43.801753 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88019bcc-de76-4a74-ad3f-2d5359e92485 admin admin] PATH_INFO: `/v3/projects/95e46494d991436496d84a868b727a15` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:43.803069 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88019bcc-de76-4a74-ad3f-2d5359e92485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e46494d991436496d84a868b727a15)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:43.803179 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9da0fc-baef-4754-8c82-6fb847a36d75 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:43.806800 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88019bcc-de76-4a74-ad3f-2d5359e92485 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:43.808368 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e00fb1-ed07-4902-8237-e154c8c4d8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:43.809894 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e00fb1-ed07-4902-8237-e154c8c4d8e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:43.810171 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e00fb1-ed07-4902-8237-e154c8c4d8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:43.810480 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e00fb1-ed07-4902-8237-e154c8c4d8e1 admin admin] PATH_INFO: `/v3/projects/7fa5e7493427493f92b658221eb83d9e` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:43.812016 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e00fb1-ed07-4902-8237-e154c8c4d8e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fa5e7493427493f92b658221eb83d9e)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:43.813960 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e00fb1-ed07-4902-8237-e154c8c4d8e1 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:43.928330 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-88019bcc-de76-4a74-ad3f-2d5359e92485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e46494d991436496d84a868b727a15', 'request_id': 'req-88019bcc-de76-4a74-ad3f-2d5359e92485'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:43.955877 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-88019bcc-de76-4a74-ad3f-2d5359e92485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e46494d991436496d84a868b727a15', 'request_id': 'req-88019bcc-de76-4a74-ad3f-2d5359e92485'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:43.958769 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c0e00fb1-ed07-4902-8237-e154c8c4d8e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fa5e7493427493f92b658221eb83d9e', 'request_id': 'req-c0e00fb1-ed07-4902-8237-e154c8c4d8e1'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:43.965872 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c0e00fb1-ed07-4902-8237-e154c8c4d8e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fa5e7493427493f92b658221eb83d9e', 'request_id': 'req-c0e00fb1-ed07-4902-8237-e154c8c4d8e1'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:43.989125 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-88019bcc-de76-4a74-ad3f-2d5359e92485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e46494d991436496d84a868b727a15', 'request_id': 'req-88019bcc-de76-4a74-ad3f-2d5359e92485'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:43.990794 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c0e00fb1-ed07-4902-8237-e154c8c4d8e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fa5e7493427493f92b658221eb83d9e', 'request_id': 'req-c0e00fb1-ed07-4902-8237-e154c8c4d8e1'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:44.120720 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c0e00fb1-ed07-4902-8237-e154c8c4d8e1 admin admin] The token cache is being invalidate because project 7fa5e7493427493f92b658221eb83d9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:14:44.122278 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c0e00fb1-ed07-4902-8237-e154c8c4d8e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:44.123368 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c0e00fb1-ed07-4902-8237-e154c8c4d8e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:44.127974 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 903/1799] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:14:43 2021] DELETE /identity/v3/projects/7fa5e7493427493f92b658221eb83d9e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:44.133936 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bfbbf-7057-4ec3-b4eb-dbd49cab10b5 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:44.134435 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bfbbf-7057-4ec3-b4eb-dbd49cab10b5 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:44.134946 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bfbbf-7057-4ec3-b4eb-dbd49cab10b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:44.159559 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-2c0bfbbf-7057-4ec3-b4eb-dbd49cab10b5 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:44.161013 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-2c0bfbbf-7057-4ec3-b4eb-dbd49cab10b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:44.211543 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-88019bcc-de76-4a74-ad3f-2d5359e92485 admin admin] The token cache is being invalidate because project 95e46494d991436496d84a868b727a15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:14:44.212330 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-88019bcc-de76-4a74-ad3f-2d5359e92485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:44.213318 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-88019bcc-de76-4a74-ad3f-2d5359e92485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:44.217502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 897/1800] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:14:43 2021] DELETE /identity/v3/projects/95e46494d991436496d84a868b727a15 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:44.224944 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdb70a-22fe-4134-b549-8f3239b02f05 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:44.225369 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdb70a-22fe-4134-b549-8f3239b02f05 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:44.225977 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdb70a-22fe-4134-b549-8f3239b02f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:44.231599 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 904/1801] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:44.236367 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5bd0f-f99b-46eb-8230-a855f03ae960 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:44.238475 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5bd0f-f99b-46eb-8230-a855f03ae960 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:44.238475 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5bd0f-f99b-46eb-8230-a855f03ae960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:44.268184 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-b4a5bd0f-f99b-46eb-8230-a855f03ae960 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:44.268994 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-edbdb70a-22fe-4134-b549-8f3239b02f05 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:44.269980 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-b4a5bd0f-f99b-46eb-8230-a855f03ae960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:44.270276 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-edbdb70a-22fe-4134-b549-8f3239b02f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:44.283118 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 905/1802] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:44.287040 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5bd0f-f99b-46eb-8230-a855f03ae960 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:44.289001 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 898/1803] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:44.297541 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5bd0f-f99b-46eb-8230-a855f03ae960 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:44.298922 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39a380-d1ea-41dc-ac8d-194c284c373e None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:44.299247 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39a380-d1ea-41dc-ac8d-194c284c373e None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:44.299556 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39a380-d1ea-41dc-ac8d-194c284c373e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:44.309288 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e3389-9a8d-4123-9861-870b7bfb1e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:44.310082 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e3389-9a8d-4123-9861-870b7bfb1e20 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:44.310340 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e3389-9a8d-4123-9861-870b7bfb1e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:44.310642 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e3389-9a8d-4123-9861-870b7bfb1e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:44.311762 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e3389-9a8d-4123-9861-870b7bfb1e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:14:44.312219 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e3389-9a8d-4123-9861-870b7bfb1e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:44.313975 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e3389-9a8d-4123-9861-870b7bfb1e20 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:44.332096 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 906/1804] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:14:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 04:14:44.333530 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-7e39a380-d1ea-41dc-ac8d-194c284c373e None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:44.334346 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e3389-9a8d-4123-9861-870b7bfb1e20 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:44.335155 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-7e39a380-d1ea-41dc-ac8d-194c284c373e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:44.346380 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e3389-9a8d-4123-9861-870b7bfb1e20 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:44.352159 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c005a38-a4e4-4b9a-b59f-70053e6f23dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:44.352902 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c005a38-a4e4-4b9a-b59f-70053e6f23dc admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:44.353188 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c005a38-a4e4-4b9a-b59f-70053e6f23dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:44.353467 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c005a38-a4e4-4b9a-b59f-70053e6f23dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:44.354373 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c005a38-a4e4-4b9a-b59f-70053e6f23dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:44.356596 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c005a38-a4e4-4b9a-b59f-70053e6f23dc admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:44.362690 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 899/1805] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:44.366073 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39a380-d1ea-41dc-ac8d-194c284c373e None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:44.376588 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39a380-d1ea-41dc-ac8d-194c284c373e None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:44.381834 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd20b45-8ec3-4e13-99c5-320f8cf7878a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:44.382518 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd20b45-8ec3-4e13-99c5-320f8cf7878a admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:44.382799 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd20b45-8ec3-4e13-99c5-320f8cf7878a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:44.383073 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd20b45-8ec3-4e13-99c5-320f8cf7878a admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:44.383843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd20b45-8ec3-4e13-99c5-320f8cf7878a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:14:44.384153 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd20b45-8ec3-4e13-99c5-320f8cf7878a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:44.385800 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd20b45-8ec3-4e13-99c5-320f8cf7878a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:44.398592 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 900/1806] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:14:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:14:44.403533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd20b45-8ec3-4e13-99c5-320f8cf7878a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:44.413405 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd20b45-8ec3-4e13-99c5-320f8cf7878a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:44.419194 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2adac2-8182-4451-a52f-cad67faa5ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:44.419914 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2adac2-8182-4451-a52f-cad67faa5ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:44.420267 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2adac2-8182-4451-a52f-cad67faa5ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:44.420491 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2adac2-8182-4451-a52f-cad67faa5ed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:44.421253 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2adac2-8182-4451-a52f-cad67faa5ed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:44.423251 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2adac2-8182-4451-a52f-cad67faa5ed0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:44.490436 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 907/1807] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:44 2021] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:44.490436 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c005a38-a4e4-4b9a-b59f-70053e6f23dc admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:44.515346 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 901/1808] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:44 2021] POST /identity/v3/projects => generated 407 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:14:44.518785 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2adac2-8182-4451-a52f-cad67faa5ed0 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:44.636806 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c005a38-a4e4-4b9a-b59f-70053e6f23dc admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:44.646388 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c069fe-3ced-457d-a55d-70d3f82faed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:44.647269 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c069fe-3ced-457d-a55d-70d3f82faed6 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:44.652983 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c069fe-3ced-457d-a55d-70d3f82faed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:44.653199 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2adac2-8182-4451-a52f-cad67faa5ed0 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:44.653288 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c069fe-3ced-457d-a55d-70d3f82faed6 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:44.653288 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c069fe-3ced-457d-a55d-70d3f82faed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:44.653288 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c069fe-3ced-457d-a55d-70d3f82faed6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:44.672157 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590859c-02d7-4c79-8c66-b9d12264a079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:44.673344 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590859c-02d7-4c79-8c66-b9d12264a079 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:44.673838 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590859c-02d7-4c79-8c66-b9d12264a079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:44.674275 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590859c-02d7-4c79-8c66-b9d12264a079 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:44.687098 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590859c-02d7-4c79-8c66-b9d12264a079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:44.687098 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590859c-02d7-4c79-8c66-b9d12264a079 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:44.790637 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 908/1809] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:44 2021] POST /identity/v3/users => generated 292 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:44.795465 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c069fe-3ced-457d-a55d-70d3f82faed6 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:44.808745 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 902/1810] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:44 2021] POST /identity/v3/users => generated 304 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:44.809405 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590859c-02d7-4c79-8c66-b9d12264a079 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:44.816466 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c069fe-3ced-457d-a55d-70d3f82faed6 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:44.828605 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170aa91-2fa0-4fdd-a0e9-23016c7b8cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:44.829456 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170aa91-2fa0-4fdd-a0e9-23016c7b8cad admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:44.831579 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170aa91-2fa0-4fdd-a0e9-23016c7b8cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:44.832355 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170aa91-2fa0-4fdd-a0e9-23016c7b8cad admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:44.835026 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170aa91-2fa0-4fdd-a0e9-23016c7b8cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:44.841082 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170aa91-2fa0-4fdd-a0e9-23016c7b8cad admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:44.841738 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590859c-02d7-4c79-8c66-b9d12264a079 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:44.862541 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50359a4e-fd54-4fcb-87be-43e3bc90f333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:44.863242 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50359a4e-fd54-4fcb-87be-43e3bc90f333 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:44.863548 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50359a4e-fd54-4fcb-87be-43e3bc90f333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:44.863829 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50359a4e-fd54-4fcb-87be-43e3bc90f333 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:44.864588 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50359a4e-fd54-4fcb-87be-43e3bc90f333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:44.865914 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 909/1811] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:44 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:44.867967 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50359a4e-fd54-4fcb-87be-43e3bc90f333 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:44.869675 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170aa91-2fa0-4fdd-a0e9-23016c7b8cad admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:44.884191 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170aa91-2fa0-4fdd-a0e9-23016c7b8cad admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:44.889593 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36fc9b-465d-4b88-bb03-1f5c04a38a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:44.890542 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36fc9b-465d-4b88-bb03-1f5c04a38a92 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:44.890847 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36fc9b-465d-4b88-bb03-1f5c04a38a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:44.891383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36fc9b-465d-4b88-bb03-1f5c04a38a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:44.892291 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36fc9b-465d-4b88-bb03-1f5c04a38a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:44.893901 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36fc9b-465d-4b88-bb03-1f5c04a38a92 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:44.908098 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 903/1812] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:44 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:44.912097 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50359a4e-fd54-4fcb-87be-43e3bc90f333 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:44.914207 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 910/1813] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:44 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:44.918727 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36fc9b-465d-4b88-bb03-1f5c04a38a92 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:44.924134 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50359a4e-fd54-4fcb-87be-43e3bc90f333 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:44.930105 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36fc9b-465d-4b88-bb03-1f5c04a38a92 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:44.930718 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e0fc0-959d-4080-9146-2332c9a42d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:44.931618 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e0fc0-959d-4080-9146-2332c9a42d46 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:44.932050 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e0fc0-959d-4080-9146-2332c9a42d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:44.932474 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e0fc0-959d-4080-9146-2332c9a42d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:44.934183 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e0fc0-959d-4080-9146-2332c9a42d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:44.935817 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa1770-6b4c-4d6a-8920-5fed979fc6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:44.936262 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e0fc0-959d-4080-9146-2332c9a42d46 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:44.936705 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa1770-6b4c-4d6a-8920-5fed979fc6e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:44.937090 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa1770-6b4c-4d6a-8920-5fed979fc6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:44.937374 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa1770-6b4c-4d6a-8920-5fed979fc6e8 admin admin] PATH_INFO: `/v3/projects/eb523b91457644aeac85e93a90cba308/users/e850be21871e424c87da68018fee449a/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:44.953634 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 904/1814] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:44 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:44.954760 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e0fc0-959d-4080-9146-2332c9a42d46 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:44.955481 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa1770-6b4c-4d6a-8920-5fed979fc6e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb523b91457644aeac85e93a90cba308, user_id=e850be21871e424c87da68018fee449a, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:44.958373 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa1770-6b4c-4d6a-8920-5fed979fc6e8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:44.967021 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e0fc0-959d-4080-9146-2332c9a42d46 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:44.974648 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac241e-e667-43d5-9e91-8ff5109d4d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:44.975944 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac241e-e667-43d5-9e91-8ff5109d4d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:44.976559 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac241e-e667-43d5-9e91-8ff5109d4d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:44.977275 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac241e-e667-43d5-9e91-8ff5109d4d03 admin admin] PATH_INFO: `/v3/projects/1870e13e4a4a4bfd8efc44a0eafbce51/users/9b461071bbb94db1895e69e06a5b9ad4/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:44.997009 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac241e-e667-43d5-9e91-8ff5109d4d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1870e13e4a4a4bfd8efc44a0eafbce51, user_id=9b461071bbb94db1895e69e06a5b9ad4, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:45.001259 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac241e-e667-43d5-9e91-8ff5109d4d03 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:45.103115 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 911/1815] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:44 2021] PUT /identity/v3/projects/eb523b91457644aeac85e93a90cba308/users/e850be21871e424c87da68018fee449a/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:14:45.115962 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561fa89-17c5-4365-831f-22a29ac558e9 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:45.116317 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561fa89-17c5-4365-831f-22a29ac558e9 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:45.116742 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561fa89-17c5-4365-831f-22a29ac558e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:45.142973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 905/1816] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:44 2021] PUT /identity/v3/projects/1870e13e4a4a4bfd8efc44a0eafbce51/users/9b461071bbb94db1895e69e06a5b9ad4/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:45.155412 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf6d45-3116-43f2-8024-2ae9243b7539 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:45.155706 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf6d45-3116-43f2-8024-2ae9243b7539 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:45.156026 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf6d45-3116-43f2-8024-2ae9243b7539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:45.182576 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-c561fa89-17c5-4365-831f-22a29ac558e9 None None] MFA Rules not processed for user `e850be21871e424c87da68018fee449a`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:45.182576 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-c561fa89-17c5-4365-831f-22a29ac558e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:45.226679 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-79cf6d45-3116-43f2-8024-2ae9243b7539 None None] MFA Rules not processed for user `9b461071bbb94db1895e69e06a5b9ad4`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:45.228649 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-79cf6d45-3116-43f2-8024-2ae9243b7539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:45.353158 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 912/1817] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:45 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:14:45.359517 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561fa89-17c5-4365-831f-22a29ac558e9 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:45.393680 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 906/1818] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:45 2021] POST /identity/v3/auth/tokens => generated 3274 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:45.394966 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf6d45-3116-43f2-8024-2ae9243b7539 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:45.477657 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561fa89-17c5-4365-831f-22a29ac558e9 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:45.484698 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bb0f3-ef0e-4b56-9669-51b60a224c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:45.486601 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bb0f3-ef0e-4b56-9669-51b60a224c6e admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:45.487045 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bb0f3-ef0e-4b56-9669-51b60a224c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:45.487453 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bb0f3-ef0e-4b56-9669-51b60a224c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:45.489724 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bb0f3-ef0e-4b56-9669-51b60a224c6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:45.503940 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bb0f3-ef0e-4b56-9669-51b60a224c6e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:45.514815 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf6d45-3116-43f2-8024-2ae9243b7539 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:45.520016 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d154d9-57a6-4401-8838-76eefdf15ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:45.521119 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d154d9-57a6-4401-8838-76eefdf15ede admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:45.521273 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d154d9-57a6-4401-8838-76eefdf15ede admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:45.521637 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d154d9-57a6-4401-8838-76eefdf15ede admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:45.522522 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d154d9-57a6-4401-8838-76eefdf15ede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:45.524959 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d154d9-57a6-4401-8838-76eefdf15ede admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:45.662096 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 913/1819] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:45 2021] POST /identity/v3/projects => generated 381 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:45.666861 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bb0f3-ef0e-4b56-9669-51b60a224c6e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:45.703164 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 907/1820] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:45 2021] POST /identity/v3/projects => generated 407 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:45.707010 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d154d9-57a6-4401-8838-76eefdf15ede admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:45.765347 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bb0f3-ef0e-4b56-9669-51b60a224c6e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:45.816432 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d154d9-57a6-4401-8838-76eefdf15ede admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:45.826619 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595c723-8cc3-4476-af34-3bbf2f33f7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:45.827838 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595c723-8cc3-4476-af34-3bbf2f33f7c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:45.828127 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595c723-8cc3-4476-af34-3bbf2f33f7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:45.829820 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595c723-8cc3-4476-af34-3bbf2f33f7c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:45.830560 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595c723-8cc3-4476-af34-3bbf2f33f7c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:45.832549 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595c723-8cc3-4476-af34-3bbf2f33f7c5 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:45.862683 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5e22e-54d2-46a2-8573-1a72598affa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:45.863317 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5e22e-54d2-46a2-8573-1a72598affa3 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:45.867685 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5e22e-54d2-46a2-8573-1a72598affa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:45.868148 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5e22e-54d2-46a2-8573-1a72598affa3 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:45.869035 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5e22e-54d2-46a2-8573-1a72598affa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:45.872087 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5e22e-54d2-46a2-8573-1a72598affa3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:46.132584 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 908/1821] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:45 2021] POST /identity/v3/users => generated 310 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:14:46.156254 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595c723-8cc3-4476-af34-3bbf2f33f7c5 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:46.166281 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595c723-8cc3-4476-af34-3bbf2f33f7c5 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:46.171689 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d087ea-b7a7-4b23-bace-e8efb436bda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:46.172432 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d087ea-b7a7-4b23-bace-e8efb436bda4 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:46.172717 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d087ea-b7a7-4b23-bace-e8efb436bda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:46.172993 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d087ea-b7a7-4b23-bace-e8efb436bda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:46.173738 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d087ea-b7a7-4b23-bace-e8efb436bda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:46.175385 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d087ea-b7a7-4b23-bace-e8efb436bda4 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:46.185951 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 909/1822] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:46 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:14:46.190097 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d087ea-b7a7-4b23-bace-e8efb436bda4 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:46.200746 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d087ea-b7a7-4b23-bace-e8efb436bda4 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:46.205308 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd0080-36f2-4c79-922e-38a06ea31adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:46.206182 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd0080-36f2-4c79-922e-38a06ea31adf admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:46.206463 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd0080-36f2-4c79-922e-38a06ea31adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:46.206737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd0080-36f2-4c79-922e-38a06ea31adf admin admin] PATH_INFO: `/v3/projects/d5bd994b8de64cfc906d7adb6957e522/users/4e745a75757d471097213a719f2c3914/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:46.223228 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd0080-36f2-4c79-922e-38a06ea31adf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5bd994b8de64cfc906d7adb6957e522, user_id=4e745a75757d471097213a719f2c3914, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:46.226160 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd0080-36f2-4c79-922e-38a06ea31adf admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:46.239177 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 914/1823] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:45 2021] POST /identity/v3/users => generated 297 bytes in 570 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:46.240441 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5e22e-54d2-46a2-8573-1a72598affa3 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:46.250910 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5e22e-54d2-46a2-8573-1a72598affa3 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:46.255743 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908f21a-a1c3-45d4-8eca-903b519075ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:46.256460 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908f21a-a1c3-45d4-8eca-903b519075ca admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:46.256763 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908f21a-a1c3-45d4-8eca-903b519075ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:46.257036 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908f21a-a1c3-45d4-8eca-903b519075ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:46.257803 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908f21a-a1c3-45d4-8eca-903b519075ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:46.259464 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908f21a-a1c3-45d4-8eca-903b519075ca admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:46.271179 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 915/1824] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:46 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:14:46.275284 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908f21a-a1c3-45d4-8eca-903b519075ca admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:46.296429 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908f21a-a1c3-45d4-8eca-903b519075ca admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:46.335811 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 910/1825] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:46 2021] PUT /identity/v3/projects/d5bd994b8de64cfc906d7adb6957e522/users/4e745a75757d471097213a719f2c3914/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:14:46.339441 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd0080-36f2-4c79-922e-38a06ea31adf admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:46.356622 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95627535-88b4-46f0-af7f-9b13237058a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:46.357886 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95627535-88b4-46f0-af7f-9b13237058a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:46.358180 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95627535-88b4-46f0-af7f-9b13237058a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:46.358590 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95627535-88b4-46f0-af7f-9b13237058a4 admin admin] PATH_INFO: `/v3/projects/c43182eb07a2455797fe8ffe4f71c334/users/7f72e06472be477ca6ae9ffca102d7a7/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:46.381315 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95627535-88b4-46f0-af7f-9b13237058a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c43182eb07a2455797fe8ffe4f71c334, user_id=7f72e06472be477ca6ae9ffca102d7a7, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:46.389231 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95627535-88b4-46f0-af7f-9b13237058a4 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:46.477068 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd0080-36f2-4c79-922e-38a06ea31adf admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:46.495403 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860a823-0b13-4068-8bb7-bdb64524f2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:46.496143 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860a823-0b13-4068-8bb7-bdb64524f2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:46.496423 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860a823-0b13-4068-8bb7-bdb64524f2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:46.496701 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860a823-0b13-4068-8bb7-bdb64524f2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:46.498175 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860a823-0b13-4068-8bb7-bdb64524f2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:46.499885 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860a823-0b13-4068-8bb7-bdb64524f2d4 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:46.520658 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 911/1826] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:46 2021] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:14:46.525105 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860a823-0b13-4068-8bb7-bdb64524f2d4 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:46.557793 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860a823-0b13-4068-8bb7-bdb64524f2d4 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:46.560066 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 916/1827] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:46 2021] PUT /identity/v3/projects/c43182eb07a2455797fe8ffe4f71c334/users/7f72e06472be477ca6ae9ffca102d7a7/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:14:46.565568 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95627535-88b4-46f0-af7f-9b13237058a4 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:46.697358 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7168c5f-22aa-4927-8c09-f3ca214892f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:46.700796 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7168c5f-22aa-4927-8c09-f3ca214892f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:46.701100 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7168c5f-22aa-4927-8c09-f3ca214892f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:46.702931 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7168c5f-22aa-4927-8c09-f3ca214892f7 admin admin] PATH_INFO: `/v3/projects/d5bd994b8de64cfc906d7adb6957e522/users/4e745a75757d471097213a719f2c3914/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:46.710547 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7168c5f-22aa-4927-8c09-f3ca214892f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5bd994b8de64cfc906d7adb6957e522, user_id=4e745a75757d471097213a719f2c3914, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:46.719332 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7168c5f-22aa-4927-8c09-f3ca214892f7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:46.749797 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95627535-88b4-46f0-af7f-9b13237058a4 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:46.763421 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 912/1828] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:46 2021] PUT /identity/v3/projects/d5bd994b8de64cfc906d7adb6957e522/users/4e745a75757d471097213a719f2c3914/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:46.764925 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1b8d4-3e29-49cc-8833-cf135f3e95b0 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:46.765226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1b8d4-3e29-49cc-8833-cf135f3e95b0 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:46.765513 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1b8d4-3e29-49cc-8833-cf135f3e95b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:46.820625 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03846a-d604-49ea-80d4-d302a7138cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:46.832539 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03846a-d604-49ea-80d4-d302a7138cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:46.832539 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03846a-d604-49ea-80d4-d302a7138cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:46.832539 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03846a-d604-49ea-80d4-d302a7138cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:46.832539 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03846a-d604-49ea-80d4-d302a7138cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:46.832539 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03846a-d604-49ea-80d4-d302a7138cf5 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:46.833361 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-97b1b8d4-3e29-49cc-8833-cf135f3e95b0 None None] MFA Rules not processed for user `4e745a75757d471097213a719f2c3914`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:46.834807 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-97b1b8d4-3e29-49cc-8833-cf135f3e95b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:46.859747 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 917/1829] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:46 2021] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:14:46.872804 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03846a-d604-49ea-80d4-d302a7138cf5 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:46.897442 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03846a-d604-49ea-80d4-d302a7138cf5 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:46.927684 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c9152-79ed-43b2-8fc4-81b5698c6656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:46.932027 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c9152-79ed-43b2-8fc4-81b5698c6656 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:46.932027 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c9152-79ed-43b2-8fc4-81b5698c6656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:46.932205 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c9152-79ed-43b2-8fc4-81b5698c6656 admin admin] PATH_INFO: `/v3/projects/c43182eb07a2455797fe8ffe4f71c334/users/7f72e06472be477ca6ae9ffca102d7a7/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:46.934786 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c9152-79ed-43b2-8fc4-81b5698c6656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c43182eb07a2455797fe8ffe4f71c334, user_id=7f72e06472be477ca6ae9ffca102d7a7, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:46.937803 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c9152-79ed-43b2-8fc4-81b5698c6656 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:46.978084 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 918/1830] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:46 2021] PUT /identity/v3/projects/c43182eb07a2455797fe8ffe4f71c334/users/7f72e06472be477ca6ae9ffca102d7a7/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:46.982050 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132819b-faa0-4f7c-99db-1af8d6cf7c27 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:46.982302 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132819b-faa0-4f7c-99db-1af8d6cf7c27 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:46.982584 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132819b-faa0-4f7c-99db-1af8d6cf7c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:47.012278 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 913/1831] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:46 2021] POST /identity/v3/auth/tokens => generated 3341 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:47.014054 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1b8d4-3e29-49cc-8833-cf135f3e95b0 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:47.019351 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-97b1b8d4-3e29-49cc-8833-cf135f3e95b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:47.023510 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-c132819b-faa0-4f7c-99db-1af8d6cf7c27 None None] MFA Rules not processed for user `7f72e06472be477ca6ae9ffca102d7a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:47.024717 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-c132819b-faa0-4f7c-99db-1af8d6cf7c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:47.087947 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1b8d4-3e29-49cc-8833-cf135f3e95b0 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:47.128680 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 919/1832] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:46 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:14:47.148104 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132819b-faa0-4f7c-99db-1af8d6cf7c27 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:47.150118 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-c132819b-faa0-4f7c-99db-1af8d6cf7c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:47.151319 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812964b6-ef4e-46b1-ae8c-59b4d699a841 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:47.152067 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812964b6-ef4e-46b1-ae8c-59b4d699a841 service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:47.152482 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812964b6-ef4e-46b1-ae8c-59b4d699a841 service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:47.152826 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812964b6-ef4e-46b1-ae8c-59b4d699a841 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:47.171150 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132819b-faa0-4f7c-99db-1af8d6cf7c27 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:47.177161 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d95e8f-09c2-48ed-a5cb-2769112a7617 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:47.177970 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d95e8f-09c2-48ed-a5cb-2769112a7617 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:47.178259 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d95e8f-09c2-48ed-a5cb-2769112a7617 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:47.178532 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d95e8f-09c2-48ed-a5cb-2769112a7617 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:47.192122 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d95e8f-09c2-48ed-a5cb-2769112a7617 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:47.193564 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d95e8f-09c2-48ed-a5cb-2769112a7617 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:47.209666 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 920/1833] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:47 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:47.236201 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812964b6-ef4e-46b1-ae8c-59b4d699a841 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:47.237744 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812964b6-ef4e-46b1-ae8c-59b4d699a841 service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:47.252461 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 914/1834] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:47 2021] GET /identity/v3/auth/tokens => generated 3341 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:47.396320 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d95e8f-09c2-48ed-a5cb-2769112a7617 service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:47.404778 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d95e8f-09c2-48ed-a5cb-2769112a7617 service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:47.408678 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0e663-53b4-42a1-adeb-b75942610865 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:47.409403 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0e663-53b4-42a1-adeb-b75942610865 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:47.409702 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0e663-53b4-42a1-adeb-b75942610865 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:47.409960 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0e663-53b4-42a1-adeb-b75942610865 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:47.474605 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0e663-53b4-42a1-adeb-b75942610865 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:47.476334 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0e663-53b4-42a1-adeb-b75942610865 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:47.498075 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 921/1835] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:47 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:47.861460 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812964b6-ef4e-46b1-ae8c-59b4d699a841 service cinder] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:47.870678 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812964b6-ef4e-46b1-ae8c-59b4d699a841 service cinder] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:47.877375 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f5998-91ea-45cd-a28e-b18a366fee64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:47.877375 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f5998-91ea-45cd-a28e-b18a366fee64 service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:47.877375 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f5998-91ea-45cd-a28e-b18a366fee64 service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:47.877629 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f5998-91ea-45cd-a28e-b18a366fee64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:47.963328 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f5998-91ea-45cd-a28e-b18a366fee64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:47.965693 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f5998-91ea-45cd-a28e-b18a366fee64 service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:47.978941 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 915/1836] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:47 2021] GET /identity/v3/auth/tokens => generated 3274 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:48.750676 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0e663-53b4-42a1-adeb-b75942610865 service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:48.836300 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0e663-53b4-42a1-adeb-b75942610865 service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:48.841505 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582ea23-38a1-4c12-a728-a55f0a78d118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:48.842658 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582ea23-38a1-4c12-a728-a55f0a78d118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:48.842991 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582ea23-38a1-4c12-a728-a55f0a78d118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:48.843711 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582ea23-38a1-4c12-a728-a55f0a78d118 admin admin] PATH_INFO: `/v3/users/e850be21871e424c87da68018fee449a` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:48.845053 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582ea23-38a1-4c12-a728-a55f0a78d118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e850be21871e424c87da68018fee449a)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:48.846956 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582ea23-38a1-4c12-a728-a55f0a78d118 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:49.113738 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-9582ea23-38a1-4c12-a728-a55f0a78d118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e850be21871e424c87da68018fee449a'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:49.262820 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-9582ea23-38a1-4c12-a728-a55f0a78d118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e850be21871e424c87da68018fee449a'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:49.270963 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-9582ea23-38a1-4c12-a728-a55f0a78d118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e850be21871e424c87da68018fee449a'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:49.272003 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-9582ea23-38a1-4c12-a728-a55f0a78d118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e850be21871e424c87da68018fee449a'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:49.285189 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-9582ea23-38a1-4c12-a728-a55f0a78d118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e850be21871e424c87da68018fee449a'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:49.291891 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 922/1837] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:14:48 2021] DELETE /identity/v3/users/e850be21871e424c87da68018fee449a => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:49.297391 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c64bb-cd82-4dec-a79d-a3ba6c713235 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:49.297843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c64bb-cd82-4dec-a79d-a3ba6c713235 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:49.297929 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c64bb-cd82-4dec-a79d-a3ba6c713235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:49.317034 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-9b0c64bb-cd82-4dec-a79d-a3ba6c713235 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:49.318769 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-9b0c64bb-cd82-4dec-a79d-a3ba6c713235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:49.389871 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 916/1838] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:49.395046 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582ea23-38a1-4c12-a728-a55f0a78d118 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:49.396932 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-9582ea23-38a1-4c12-a728-a55f0a78d118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:49.399714 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9e714-be19-4bb8-a589-9e3ec36406f0 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:49.400252 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9e714-be19-4bb8-a589-9e3ec36406f0 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:49.400613 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9e714-be19-4bb8-a589-9e3ec36406f0 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:49.404376 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 917/1839] 10.222.0.54 () {54 vars in 921 bytes} [Tue Nov 23 04:14:49 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 04:14:49.451162 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667d719-c7c0-4c54-aba2-1123506bf9d2 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:49.451574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667d719-c7c0-4c54-aba2-1123506bf9d2 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:49.452010 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667d719-c7c0-4c54-aba2-1123506bf9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:49.483536 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-b667d719-c7c0-4c54-aba2-1123506bf9d2 None None] MFA Rules not processed for user `35e14131fb22470cba63cd5e8db359e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:49.486018 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-b667d719-c7c0-4c54-aba2-1123506bf9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:49.499831 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582ea23-38a1-4c12-a728-a55f0a78d118 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:49.507760 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044777b-19ed-467e-9929-065652e62677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:49.509360 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044777b-19ed-467e-9929-065652e62677 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:49.509835 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044777b-19ed-467e-9929-065652e62677 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:49.510304 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044777b-19ed-467e-9929-065652e62677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:49.526555 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044777b-19ed-467e-9929-065652e62677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:49.528955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044777b-19ed-467e-9929-065652e62677 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:49.542368 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 923/1840] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:49.597025 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 918/1841] 10.222.0.54 () {58 vars in 1018 bytes} [Tue Nov 23 04:14:49 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:49.903938 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044777b-19ed-467e-9929-065652e62677 service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:49.909595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-9044777b-19ed-467e-9929-065652e62677 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:49.929382 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044777b-19ed-467e-9929-065652e62677 service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:49.937464 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640eacf1-ca20-4465-8066-12326aa6bc40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:49.938136 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640eacf1-ca20-4465-8066-12326aa6bc40 service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:49.938426 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640eacf1-ca20-4465-8066-12326aa6bc40 service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:49.938694 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640eacf1-ca20-4465-8066-12326aa6bc40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:49.950030 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640eacf1-ca20-4465-8066-12326aa6bc40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:49.951725 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640eacf1-ca20-4465-8066-12326aa6bc40 service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:49.966714 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 924/1842] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:49 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:50.259998 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667d719-c7c0-4c54-aba2-1123506bf9d2 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:50.262425 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-b667d719-c7c0-4c54-aba2-1123506bf9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:50.285712 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667d719-c7c0-4c54-aba2-1123506bf9d2 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:50.298929 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91025f89-a091-40c5-9723-94ccebd36c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:50.300473 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91025f89-a091-40c5-9723-94ccebd36c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:50.302143 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91025f89-a091-40c5-9723-94ccebd36c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:50.303272 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91025f89-a091-40c5-9723-94ccebd36c24 admin admin] PATH_INFO: `/v3/projects/eb523b91457644aeac85e93a90cba308` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:50.320842 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91025f89-a091-40c5-9723-94ccebd36c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb523b91457644aeac85e93a90cba308)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:50.325311 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91025f89-a091-40c5-9723-94ccebd36c24 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:50.500772 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-91025f89-a091-40c5-9723-94ccebd36c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb523b91457644aeac85e93a90cba308', 'request_id': 'req-91025f89-a091-40c5-9723-94ccebd36c24'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:50.507168 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-91025f89-a091-40c5-9723-94ccebd36c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb523b91457644aeac85e93a90cba308', 'request_id': 'req-91025f89-a091-40c5-9723-94ccebd36c24'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:50.513533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-91025f89-a091-40c5-9723-94ccebd36c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb523b91457644aeac85e93a90cba308', 'request_id': 'req-91025f89-a091-40c5-9723-94ccebd36c24'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:50.658314 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-91025f89-a091-40c5-9723-94ccebd36c24 admin admin] The token cache is being invalidate because project eb523b91457644aeac85e93a90cba308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:14:50.658704 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-91025f89-a091-40c5-9723-94ccebd36c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:50.659906 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-91025f89-a091-40c5-9723-94ccebd36c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:50.664745 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 919/1843] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:14:50 2021] DELETE /identity/v3/projects/eb523b91457644aeac85e93a90cba308 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:50.666033 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640eacf1-ca20-4465-8066-12326aa6bc40 service nova] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:50.681569 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640eacf1-ca20-4465-8066-12326aa6bc40 service nova] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:50.774430 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420eb21-ce50-47c0-83c2-4a6fd11f2dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:50.775969 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420eb21-ce50-47c0-83c2-4a6fd11f2dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:50.776451 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420eb21-ce50-47c0-83c2-4a6fd11f2dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:50.776730 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420eb21-ce50-47c0-83c2-4a6fd11f2dcc admin admin] PATH_INFO: `/v3/users/7f72e06472be477ca6ae9ffca102d7a7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:50.778233 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420eb21-ce50-47c0-83c2-4a6fd11f2dcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f72e06472be477ca6ae9ffca102d7a7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:50.780157 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420eb21-ce50-47c0-83c2-4a6fd11f2dcc admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:51.026025 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c420eb21-ce50-47c0-83c2-4a6fd11f2dcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f72e06472be477ca6ae9ffca102d7a7'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:51.118124 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c420eb21-ce50-47c0-83c2-4a6fd11f2dcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f72e06472be477ca6ae9ffca102d7a7'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:51.132538 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c420eb21-ce50-47c0-83c2-4a6fd11f2dcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f72e06472be477ca6ae9ffca102d7a7'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:51.132538 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c420eb21-ce50-47c0-83c2-4a6fd11f2dcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f72e06472be477ca6ae9ffca102d7a7'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:51.140867 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91025f89-a091-40c5-9723-94ccebd36c24 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:51.142410 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-91025f89-a091-40c5-9723-94ccebd36c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:51.158315 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c420eb21-ce50-47c0-83c2-4a6fd11f2dcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f72e06472be477ca6ae9ffca102d7a7'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:51.159303 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91025f89-a091-40c5-9723-94ccebd36c24 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:51.166214 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d5cd2-8318-4c14-9cef-bfdb84632ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:51.169459 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 925/1844] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:14:50 2021] DELETE /identity/v3/users/7f72e06472be477ca6ae9ffca102d7a7 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:51.178155 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d5cd2-8318-4c14-9cef-bfdb84632ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:51.184428 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d5cd2-8318-4c14-9cef-bfdb84632ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:51.184724 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d5cd2-8318-4c14-9cef-bfdb84632ae2 admin admin] PATH_INFO: `/v3/users/b999989d76854d3d89ae0bb94046d38a` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:51.188040 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d5cd2-8318-4c14-9cef-bfdb84632ae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b999989d76854d3d89ae0bb94046d38a)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:51.190204 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d5cd2-8318-4c14-9cef-bfdb84632ae2 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:51.476887 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-200d5cd2-8318-4c14-9cef-bfdb84632ae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b999989d76854d3d89ae0bb94046d38a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:51.568012 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-200d5cd2-8318-4c14-9cef-bfdb84632ae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b999989d76854d3d89ae0bb94046d38a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:51.572545 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-200d5cd2-8318-4c14-9cef-bfdb84632ae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b999989d76854d3d89ae0bb94046d38a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:51.573178 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-200d5cd2-8318-4c14-9cef-bfdb84632ae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b999989d76854d3d89ae0bb94046d38a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:51.585184 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-200d5cd2-8318-4c14-9cef-bfdb84632ae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b999989d76854d3d89ae0bb94046d38a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:51.591145 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 920/1845] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:14:51 2021] DELETE /identity/v3/users/b999989d76854d3d89ae0bb94046d38a => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:14:51.596837 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5ffe1-d535-4110-b2c5-787a70b12b78 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:51.596837 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5ffe1-d535-4110-b2c5-787a70b12b78 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:51.596837 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5ffe1-d535-4110-b2c5-787a70b12b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:51.613959 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-7fc5ffe1-d535-4110-b2c5-787a70b12b78 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:51.615406 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-7fc5ffe1-d535-4110-b2c5-787a70b12b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:51.674557 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 926/1846] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:51.685472 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d5cd2-8318-4c14-9cef-bfdb84632ae2 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:51.687358 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-200d5cd2-8318-4c14-9cef-bfdb84632ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:51.727474 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5ffe1-d535-4110-b2c5-787a70b12b78 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:51.728922 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-7fc5ffe1-d535-4110-b2c5-787a70b12b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:51.743869 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5ffe1-d535-4110-b2c5-787a70b12b78 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:51.749976 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525997ba-e4e0-409a-83f7-10eb6c6cf626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:51.750970 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525997ba-e4e0-409a-83f7-10eb6c6cf626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:51.751178 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525997ba-e4e0-409a-83f7-10eb6c6cf626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:51.751483 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525997ba-e4e0-409a-83f7-10eb6c6cf626 admin admin] PATH_INFO: `/v3/projects/c43182eb07a2455797fe8ffe4f71c334` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:51.753099 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525997ba-e4e0-409a-83f7-10eb6c6cf626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c43182eb07a2455797fe8ffe4f71c334)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:51.754993 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525997ba-e4e0-409a-83f7-10eb6c6cf626 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:51.757050 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d5cd2-8318-4c14-9cef-bfdb84632ae2 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:51.761192 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27e8d4-3e1e-477e-8479-a05a1c545d9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:51.763810 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27e8d4-3e1e-477e-8479-a05a1c545d9e service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:51.763810 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27e8d4-3e1e-477e-8479-a05a1c545d9e service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:51.763810 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27e8d4-3e1e-477e-8479-a05a1c545d9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:51.781956 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27e8d4-3e1e-477e-8479-a05a1c545d9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:51.783681 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27e8d4-3e1e-477e-8479-a05a1c545d9e service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:51.799134 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 921/1847] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:51.897406 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-525997ba-e4e0-409a-83f7-10eb6c6cf626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c43182eb07a2455797fe8ffe4f71c334', 'request_id': 'req-525997ba-e4e0-409a-83f7-10eb6c6cf626'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:51.904977 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-525997ba-e4e0-409a-83f7-10eb6c6cf626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c43182eb07a2455797fe8ffe4f71c334', 'request_id': 'req-525997ba-e4e0-409a-83f7-10eb6c6cf626'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:51.912119 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-525997ba-e4e0-409a-83f7-10eb6c6cf626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c43182eb07a2455797fe8ffe4f71c334', 'request_id': 'req-525997ba-e4e0-409a-83f7-10eb6c6cf626'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:51.994026 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-525997ba-e4e0-409a-83f7-10eb6c6cf626 admin admin] The token cache is being invalidate because project c43182eb07a2455797fe8ffe4f71c334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:14:51.994323 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-525997ba-e4e0-409a-83f7-10eb6c6cf626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:51.995032 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-525997ba-e4e0-409a-83f7-10eb6c6cf626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:51.997865 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 927/1848] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:14:51 2021] DELETE /identity/v3/projects/c43182eb07a2455797fe8ffe4f71c334 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:14:52.003355 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed54797-d8c8-466d-acfd-a16fbbaa4212 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:52.003801 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed54797-d8c8-466d-acfd-a16fbbaa4212 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:52.004149 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed54797-d8c8-466d-acfd-a16fbbaa4212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:52.023171 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-2ed54797-d8c8-466d-acfd-a16fbbaa4212 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:52.024580 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-2ed54797-d8c8-466d-acfd-a16fbbaa4212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:52.082815 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 922/1849] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:52.091849 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20ecbc-2981-44d8-96ae-9aa5ba9b3221 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:52.092354 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20ecbc-2981-44d8-96ae-9aa5ba9b3221 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:52.092482 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20ecbc-2981-44d8-96ae-9aa5ba9b3221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:52.112273 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-4f20ecbc-2981-44d8-96ae-9aa5ba9b3221 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:52.113914 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-4f20ecbc-2981-44d8-96ae-9aa5ba9b3221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:52.124435 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 928/1850] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:52.128745 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed54797-d8c8-466d-acfd-a16fbbaa4212 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:52.138969 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed54797-d8c8-466d-acfd-a16fbbaa4212 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:52.143691 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a1f60-eda2-44c3-b34f-5acab9d59c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:52.144349 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a1f60-eda2-44c3-b34f-5acab9d59c80 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:52.144637 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a1f60-eda2-44c3-b34f-5acab9d59c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:52.144914 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a1f60-eda2-44c3-b34f-5acab9d59c80 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:52.145747 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a1f60-eda2-44c3-b34f-5acab9d59c80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:14:52.145953 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a1f60-eda2-44c3-b34f-5acab9d59c80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:52.147597 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a1f60-eda2-44c3-b34f-5acab9d59c80 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:52.173691 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 923/1851] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:14:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:14:52.178271 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20ecbc-2981-44d8-96ae-9aa5ba9b3221 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:52.187737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20ecbc-2981-44d8-96ae-9aa5ba9b3221 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:52.192410 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d58a35-d3e3-4dc9-9f6a-55e2d5a42159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:52.193063 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d58a35-d3e3-4dc9-9f6a-55e2d5a42159 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:52.193341 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d58a35-d3e3-4dc9-9f6a-55e2d5a42159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:52.193612 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d58a35-d3e3-4dc9-9f6a-55e2d5a42159 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:52.194329 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d58a35-d3e3-4dc9-9f6a-55e2d5a42159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:52.196249 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d58a35-d3e3-4dc9-9f6a-55e2d5a42159 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:52.332130 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 929/1852] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:52 2021] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:52.336496 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a1f60-eda2-44c3-b34f-5acab9d59c80 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:52.346245 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a1f60-eda2-44c3-b34f-5acab9d59c80 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:52.378574 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d58a35-d3e3-4dc9-9f6a-55e2d5a42159 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:52.382592 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-35d58a35-d3e3-4dc9-9f6a-55e2d5a42159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:52.423845 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8a599-204c-46f6-a5a6-0d1ff6b96056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:52.429847 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8a599-204c-46f6-a5a6-0d1ff6b96056 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:52.429847 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8a599-204c-46f6-a5a6-0d1ff6b96056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:52.429847 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8a599-204c-46f6-a5a6-0d1ff6b96056 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:52.429847 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8a599-204c-46f6-a5a6-0d1ff6b96056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:52.429847 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8a599-204c-46f6-a5a6-0d1ff6b96056 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:52.484913 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d58a35-d3e3-4dc9-9f6a-55e2d5a42159 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:52.489595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe92a3d-d7e6-4f2b-ba32-910521ab840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:52.490639 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe92a3d-d7e6-4f2b-ba32-910521ab840c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:52.490925 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe92a3d-d7e6-4f2b-ba32-910521ab840c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:52.491201 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe92a3d-d7e6-4f2b-ba32-910521ab840c admin admin] PATH_INFO: `/v3/projects/97f06799b3a44c2a926bec02e238dd3b` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:52.492421 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe92a3d-d7e6-4f2b-ba32-910521ab840c admin admin] RBAC: Authorizing `identity:delete_project(project_id=97f06799b3a44c2a926bec02e238dd3b)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:52.494347 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe92a3d-d7e6-4f2b-ba32-910521ab840c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:52.562858 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 924/1853] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:52 2021] POST /identity/v3/users => generated 286 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:52.567043 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8a599-204c-46f6-a5a6-0d1ff6b96056 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:52.578124 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8a599-204c-46f6-a5a6-0d1ff6b96056 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:52.583065 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d8085-17a9-45f8-8f6f-553c7f1dcb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:52.583754 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d8085-17a9-45f8-8f6f-553c7f1dcb53 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:52.584038 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d8085-17a9-45f8-8f6f-553c7f1dcb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:52.584314 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d8085-17a9-45f8-8f6f-553c7f1dcb53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:52.585057 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d8085-17a9-45f8-8f6f-553c7f1dcb53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:52.586696 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d8085-17a9-45f8-8f6f-553c7f1dcb53 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:52.596970 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 925/1854] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:52 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:14:52.600770 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d8085-17a9-45f8-8f6f-553c7f1dcb53 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:52.610476 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d8085-17a9-45f8-8f6f-553c7f1dcb53 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:52.615987 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b230b-59a5-4961-b58b-fcf6725a0866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:52.616638 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b230b-59a5-4961-b58b-fcf6725a0866 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:52.616926 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b230b-59a5-4961-b58b-fcf6725a0866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:52.617204 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b230b-59a5-4961-b58b-fcf6725a0866 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:52.617952 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b230b-59a5-4961-b58b-fcf6725a0866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:52.619546 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b230b-59a5-4961-b58b-fcf6725a0866 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:52.631963 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 926/1855] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:52 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:14:52.637042 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b230b-59a5-4961-b58b-fcf6725a0866 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:52.645140 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-efe92a3d-d7e6-4f2b-ba32-910521ab840c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97f06799b3a44c2a926bec02e238dd3b', 'request_id': 'req-efe92a3d-d7e6-4f2b-ba32-910521ab840c'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:52.647542 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b230b-59a5-4961-b58b-fcf6725a0866 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:52.651439 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-efe92a3d-d7e6-4f2b-ba32-910521ab840c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97f06799b3a44c2a926bec02e238dd3b', 'request_id': 'req-efe92a3d-d7e6-4f2b-ba32-910521ab840c'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:52.657734 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-efe92a3d-d7e6-4f2b-ba32-910521ab840c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97f06799b3a44c2a926bec02e238dd3b', 'request_id': 'req-efe92a3d-d7e6-4f2b-ba32-910521ab840c'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:52.704499 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86097705-189a-4124-891a-384e5c0fc15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:52.705383 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86097705-189a-4124-891a-384e5c0fc15c admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:52.705668 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86097705-189a-4124-891a-384e5c0fc15c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:52.705947 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86097705-189a-4124-891a-384e5c0fc15c admin admin] PATH_INFO: `/v3/projects/d63df76f0e6143769f3c277ddefb7623/users/beeeda545efa4628b7c8bdc7abab1f32/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:52.719656 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86097705-189a-4124-891a-384e5c0fc15c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63df76f0e6143769f3c277ddefb7623, user_id=beeeda545efa4628b7c8bdc7abab1f32, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:52.722294 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86097705-189a-4124-891a-384e5c0fc15c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:52.735746 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-efe92a3d-d7e6-4f2b-ba32-910521ab840c admin admin] The token cache is being invalidate because project 97f06799b3a44c2a926bec02e238dd3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:14:52.736193 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-efe92a3d-d7e6-4f2b-ba32-910521ab840c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:52.736723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-efe92a3d-d7e6-4f2b-ba32-910521ab840c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:52.738481 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 930/1856] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:14:52 2021] DELETE /identity/v3/projects/97f06799b3a44c2a926bec02e238dd3b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:52.742071 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe92a3d-d7e6-4f2b-ba32-910521ab840c admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:52.743386 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-efe92a3d-d7e6-4f2b-ba32-910521ab840c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:52.755942 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe92a3d-d7e6-4f2b-ba32-910521ab840c admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:52.760406 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94f592-2c73-4cb3-b62e-d95a574c11e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:52.761240 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94f592-2c73-4cb3-b62e-d95a574c11e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:52.762155 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94f592-2c73-4cb3-b62e-d95a574c11e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:52.762466 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94f592-2c73-4cb3-b62e-d95a574c11e1 admin admin] PATH_INFO: `/v3/users/11a2fd5de80c42c783d9172aff43c3da` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:52.763725 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94f592-2c73-4cb3-b62e-d95a574c11e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11a2fd5de80c42c783d9172aff43c3da)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:52.765644 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94f592-2c73-4cb3-b62e-d95a574c11e1 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:52.799249 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 927/1857] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:52 2021] PUT /identity/v3/projects/d63df76f0e6143769f3c277ddefb7623/users/beeeda545efa4628b7c8bdc7abab1f32/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:52.804170 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80bb16-2310-496e-920d-33caaed5fbff None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:52.804461 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80bb16-2310-496e-920d-33caaed5fbff None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:52.804740 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80bb16-2310-496e-920d-33caaed5fbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:52.821298 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-de80bb16-2310-496e-920d-33caaed5fbff None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:52.822485 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-de80bb16-2310-496e-920d-33caaed5fbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:52.878260 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 928/1858] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:14:52.888732 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80bb16-2310-496e-920d-33caaed5fbff None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:52.890088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-de80bb16-2310-496e-920d-33caaed5fbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:52.944877 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80bb16-2310-496e-920d-33caaed5fbff None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:52.948590 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7cd38-4792-4b97-90e3-efff03141e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:52.952403 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7cd38-4792-4b97-90e3-efff03141e4b service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:52.952403 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7cd38-4792-4b97-90e3-efff03141e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:52.952403 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7cd38-4792-4b97-90e3-efff03141e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:52.960015 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7cd38-4792-4b97-90e3-efff03141e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:52.961480 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7cd38-4792-4b97-90e3-efff03141e4b service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:52.962124 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-fc94f592-2c73-4cb3-b62e-d95a574c11e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11a2fd5de80c42c783d9172aff43c3da'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:52.972266 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 929/1859] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:14:53.038611 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-fc94f592-2c73-4cb3-b62e-d95a574c11e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11a2fd5de80c42c783d9172aff43c3da'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:53.046986 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-fc94f592-2c73-4cb3-b62e-d95a574c11e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11a2fd5de80c42c783d9172aff43c3da'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:53.048340 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-fc94f592-2c73-4cb3-b62e-d95a574c11e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11a2fd5de80c42c783d9172aff43c3da'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:53.061568 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-fc94f592-2c73-4cb3-b62e-d95a574c11e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11a2fd5de80c42c783d9172aff43c3da'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:53.068971 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 931/1860] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:14:52 2021] DELETE /identity/v3/users/11a2fd5de80c42c783d9172aff43c3da => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:14:53.681690 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7cd38-4792-4b97-90e3-efff03141e4b service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:53.696435 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7cd38-4792-4b97-90e3-efff03141e4b service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:53.759991 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b0da3-face-4738-a522-74a05f300b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:53.761200 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b0da3-face-4738-a522-74a05f300b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:53.762131 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b0da3-face-4738-a522-74a05f300b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:53.762411 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b0da3-face-4738-a522-74a05f300b3a admin admin] PATH_INFO: `/v3/projects/28f49a7fd77b43dbb2980ab9d4114306` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:53.763695 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b0da3-face-4738-a522-74a05f300b3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=28f49a7fd77b43dbb2980ab9d4114306)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:53.765574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b0da3-face-4738-a522-74a05f300b3a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:53.903067 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-ad0b0da3-face-4738-a522-74a05f300b3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28f49a7fd77b43dbb2980ab9d4114306', 'request_id': 'req-ad0b0da3-face-4738-a522-74a05f300b3a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:53.909341 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-ad0b0da3-face-4738-a522-74a05f300b3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28f49a7fd77b43dbb2980ab9d4114306', 'request_id': 'req-ad0b0da3-face-4738-a522-74a05f300b3a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:53.914636 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-ad0b0da3-face-4738-a522-74a05f300b3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28f49a7fd77b43dbb2980ab9d4114306', 'request_id': 'req-ad0b0da3-face-4738-a522-74a05f300b3a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:54.038600 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-ad0b0da3-face-4738-a522-74a05f300b3a admin admin] The token cache is being invalidate because project 28f49a7fd77b43dbb2980ab9d4114306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:14:54.043107 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-ad0b0da3-face-4738-a522-74a05f300b3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:54.043107 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-ad0b0da3-face-4738-a522-74a05f300b3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:14:54.043107 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 930/1861] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:14:53 2021] DELETE /identity/v3/projects/28f49a7fd77b43dbb2980ab9d4114306 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:54.048214 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c103a-589b-48da-8279-cd9a1aab8f97 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:54.048689 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c103a-589b-48da-8279-cd9a1aab8f97 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:54.048783 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c103a-589b-48da-8279-cd9a1aab8f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:54.066707 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-aa0c103a-589b-48da-8279-cd9a1aab8f97 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:54.067980 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-aa0c103a-589b-48da-8279-cd9a1aab8f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:54.127730 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 932/1862] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:54.136472 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8676d2-363b-4025-a6d1-f3e387ccc402 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:54.136875 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8676d2-363b-4025-a6d1-f3e387ccc402 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:54.137161 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8676d2-363b-4025-a6d1-f3e387ccc402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:54.155537 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-cf8676d2-363b-4025-a6d1-f3e387ccc402 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:54.156737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-cf8676d2-363b-4025-a6d1-f3e387ccc402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:54.164525 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 931/1863] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:54.169846 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c103a-589b-48da-8279-cd9a1aab8f97 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:54.179339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c103a-589b-48da-8279-cd9a1aab8f97 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:54.183938 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4b81d-5b02-4c83-8da6-11457bf72645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:54.184587 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4b81d-5b02-4c83-8da6-11457bf72645 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:54.184869 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4b81d-5b02-4c83-8da6-11457bf72645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:54.185141 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4b81d-5b02-4c83-8da6-11457bf72645 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:54.185863 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4b81d-5b02-4c83-8da6-11457bf72645 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:14:54.186168 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4b81d-5b02-4c83-8da6-11457bf72645 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:54.187780 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4b81d-5b02-4c83-8da6-11457bf72645 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:54.199582 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 933/1864] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:14:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 04:14:54.203970 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8676d2-363b-4025-a6d1-f3e387ccc402 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:54.213342 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8676d2-363b-4025-a6d1-f3e387ccc402 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:54.218779 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b560d-b35c-434b-905c-d50c8b94e8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:54.219466 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b560d-b35c-434b-905c-d50c8b94e8d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:54.219752 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b560d-b35c-434b-905c-d50c8b94e8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:54.220031 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b560d-b35c-434b-905c-d50c8b94e8d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:54.220762 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b560d-b35c-434b-905c-d50c8b94e8d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:54.222722 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b560d-b35c-434b-905c-d50c8b94e8d6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:54.366562 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 932/1865] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:54 2021] POST /identity/v3/projects => generated 363 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:54.375065 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4b81d-5b02-4c83-8da6-11457bf72645 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:54.385348 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4b81d-5b02-4c83-8da6-11457bf72645 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:54.403697 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33383f-7c33-43b0-a195-0d757c9e2817 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:54.404093 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33383f-7c33-43b0-a195-0d757c9e2817 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:54.404453 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33383f-7c33-43b0-a195-0d757c9e2817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:54.445794 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-0d33383f-7c33-43b0-a195-0d757c9e2817 None None] MFA Rules not processed for user `beeeda545efa4628b7c8bdc7abab1f32`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:54.447767 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-0d33383f-7c33-43b0-a195-0d757c9e2817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:54.477750 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963fb6a-7938-48e6-9411-40f3bbb0383d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:54.478516 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963fb6a-7938-48e6-9411-40f3bbb0383d admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:54.478866 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963fb6a-7938-48e6-9411-40f3bbb0383d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:54.479231 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963fb6a-7938-48e6-9411-40f3bbb0383d admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:54.480022 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963fb6a-7938-48e6-9411-40f3bbb0383d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:54.482242 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963fb6a-7938-48e6-9411-40f3bbb0383d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:54.540556 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 933/1866] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:54 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:54.545214 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33383f-7c33-43b0-a195-0d757c9e2817 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:54.546524 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-0d33383f-7c33-43b0-a195-0d757c9e2817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:54.559665 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33383f-7c33-43b0-a195-0d757c9e2817 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:54.564228 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2cae1-1083-4da5-ad24-8970998d8130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:54.564876 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2cae1-1083-4da5-ad24-8970998d8130 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:54.565158 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2cae1-1083-4da5-ad24-8970998d8130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:54.565432 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2cae1-1083-4da5-ad24-8970998d8130 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:54.566133 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2cae1-1083-4da5-ad24-8970998d8130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:54.568059 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2cae1-1083-4da5-ad24-8970998d8130 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:54.629108 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 934/1867] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:54 2021] POST /identity/v3/users => generated 282 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:54.633159 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963fb6a-7938-48e6-9411-40f3bbb0383d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:54.643802 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963fb6a-7938-48e6-9411-40f3bbb0383d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:54.649874 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f61628-6bad-4e6c-bc04-088293eb14ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:54.650609 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f61628-6bad-4e6c-bc04-088293eb14ca admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:54.650905 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f61628-6bad-4e6c-bc04-088293eb14ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:54.651344 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f61628-6bad-4e6c-bc04-088293eb14ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:54.652793 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f61628-6bad-4e6c-bc04-088293eb14ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:54.654794 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f61628-6bad-4e6c-bc04-088293eb14ca admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:54.664885 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 935/1868] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:54 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:54.669306 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f61628-6bad-4e6c-bc04-088293eb14ca admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:54.680211 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f61628-6bad-4e6c-bc04-088293eb14ca admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:54.685544 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 934/1869] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:54 2021] POST /identity/v3/projects => generated 369 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:54.687808 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2cae1-1083-4da5-ad24-8970998d8130 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:54.688680 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e6e02-78c0-4932-bcb6-a59e15820bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:54.689463 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e6e02-78c0-4932-bcb6-a59e15820bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:54.689781 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e6e02-78c0-4932-bcb6-a59e15820bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:54.690062 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e6e02-78c0-4932-bcb6-a59e15820bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:54.690808 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e6e02-78c0-4932-bcb6-a59e15820bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:54.692605 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e6e02-78c0-4932-bcb6-a59e15820bb8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:54.709772 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 936/1870] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:54 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:54.713977 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e6e02-78c0-4932-bcb6-a59e15820bb8 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:54.725561 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e6e02-78c0-4932-bcb6-a59e15820bb8 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:54.755688 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2cae1-1083-4da5-ad24-8970998d8130 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:54.760587 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c869f5-f71f-45a6-8d9a-222ccdc08a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:54.761261 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c869f5-f71f-45a6-8d9a-222ccdc08a8a admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:54.762586 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c869f5-f71f-45a6-8d9a-222ccdc08a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:54.762880 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c869f5-f71f-45a6-8d9a-222ccdc08a8a admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:54.763649 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c869f5-f71f-45a6-8d9a-222ccdc08a8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:54.765620 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c869f5-f71f-45a6-8d9a-222ccdc08a8a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:54.784900 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651653e-a9f7-46df-b1c8-882e47a4bd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:54.785786 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651653e-a9f7-46df-b1c8-882e47a4bd0c admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:54.786064 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651653e-a9f7-46df-b1c8-882e47a4bd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:54.786336 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651653e-a9f7-46df-b1c8-882e47a4bd0c admin admin] PATH_INFO: `/v3/projects/ea9ac003bc79415f8aac0ee3f69649ad/users/e5e75364ac154c3487844761334ac030/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:54.801030 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651653e-a9f7-46df-b1c8-882e47a4bd0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9ac003bc79415f8aac0ee3f69649ad, user_id=e5e75364ac154c3487844761334ac030, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:54.803678 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651653e-a9f7-46df-b1c8-882e47a4bd0c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:54.868824 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 935/1871] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:54 2021] POST /identity/v3/users => generated 291 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:54.874029 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c869f5-f71f-45a6-8d9a-222ccdc08a8a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:54.884904 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c869f5-f71f-45a6-8d9a-222ccdc08a8a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:54.891610 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474d310-150e-4778-a03e-d83b383ca045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:54.892003 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474d310-150e-4778-a03e-d83b383ca045 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:54.892368 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474d310-150e-4778-a03e-d83b383ca045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:54.892720 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474d310-150e-4778-a03e-d83b383ca045 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:54.893543 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474d310-150e-4778-a03e-d83b383ca045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:54.895301 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474d310-150e-4778-a03e-d83b383ca045 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:54.907255 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 936/1872] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:54 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:54.911437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474d310-150e-4778-a03e-d83b383ca045 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:54.923006 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474d310-150e-4778-a03e-d83b383ca045 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:54.927940 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40893273-cbcd-483a-87e6-b8daf4cfb164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:54.928890 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40893273-cbcd-483a-87e6-b8daf4cfb164 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:54.929268 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40893273-cbcd-483a-87e6-b8daf4cfb164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:54.929623 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40893273-cbcd-483a-87e6-b8daf4cfb164 admin admin] PATH_INFO: `/v3/projects/a96b3d44323a46409290066d369c7daa/users/d9a9dfd4ced84b21ad645ad13354717f/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:54.943066 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 937/1873] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:54 2021] PUT /identity/v3/projects/ea9ac003bc79415f8aac0ee3f69649ad/users/e5e75364ac154c3487844761334ac030/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:54.950502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40893273-cbcd-483a-87e6-b8daf4cfb164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a96b3d44323a46409290066d369c7daa, user_id=d9a9dfd4ced84b21ad645ad13354717f, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:54.950502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40893273-cbcd-483a-87e6-b8daf4cfb164 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:54.959472 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab81df-6571-40cd-b482-f520a1fc8df3 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:54.959762 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab81df-6571-40cd-b482-f520a1fc8df3 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:54.960079 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab81df-6571-40cd-b482-f520a1fc8df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:54.993311 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-52ab81df-6571-40cd-b482-f520a1fc8df3 None None] MFA Rules not processed for user `e5e75364ac154c3487844761334ac030`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:54.994589 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-52ab81df-6571-40cd-b482-f520a1fc8df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:55.049528 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 937/1874] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:54 2021] PUT /identity/v3/projects/a96b3d44323a46409290066d369c7daa/users/d9a9dfd4ced84b21ad645ad13354717f/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:14:55.053789 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40893273-cbcd-483a-87e6-b8daf4cfb164 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:55.077366 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 938/1875] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:54 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:55.077366 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab81df-6571-40cd-b482-f520a1fc8df3 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:55.122452 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40893273-cbcd-483a-87e6-b8daf4cfb164 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:55.128768 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff669983-0c7d-401f-bd3b-f1349bc9286f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:55.129429 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff669983-0c7d-401f-bd3b-f1349bc9286f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:55.129739 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff669983-0c7d-401f-bd3b-f1349bc9286f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:55.130081 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff669983-0c7d-401f-bd3b-f1349bc9286f admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:55.130894 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff669983-0c7d-401f-bd3b-f1349bc9286f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:55.132552 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff669983-0c7d-401f-bd3b-f1349bc9286f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:55.142823 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 938/1876] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:55 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:14:55.147069 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff669983-0c7d-401f-bd3b-f1349bc9286f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:55.150847 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab81df-6571-40cd-b482-f520a1fc8df3 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:55.156247 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bfd15-495a-499a-a5dc-9e7f67618166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:55.156929 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bfd15-495a-499a-a5dc-9e7f67618166 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:55.157213 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bfd15-495a-499a-a5dc-9e7f67618166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:55.157492 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bfd15-495a-499a-a5dc-9e7f67618166 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:55.157576 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff669983-0c7d-401f-bd3b-f1349bc9286f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:55.158201 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1bfd15-495a-499a-a5dc-9e7f67618166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:55.160106 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1bfd15-495a-499a-a5dc-9e7f67618166 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:55.162463 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c9603-874c-4d1e-87b6-f5a69219e4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:55.163394 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c9603-874c-4d1e-87b6-f5a69219e4a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:55.163661 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c9603-874c-4d1e-87b6-f5a69219e4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:55.163938 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c9603-874c-4d1e-87b6-f5a69219e4a9 admin admin] PATH_INFO: `/v3/projects/a96b3d44323a46409290066d369c7daa/users/d9a9dfd4ced84b21ad645ad13354717f/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:55.166202 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c9603-874c-4d1e-87b6-f5a69219e4a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a96b3d44323a46409290066d369c7daa, user_id=d9a9dfd4ced84b21ad645ad13354717f, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:55.169417 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c9603-874c-4d1e-87b6-f5a69219e4a9 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:55.179859 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 939/1877] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:55 2021] PUT /identity/v3/projects/a96b3d44323a46409290066d369c7daa/users/d9a9dfd4ced84b21ad645ad13354717f/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:14:55.290408 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 939/1878] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:14:55 2021] POST /identity/v3/projects => generated 365 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:55.294500 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c9603-874c-4d1e-87b6-f5a69219e4a9 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:55.384255 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c9603-874c-4d1e-87b6-f5a69219e4a9 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:55.439539 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7012e6-f560-4af1-97c9-0d58fbfcf7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:55.440415 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7012e6-f560-4af1-97c9-0d58fbfcf7fc admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:55.440698 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7012e6-f560-4af1-97c9-0d58fbfcf7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:55.443807 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7012e6-f560-4af1-97c9-0d58fbfcf7fc admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:55.443807 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7012e6-f560-4af1-97c9-0d58fbfcf7fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:55.443807 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7012e6-f560-4af1-97c9-0d58fbfcf7fc admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:55.548967 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 940/1879] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:14:55 2021] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:14:55.552875 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bfd15-495a-499a-a5dc-9e7f67618166 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:55.571121 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bfd15-495a-499a-a5dc-9e7f67618166 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:55.577408 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224b29a-d5b3-4c9b-a8ac-50da932856d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:55.578155 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224b29a-d5b3-4c9b-a8ac-50da932856d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:55.578508 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224b29a-d5b3-4c9b-a8ac-50da932856d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:55.578852 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224b29a-d5b3-4c9b-a8ac-50da932856d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:55.579866 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224b29a-d5b3-4c9b-a8ac-50da932856d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:55.581520 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224b29a-d5b3-4c9b-a8ac-50da932856d8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:55.593860 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 940/1880] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:55 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:55.598058 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7012e6-f560-4af1-97c9-0d58fbfcf7fc admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:55.608657 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7012e6-f560-4af1-97c9-0d58fbfcf7fc admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:55.613338 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ecb58-fb9d-470a-8c85-e81424f2cbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:55.614226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ecb58-fb9d-470a-8c85-e81424f2cbf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:55.614505 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ecb58-fb9d-470a-8c85-e81424f2cbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:55.614813 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ecb58-fb9d-470a-8c85-e81424f2cbf6 admin admin] PATH_INFO: `/v3/projects/c7428447081841efbbecf2c62a621f18/users/cf7f3231a3dc4e87a5ae104122104793/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:55.630480 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ecb58-fb9d-470a-8c85-e81424f2cbf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7428447081841efbbecf2c62a621f18, user_id=cf7f3231a3dc4e87a5ae104122104793, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:55.633410 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ecb58-fb9d-470a-8c85-e81424f2cbf6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:55.837586 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 941/1881] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:55 2021] PUT /identity/v3/projects/c7428447081841efbbecf2c62a621f18/users/cf7f3231a3dc4e87a5ae104122104793/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:55.845608 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224b29a-d5b3-4c9b-a8ac-50da932856d8 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:55.855443 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224b29a-d5b3-4c9b-a8ac-50da932856d8 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:55.914852 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7599dcf-c167-4386-b936-749762e84564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:55.915898 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7599dcf-c167-4386-b936-749762e84564 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:55.916251 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7599dcf-c167-4386-b936-749762e84564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:55.916598 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7599dcf-c167-4386-b936-749762e84564 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:55.917434 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7599dcf-c167-4386-b936-749762e84564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:55.919156 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7599dcf-c167-4386-b936-749762e84564 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:55.929625 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 941/1882] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:14:55 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:14:55.938970 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ecb58-fb9d-470a-8c85-e81424f2cbf6 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:55.956587 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ecb58-fb9d-470a-8c85-e81424f2cbf6 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:55.963818 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdea64-ac17-4fa9-ad2b-32064d2a9597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:55.964826 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdea64-ac17-4fa9-ad2b-32064d2a9597 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:55.965150 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdea64-ac17-4fa9-ad2b-32064d2a9597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:55.966072 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdea64-ac17-4fa9-ad2b-32064d2a9597 admin admin] PATH_INFO: `/v3/projects/c7428447081841efbbecf2c62a621f18/users/cf7f3231a3dc4e87a5ae104122104793/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:55.969344 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdea64-ac17-4fa9-ad2b-32064d2a9597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7428447081841efbbecf2c62a621f18, user_id=cf7f3231a3dc4e87a5ae104122104793, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:55.972064 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdea64-ac17-4fa9-ad2b-32064d2a9597 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:55.983456 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 942/1883] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:14:55 2021] PUT /identity/v3/projects/c7428447081841efbbecf2c62a621f18/users/cf7f3231a3dc4e87a5ae104122104793/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:14:55.993802 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b05b6f-d498-4d3d-bb46-9a0701b9a031 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:55.994098 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b05b6f-d498-4d3d-bb46-9a0701b9a031 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:55.994382 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b05b6f-d498-4d3d-bb46-9a0701b9a031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:56.034944 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-38b05b6f-d498-4d3d-bb46-9a0701b9a031 None None] MFA Rules not processed for user `cf7f3231a3dc4e87a5ae104122104793`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:56.041013 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-38b05b6f-d498-4d3d-bb46-9a0701b9a031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:56.126383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 942/1884] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:55 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:56.132933 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdea64-ac17-4fa9-ad2b-32064d2a9597 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:56.134732 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c9cdea64-ac17-4fa9-ad2b-32064d2a9597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:56.191822 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdea64-ac17-4fa9-ad2b-32064d2a9597 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:56.195635 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49faa9e4-8f09-4f98-9d96-afb6b64e8a72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:56.196288 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49faa9e4-8f09-4f98-9d96-afb6b64e8a72 service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:56.196575 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49faa9e4-8f09-4f98-9d96-afb6b64e8a72 service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:56.196854 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49faa9e4-8f09-4f98-9d96-afb6b64e8a72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:56.207459 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49faa9e4-8f09-4f98-9d96-afb6b64e8a72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:56.208911 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49faa9e4-8f09-4f98-9d96-afb6b64e8a72 service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:56.220434 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 943/1885] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:56 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:56.456651 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b05b6f-d498-4d3d-bb46-9a0701b9a031 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:56.466363 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b05b6f-d498-4d3d-bb46-9a0701b9a031 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:56.469928 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a41d0-682c-4fdc-ac5c-d7d317b1ff32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:56.470592 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a41d0-682c-4fdc-ac5c-d7d317b1ff32 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:56.470877 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a41d0-682c-4fdc-ac5c-d7d317b1ff32 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:56.471155 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a41d0-682c-4fdc-ac5c-d7d317b1ff32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:56.524950 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a41d0-682c-4fdc-ac5c-d7d317b1ff32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:56.526377 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a41d0-682c-4fdc-ac5c-d7d317b1ff32 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:56.535914 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 943/1886] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:56 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:14:56.943984 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfd69c-e7f5-496b-9c26-5015d9f55050 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:56.947301 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfd69c-e7f5-496b-9c26-5015d9f55050 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:56.947301 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfd69c-e7f5-496b-9c26-5015d9f55050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:57.021601 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-47bfd69c-e7f5-496b-9c26-5015d9f55050 None None] MFA Rules not processed for user `d9a9dfd4ced84b21ad645ad13354717f`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:14:57.022851 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-47bfd69c-e7f5-496b-9c26-5015d9f55050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:14:57.118544 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 944/1887] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:14:56 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:14:57.127277 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a41d0-682c-4fdc-ac5c-d7d317b1ff32 service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:14:57.141484 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a41d0-682c-4fdc-ac5c-d7d317b1ff32 service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:14:57.141484 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39767513-ae80-4bff-b508-81d760558b53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:14:57.142225 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39767513-ae80-4bff-b508-81d760558b53 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:14:57.142641 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39767513-ae80-4bff-b508-81d760558b53 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:14:57.143765 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39767513-ae80-4bff-b508-81d760558b53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:14:57.211293 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39767513-ae80-4bff-b508-81d760558b53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:14:57.212755 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39767513-ae80-4bff-b508-81d760558b53 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:14:57.222629 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 944/1888] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:14:57 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:15:01.115250 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfd69c-e7f5-496b-9c26-5015d9f55050 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:01.125933 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-47bfd69c-e7f5-496b-9c26-5015d9f55050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:01.133561 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfd69c-e7f5-496b-9c26-5015d9f55050 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:01.138209 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e06ce0-0e54-4e46-af2d-62abca826244 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:01.138938 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e06ce0-0e54-4e46-af2d-62abca826244 service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:01.139314 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e06ce0-0e54-4e46-af2d-62abca826244 service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:01.139594 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e06ce0-0e54-4e46-af2d-62abca826244 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:01.148937 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e06ce0-0e54-4e46-af2d-62abca826244 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:01.150408 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e06ce0-0e54-4e46-af2d-62abca826244 service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:01.159821 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 945/1889] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:01 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:02.896318 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39767513-ae80-4bff-b508-81d760558b53 service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:02.897945 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-39767513-ae80-4bff-b508-81d760558b53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:02.971521 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39767513-ae80-4bff-b508-81d760558b53 service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:02.976701 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b801d-5f1d-4c59-af69-a72a2d46177e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:02.977571 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b801d-5f1d-4c59-af69-a72a2d46177e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:02.977852 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b801d-5f1d-4c59-af69-a72a2d46177e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:02.978125 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b801d-5f1d-4c59-af69-a72a2d46177e admin admin] PATH_INFO: `/v3/users/9b461071bbb94db1895e69e06a5b9ad4` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:02.979479 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b801d-5f1d-4c59-af69-a72a2d46177e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b461071bbb94db1895e69e06a5b9ad4)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:02.981994 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b801d-5f1d-4c59-af69-a72a2d46177e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:03.197134 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-cd6b801d-5f1d-4c59-af69-a72a2d46177e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b461071bbb94db1895e69e06a5b9ad4'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:03.321911 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-cd6b801d-5f1d-4c59-af69-a72a2d46177e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b461071bbb94db1895e69e06a5b9ad4'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:03.325780 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-cd6b801d-5f1d-4c59-af69-a72a2d46177e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b461071bbb94db1895e69e06a5b9ad4'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:03.326955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-cd6b801d-5f1d-4c59-af69-a72a2d46177e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b461071bbb94db1895e69e06a5b9ad4'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:03.339089 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-cd6b801d-5f1d-4c59-af69-a72a2d46177e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b461071bbb94db1895e69e06a5b9ad4'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:03.351724 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 945/1890] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:02 2021] DELETE /identity/v3/users/9b461071bbb94db1895e69e06a5b9ad4 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:03.357128 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51c425-735d-4df5-a358-aac75459d0ab None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:03.357613 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51c425-735d-4df5-a358-aac75459d0ab None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:03.357800 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51c425-735d-4df5-a358-aac75459d0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:03.382793 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-9f51c425-735d-4df5-a358-aac75459d0ab None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:03.384239 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-9f51c425-735d-4df5-a358-aac75459d0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:03.446677 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 946/1891] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:03.459544 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b801d-5f1d-4c59-af69-a72a2d46177e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:03.460190 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-cd6b801d-5f1d-4c59-af69-a72a2d46177e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:03.520175 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b801d-5f1d-4c59-af69-a72a2d46177e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:03.523846 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20507e1-2ee4-47c2-8ab8-b3b912b3e788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:03.524483 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20507e1-2ee4-47c2-8ab8-b3b912b3e788 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:03.524764 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20507e1-2ee4-47c2-8ab8-b3b912b3e788 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:03.525038 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20507e1-2ee4-47c2-8ab8-b3b912b3e788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:03.534432 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20507e1-2ee4-47c2-8ab8-b3b912b3e788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:03.536004 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20507e1-2ee4-47c2-8ab8-b3b912b3e788 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:03.545634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 946/1892] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:04.021875 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51c425-735d-4df5-a358-aac75459d0ab None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:04.023729 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-9f51c425-735d-4df5-a358-aac75459d0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:04.036600 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51c425-735d-4df5-a358-aac75459d0ab None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:04.043381 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2263d66-d3b1-43a2-83ee-3c23723e4d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:04.044290 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2263d66-d3b1-43a2-83ee-3c23723e4d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:04.045185 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2263d66-d3b1-43a2-83ee-3c23723e4d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:04.045470 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2263d66-d3b1-43a2-83ee-3c23723e4d10 admin admin] PATH_INFO: `/v3/projects/1870e13e4a4a4bfd8efc44a0eafbce51` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:04.046737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2263d66-d3b1-43a2-83ee-3c23723e4d10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1870e13e4a4a4bfd8efc44a0eafbce51)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:04.048819 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2263d66-d3b1-43a2-83ee-3c23723e4d10 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:04.242055 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f2263d66-d3b1-43a2-83ee-3c23723e4d10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1870e13e4a4a4bfd8efc44a0eafbce51', 'request_id': 'req-f2263d66-d3b1-43a2-83ee-3c23723e4d10'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:04.252242 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f2263d66-d3b1-43a2-83ee-3c23723e4d10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1870e13e4a4a4bfd8efc44a0eafbce51', 'request_id': 'req-f2263d66-d3b1-43a2-83ee-3c23723e4d10'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:04.258566 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f2263d66-d3b1-43a2-83ee-3c23723e4d10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1870e13e4a4a4bfd8efc44a0eafbce51', 'request_id': 'req-f2263d66-d3b1-43a2-83ee-3c23723e4d10'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:04.336716 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f2263d66-d3b1-43a2-83ee-3c23723e4d10 admin admin] The token cache is being invalidate because project 1870e13e4a4a4bfd8efc44a0eafbce51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:04.340470 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f2263d66-d3b1-43a2-83ee-3c23723e4d10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:04.340470 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f2263d66-d3b1-43a2-83ee-3c23723e4d10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:04.340470 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 947/1893] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:04 2021] DELETE /identity/v3/projects/1870e13e4a4a4bfd8efc44a0eafbce51 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:04.344048 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20507e1-2ee4-47c2-8ab8-b3b912b3e788 service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:04.354278 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20507e1-2ee4-47c2-8ab8-b3b912b3e788 service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:04.442455 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39041de-48b4-483b-96f4-5d04b30d7a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:04.443732 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39041de-48b4-483b-96f4-5d04b30d7a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:04.444168 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39041de-48b4-483b-96f4-5d04b30d7a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:04.444584 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39041de-48b4-483b-96f4-5d04b30d7a21 admin admin] PATH_INFO: `/v3/users/4e745a75757d471097213a719f2c3914` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:04.446678 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39041de-48b4-483b-96f4-5d04b30d7a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e745a75757d471097213a719f2c3914)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:04.449189 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39041de-48b4-483b-96f4-5d04b30d7a21 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:04.674327 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c39041de-48b4-483b-96f4-5d04b30d7a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e745a75757d471097213a719f2c3914'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:04.782545 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c39041de-48b4-483b-96f4-5d04b30d7a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e745a75757d471097213a719f2c3914'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:04.790361 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c39041de-48b4-483b-96f4-5d04b30d7a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e745a75757d471097213a719f2c3914'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:04.791061 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c39041de-48b4-483b-96f4-5d04b30d7a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e745a75757d471097213a719f2c3914'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:04.803044 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c39041de-48b4-483b-96f4-5d04b30d7a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e745a75757d471097213a719f2c3914'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:04.808992 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 947/1894] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:04 2021] DELETE /identity/v3/users/4e745a75757d471097213a719f2c3914 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:05.263773 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2263d66-d3b1-43a2-83ee-3c23723e4d10 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:05.265230 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-f2263d66-d3b1-43a2-83ee-3c23723e4d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:05.281958 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2263d66-d3b1-43a2-83ee-3c23723e4d10 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:05.343550 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3120f0-d271-4780-9381-04b4267aac72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:05.344418 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3120f0-d271-4780-9381-04b4267aac72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:05.344708 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3120f0-d271-4780-9381-04b4267aac72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:05.344996 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3120f0-d271-4780-9381-04b4267aac72 admin admin] PATH_INFO: `/v3/projects/d5bd994b8de64cfc906d7adb6957e522` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:05.346213 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3120f0-d271-4780-9381-04b4267aac72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5bd994b8de64cfc906d7adb6957e522)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:05.348172 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3120f0-d271-4780-9381-04b4267aac72 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:05.610891 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-cd3120f0-d271-4780-9381-04b4267aac72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5bd994b8de64cfc906d7adb6957e522', 'request_id': 'req-cd3120f0-d271-4780-9381-04b4267aac72'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:05.617177 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-cd3120f0-d271-4780-9381-04b4267aac72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5bd994b8de64cfc906d7adb6957e522', 'request_id': 'req-cd3120f0-d271-4780-9381-04b4267aac72'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:05.623952 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-cd3120f0-d271-4780-9381-04b4267aac72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5bd994b8de64cfc906d7adb6957e522', 'request_id': 'req-cd3120f0-d271-4780-9381-04b4267aac72'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:05.737881 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-cd3120f0-d271-4780-9381-04b4267aac72 admin admin] The token cache is being invalidate because project d5bd994b8de64cfc906d7adb6957e522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:05.738277 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-cd3120f0-d271-4780-9381-04b4267aac72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:05.748174 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-cd3120f0-d271-4780-9381-04b4267aac72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:05.748174 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 948/1895] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:05 2021] DELETE /identity/v3/projects/d5bd994b8de64cfc906d7adb6957e522 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:05.752865 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4ce95-19db-47ad-89ac-1a505e2e62f6 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:05.753342 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4ce95-19db-47ad-89ac-1a505e2e62f6 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:05.753445 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4ce95-19db-47ad-89ac-1a505e2e62f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:05.771453 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-c6d4ce95-19db-47ad-89ac-1a505e2e62f6 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:05.772698 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-c6d4ce95-19db-47ad-89ac-1a505e2e62f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:05.833776 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 948/1896] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:05.841659 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de76d99-c624-4077-8438-a0e3668bf77c None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:05.841933 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de76d99-c624-4077-8438-a0e3668bf77c None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:05.842219 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de76d99-c624-4077-8438-a0e3668bf77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:05.861173 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-9de76d99-c624-4077-8438-a0e3668bf77c None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:05.862373 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-9de76d99-c624-4077-8438-a0e3668bf77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:05.870232 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 949/1897] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:05.875087 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4ce95-19db-47ad-89ac-1a505e2e62f6 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:05.884489 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4ce95-19db-47ad-89ac-1a505e2e62f6 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:05.889228 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5842a1-16ef-4c67-9a1f-bf9abe41b845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:05.889903 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5842a1-16ef-4c67-9a1f-bf9abe41b845 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:05.890183 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5842a1-16ef-4c67-9a1f-bf9abe41b845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:05.890458 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5842a1-16ef-4c67-9a1f-bf9abe41b845 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:05.891254 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5842a1-16ef-4c67-9a1f-bf9abe41b845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:15:05.891569 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5842a1-16ef-4c67-9a1f-bf9abe41b845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:05.893149 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5842a1-16ef-4c67-9a1f-bf9abe41b845 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:05.904721 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 949/1898] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:15:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:15:05.908646 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de76d99-c624-4077-8438-a0e3668bf77c None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:05.918688 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de76d99-c624-4077-8438-a0e3668bf77c None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:05.923727 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801e18a-b819-47f4-976a-c5bf87a3fd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:05.924368 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801e18a-b819-47f4-976a-c5bf87a3fd81 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:05.924653 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801e18a-b819-47f4-976a-c5bf87a3fd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:05.924929 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801e18a-b819-47f4-976a-c5bf87a3fd81 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:05.925641 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801e18a-b819-47f4-976a-c5bf87a3fd81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:05.927567 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801e18a-b819-47f4-976a-c5bf87a3fd81 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:06.029211 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 950/1899] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:15:05 2021] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:15:06.033335 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5842a1-16ef-4c67-9a1f-bf9abe41b845 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:06.044385 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5842a1-16ef-4c67-9a1f-bf9abe41b845 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:06.100449 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be781f-0f8f-4ff0-855f-2093fcaf6cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:06.101037 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be781f-0f8f-4ff0-855f-2093fcaf6cee admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:06.101319 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be781f-0f8f-4ff0-855f-2093fcaf6cee admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:06.101595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be781f-0f8f-4ff0-855f-2093fcaf6cee admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:06.102290 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be781f-0f8f-4ff0-855f-2093fcaf6cee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:06.104282 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be781f-0f8f-4ff0-855f-2093fcaf6cee admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:06.216921 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 950/1900] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:15:06 2021] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:06.220978 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801e18a-b819-47f4-976a-c5bf87a3fd81 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:06.231690 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801e18a-b819-47f4-976a-c5bf87a3fd81 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:06.236165 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62fd31-bd1d-4a37-b0aa-19bc1a9dc64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:06.236806 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62fd31-bd1d-4a37-b0aa-19bc1a9dc64f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:06.237088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62fd31-bd1d-4a37-b0aa-19bc1a9dc64f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:06.237363 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62fd31-bd1d-4a37-b0aa-19bc1a9dc64f admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:06.238127 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62fd31-bd1d-4a37-b0aa-19bc1a9dc64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:06.239735 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62fd31-bd1d-4a37-b0aa-19bc1a9dc64f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:06.249975 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 951/1901] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:06 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:06.253803 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be781f-0f8f-4ff0-855f-2093fcaf6cee admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:06.263778 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be781f-0f8f-4ff0-855f-2093fcaf6cee admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:06.268325 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56bc26-d86d-4c02-9c23-f36b667ece95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:06.268971 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56bc26-d86d-4c02-9c23-f36b667ece95 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:06.269256 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56bc26-d86d-4c02-9c23-f36b667ece95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:06.269533 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56bc26-d86d-4c02-9c23-f36b667ece95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:06.270264 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56bc26-d86d-4c02-9c23-f36b667ece95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:06.271877 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56bc26-d86d-4c02-9c23-f36b667ece95 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:06.282023 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 951/1902] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:06 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:06.286130 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62fd31-bd1d-4a37-b0aa-19bc1a9dc64f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:06.296649 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62fd31-bd1d-4a37-b0aa-19bc1a9dc64f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:06.301172 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6dd3a-a385-4f4c-8c5d-37011526a9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:06.302060 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6dd3a-a385-4f4c-8c5d-37011526a9fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:06.302324 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6dd3a-a385-4f4c-8c5d-37011526a9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:06.302600 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6dd3a-a385-4f4c-8c5d-37011526a9fc admin admin] PATH_INFO: `/v3/projects/d7d9cacc7c8340e78e071d06bd2401bd/users/1a4c7c06b5a24e8295b2a1686a272dcc/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:06.316613 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6dd3a-a385-4f4c-8c5d-37011526a9fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7d9cacc7c8340e78e071d06bd2401bd, user_id=1a4c7c06b5a24e8295b2a1686a272dcc, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:06.319308 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6dd3a-a385-4f4c-8c5d-37011526a9fc admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:06.394518 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 952/1903] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:06 2021] PUT /identity/v3/projects/d7d9cacc7c8340e78e071d06bd2401bd/users/1a4c7c06b5a24e8295b2a1686a272dcc/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:06.405339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee898cb-2a26-4f85-916c-bb2ce72e2842 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:06.405631 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee898cb-2a26-4f85-916c-bb2ce72e2842 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:06.405914 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee898cb-2a26-4f85-916c-bb2ce72e2842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:06.433184 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-6ee898cb-2a26-4f85-916c-bb2ce72e2842 None None] MFA Rules not processed for user `1a4c7c06b5a24e8295b2a1686a272dcc`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:06.434274 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-6ee898cb-2a26-4f85-916c-bb2ce72e2842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:06.496911 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 952/1904] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:06 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:06.501394 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6dd3a-a385-4f4c-8c5d-37011526a9fc admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:06.564930 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6dd3a-a385-4f4c-8c5d-37011526a9fc admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:06.569594 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cf592-2a4e-4a9a-8a34-d3d6163b1e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:06.570272 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cf592-2a4e-4a9a-8a34-d3d6163b1e06 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:06.570553 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cf592-2a4e-4a9a-8a34-d3d6163b1e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:06.570827 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cf592-2a4e-4a9a-8a34-d3d6163b1e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:06.571571 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cf592-2a4e-4a9a-8a34-d3d6163b1e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:06.573464 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cf592-2a4e-4a9a-8a34-d3d6163b1e06 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:06.658657 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 953/1905] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:15:06 2021] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:15:06.663985 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee898cb-2a26-4f85-916c-bb2ce72e2842 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:06.675057 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee898cb-2a26-4f85-916c-bb2ce72e2842 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:06.729365 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d20e18-df91-4029-be7b-c1b52893a278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:06.730130 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d20e18-df91-4029-be7b-c1b52893a278 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:06.730414 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d20e18-df91-4029-be7b-c1b52893a278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:06.730692 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d20e18-df91-4029-be7b-c1b52893a278 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:06.731416 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d20e18-df91-4029-be7b-c1b52893a278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:06.733298 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d20e18-df91-4029-be7b-c1b52893a278 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:06.838066 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 953/1906] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:15:06 2021] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:06.841815 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cf592-2a4e-4a9a-8a34-d3d6163b1e06 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:06.852525 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cf592-2a4e-4a9a-8a34-d3d6163b1e06 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:06.857789 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e6025-9a68-4fee-a4d0-1666a5b70b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:06.858459 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e6025-9a68-4fee-a4d0-1666a5b70b10 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:06.858740 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e6025-9a68-4fee-a4d0-1666a5b70b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:06.859156 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e6025-9a68-4fee-a4d0-1666a5b70b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:06.859951 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e6025-9a68-4fee-a4d0-1666a5b70b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:06.861532 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e6025-9a68-4fee-a4d0-1666a5b70b10 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:06.874070 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 954/1907] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:06 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:06.877958 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d20e18-df91-4029-be7b-c1b52893a278 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:06.888832 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d20e18-df91-4029-be7b-c1b52893a278 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:06.893544 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc743a1c-f244-4c65-bb0a-1dc612a9d586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:06.894210 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc743a1c-f244-4c65-bb0a-1dc612a9d586 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:06.894493 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc743a1c-f244-4c65-bb0a-1dc612a9d586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:06.894773 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc743a1c-f244-4c65-bb0a-1dc612a9d586 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:06.895543 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc743a1c-f244-4c65-bb0a-1dc612a9d586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:06.897118 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc743a1c-f244-4c65-bb0a-1dc612a9d586 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:06.907788 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 954/1908] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:06.912608 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e6025-9a68-4fee-a4d0-1666a5b70b10 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:06.931651 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e6025-9a68-4fee-a4d0-1666a5b70b10 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:06.937168 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58efd9c-1dca-4a3f-bfc7-189df3c91637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:06.938054 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58efd9c-1dca-4a3f-bfc7-189df3c91637 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:06.938335 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58efd9c-1dca-4a3f-bfc7-189df3c91637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:06.938607 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58efd9c-1dca-4a3f-bfc7-189df3c91637 admin admin] PATH_INFO: `/v3/projects/2c066874b4524003b9c1656cc2a19740/users/dd1e97d06ded4b59a2c375b80205c0d5/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:06.954094 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58efd9c-1dca-4a3f-bfc7-189df3c91637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c066874b4524003b9c1656cc2a19740, user_id=dd1e97d06ded4b59a2c375b80205c0d5, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:06.957754 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58efd9c-1dca-4a3f-bfc7-189df3c91637 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:07.070663 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 955/1909] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:06 2021] PUT /identity/v3/projects/2c066874b4524003b9c1656cc2a19740/users/dd1e97d06ded4b59a2c375b80205c0d5/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:07.082255 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94b0eb-248b-4081-9807-3f47cd71f40d None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:07.082555 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94b0eb-248b-4081-9807-3f47cd71f40d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:07.082839 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94b0eb-248b-4081-9807-3f47cd71f40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:07.109562 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-9d94b0eb-248b-4081-9807-3f47cd71f40d None None] MFA Rules not processed for user `dd1e97d06ded4b59a2c375b80205c0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:07.110757 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-9d94b0eb-248b-4081-9807-3f47cd71f40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:07.179272 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 955/1910] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:07 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:07.184416 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58efd9c-1dca-4a3f-bfc7-189df3c91637 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:07.242645 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58efd9c-1dca-4a3f-bfc7-189df3c91637 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:07.247873 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b914eb-5d07-48ab-a1e1-d8b599d8af6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:07.248542 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b914eb-5d07-48ab-a1e1-d8b599d8af6c admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:07.248823 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b914eb-5d07-48ab-a1e1-d8b599d8af6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:07.249096 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b914eb-5d07-48ab-a1e1-d8b599d8af6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:07.249799 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b914eb-5d07-48ab-a1e1-d8b599d8af6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:07.251700 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b914eb-5d07-48ab-a1e1-d8b599d8af6c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:07.349156 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 956/1911] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:15:07 2021] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:15:07.352975 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94b0eb-248b-4081-9807-3f47cd71f40d None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:07.364475 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94b0eb-248b-4081-9807-3f47cd71f40d None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:07.421690 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647c058-838e-40d3-afa6-216bedef972e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:07.422368 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647c058-838e-40d3-afa6-216bedef972e admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:07.422661 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647c058-838e-40d3-afa6-216bedef972e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:07.422948 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647c058-838e-40d3-afa6-216bedef972e admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:07.423673 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647c058-838e-40d3-afa6-216bedef972e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:07.425686 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647c058-838e-40d3-afa6-216bedef972e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:07.639875 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 956/1912] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:15:07 2021] POST /identity/v3/users => generated 295 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:07.644798 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b914eb-5d07-48ab-a1e1-d8b599d8af6c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:07.656453 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b914eb-5d07-48ab-a1e1-d8b599d8af6c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:07.661854 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82016a39-4bf9-4724-80b7-29b61663868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:07.662522 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82016a39-4bf9-4724-80b7-29b61663868e admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:07.662828 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82016a39-4bf9-4724-80b7-29b61663868e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:07.663102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82016a39-4bf9-4724-80b7-29b61663868e admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:07.663884 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82016a39-4bf9-4724-80b7-29b61663868e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:07.665740 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82016a39-4bf9-4724-80b7-29b61663868e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:07.681757 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 957/1913] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:07 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:07.689823 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647c058-838e-40d3-afa6-216bedef972e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:07.700212 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647c058-838e-40d3-afa6-216bedef972e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:07.705047 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be043a-54eb-428a-ab4f-244647b3e7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:07.705932 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be043a-54eb-428a-ab4f-244647b3e7a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:07.706215 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be043a-54eb-428a-ab4f-244647b3e7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:07.706490 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be043a-54eb-428a-ab4f-244647b3e7a6 admin admin] PATH_INFO: `/v3/projects/be97224b38be40f4a409375d09498d82/users/bcddc2fa4a40426898e167760e41fbec/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:07.721514 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be043a-54eb-428a-ab4f-244647b3e7a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be97224b38be40f4a409375d09498d82, user_id=bcddc2fa4a40426898e167760e41fbec, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:07.724200 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be043a-54eb-428a-ab4f-244647b3e7a6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:07.800088 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 957/1914] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:07 2021] PUT /identity/v3/projects/be97224b38be40f4a409375d09498d82/users/bcddc2fa4a40426898e167760e41fbec/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:07.804036 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82016a39-4bf9-4724-80b7-29b61663868e admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:07.813810 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82016a39-4bf9-4724-80b7-29b61663868e admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:07.874969 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801fc0b-89f2-474e-a505-e7bca9c2270c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:07.875853 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801fc0b-89f2-474e-a505-e7bca9c2270c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:07.876210 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801fc0b-89f2-474e-a505-e7bca9c2270c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:07.876565 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801fc0b-89f2-474e-a505-e7bca9c2270c admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:07.877386 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801fc0b-89f2-474e-a505-e7bca9c2270c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:07.879089 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801fc0b-89f2-474e-a505-e7bca9c2270c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:07.893310 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 958/1915] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:07 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:07.894369 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be043a-54eb-428a-ab4f-244647b3e7a6 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:07.905497 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be043a-54eb-428a-ab4f-244647b3e7a6 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:07.910773 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b0b27-34fb-4d91-aa7e-9da17af605aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:07.911695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b0b27-34fb-4d91-aa7e-9da17af605aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:07.911987 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b0b27-34fb-4d91-aa7e-9da17af605aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:07.912258 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b0b27-34fb-4d91-aa7e-9da17af605aa admin admin] PATH_INFO: `/v3/projects/be97224b38be40f4a409375d09498d82/users/bcddc2fa4a40426898e167760e41fbec/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:07.914302 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b0b27-34fb-4d91-aa7e-9da17af605aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=be97224b38be40f4a409375d09498d82, user_id=bcddc2fa4a40426898e167760e41fbec, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:07.917212 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b0b27-34fb-4d91-aa7e-9da17af605aa admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:07.951514 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 958/1916] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:07 2021] PUT /identity/v3/projects/be97224b38be40f4a409375d09498d82/users/bcddc2fa4a40426898e167760e41fbec/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:15:07.962261 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735690e-773b-4490-a7ff-a47e54eb5d3f None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:07.962653 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735690e-773b-4490-a7ff-a47e54eb5d3f None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:07.962996 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735690e-773b-4490-a7ff-a47e54eb5d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:07.991316 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-9735690e-773b-4490-a7ff-a47e54eb5d3f None None] MFA Rules not processed for user `bcddc2fa4a40426898e167760e41fbec`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:07.992874 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-9735690e-773b-4490-a7ff-a47e54eb5d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:08.071144 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 959/1917] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:07 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:08.137136 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b0b27-34fb-4d91-aa7e-9da17af605aa admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:08.138827 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-6c8b0b27-34fb-4d91-aa7e-9da17af605aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:08.200762 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b0b27-34fb-4d91-aa7e-9da17af605aa admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:08.204653 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc1e75-b504-4d8f-99b8-e96090902922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:08.205404 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc1e75-b504-4d8f-99b8-e96090902922 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:08.205771 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc1e75-b504-4d8f-99b8-e96090902922 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:08.206137 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc1e75-b504-4d8f-99b8-e96090902922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:08.216143 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc1e75-b504-4d8f-99b8-e96090902922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:08.217627 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc1e75-b504-4d8f-99b8-e96090902922 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:08.230918 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 959/1918] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:08 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:08.384802 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735690e-773b-4490-a7ff-a47e54eb5d3f None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:08.386862 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-9735690e-773b-4490-a7ff-a47e54eb5d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:08.398343 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735690e-773b-4490-a7ff-a47e54eb5d3f None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:08.402049 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e4c99-c893-4cef-bd89-422ef9cd3626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:08.402714 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e4c99-c893-4cef-bd89-422ef9cd3626 service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:08.402959 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e4c99-c893-4cef-bd89-422ef9cd3626 service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:08.403317 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e4c99-c893-4cef-bd89-422ef9cd3626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:08.470262 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e4c99-c893-4cef-bd89-422ef9cd3626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:08.471762 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e4c99-c893-4cef-bd89-422ef9cd3626 service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:08.483108 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 960/1919] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:08 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:14.921606 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc1e75-b504-4d8f-99b8-e96090902922 service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:14.989028 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc1e75-b504-4d8f-99b8-e96090902922 service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:14.993676 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49858d8-7400-4606-b734-6d4369a62f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:14.994530 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49858d8-7400-4606-b734-6d4369a62f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:14.994810 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49858d8-7400-4606-b734-6d4369a62f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:15.004917 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49858d8-7400-4606-b734-6d4369a62f88 admin admin] PATH_INFO: `/v3/users/1a4c7c06b5a24e8295b2a1686a272dcc` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:15.004917 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49858d8-7400-4606-b734-6d4369a62f88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a4c7c06b5a24e8295b2a1686a272dcc)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:15.004917 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49858d8-7400-4606-b734-6d4369a62f88 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:15.251115 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-e49858d8-7400-4606-b734-6d4369a62f88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a4c7c06b5a24e8295b2a1686a272dcc'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:15.328443 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-e49858d8-7400-4606-b734-6d4369a62f88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a4c7c06b5a24e8295b2a1686a272dcc'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:15.335727 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-e49858d8-7400-4606-b734-6d4369a62f88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a4c7c06b5a24e8295b2a1686a272dcc'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:15.336374 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-e49858d8-7400-4606-b734-6d4369a62f88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a4c7c06b5a24e8295b2a1686a272dcc'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:15.347806 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-e49858d8-7400-4606-b734-6d4369a62f88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a4c7c06b5a24e8295b2a1686a272dcc'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:15.353577 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 960/1920] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:14 2021] DELETE /identity/v3/users/1a4c7c06b5a24e8295b2a1686a272dcc => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:15.358117 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e5092-284b-4f23-8d4c-4afa1b2dc010 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:15.358625 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e5092-284b-4f23-8d4c-4afa1b2dc010 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:15.358757 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e5092-284b-4f23-8d4c-4afa1b2dc010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:15.376123 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-b87e5092-284b-4f23-8d4c-4afa1b2dc010 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:15.377326 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-b87e5092-284b-4f23-8d4c-4afa1b2dc010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:15.436155 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 961/1921] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:15.446374 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49858d8-7400-4606-b734-6d4369a62f88 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:15.448034 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e49858d8-7400-4606-b734-6d4369a62f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:15.518512 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49858d8-7400-4606-b734-6d4369a62f88 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:15.522528 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748aad9-b5d4-4421-b941-b55434afa251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:15.523176 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748aad9-b5d4-4421-b941-b55434afa251 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:15.523487 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748aad9-b5d4-4421-b941-b55434afa251 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:15.523759 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748aad9-b5d4-4421-b941-b55434afa251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:15.534111 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748aad9-b5d4-4421-b941-b55434afa251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:15.535566 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748aad9-b5d4-4421-b941-b55434afa251 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:15.546978 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 961/1922] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:16.069434 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e5092-284b-4f23-8d4c-4afa1b2dc010 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:16.071329 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-b87e5092-284b-4f23-8d4c-4afa1b2dc010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:16.082979 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e5092-284b-4f23-8d4c-4afa1b2dc010 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:16.087645 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b3dc2-262f-4829-ba85-36aee157a413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:16.088493 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b3dc2-262f-4829-ba85-36aee157a413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:16.088781 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b3dc2-262f-4829-ba85-36aee157a413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:16.089572 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b3dc2-262f-4829-ba85-36aee157a413 admin admin] PATH_INFO: `/v3/projects/d7d9cacc7c8340e78e071d06bd2401bd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:16.091107 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b3dc2-262f-4829-ba85-36aee157a413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7d9cacc7c8340e78e071d06bd2401bd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:16.093031 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b3dc2-262f-4829-ba85-36aee157a413 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:16.142265 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748aad9-b5d4-4421-b941-b55434afa251 service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:16.143800 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-c748aad9-b5d4-4421-b941-b55434afa251 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:16.157052 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748aad9-b5d4-4421-b941-b55434afa251 service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:16.161896 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536ba29-63ef-4591-9754-ec99a0906801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:16.166434 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536ba29-63ef-4591-9754-ec99a0906801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:16.166434 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536ba29-63ef-4591-9754-ec99a0906801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:16.166434 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536ba29-63ef-4591-9754-ec99a0906801 admin admin] PATH_INFO: `/v3/users/e5e75364ac154c3487844761334ac030` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:16.166434 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536ba29-63ef-4591-9754-ec99a0906801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5e75364ac154c3487844761334ac030)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:16.166795 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536ba29-63ef-4591-9754-ec99a0906801 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:16.204868 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-fe1b3dc2-262f-4829-ba85-36aee157a413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7d9cacc7c8340e78e071d06bd2401bd', 'request_id': 'req-fe1b3dc2-262f-4829-ba85-36aee157a413'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:16.210780 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-fe1b3dc2-262f-4829-ba85-36aee157a413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7d9cacc7c8340e78e071d06bd2401bd', 'request_id': 'req-fe1b3dc2-262f-4829-ba85-36aee157a413'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:16.216606 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-fe1b3dc2-262f-4829-ba85-36aee157a413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7d9cacc7c8340e78e071d06bd2401bd', 'request_id': 'req-fe1b3dc2-262f-4829-ba85-36aee157a413'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:16.321885 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-fe1b3dc2-262f-4829-ba85-36aee157a413 admin admin] The token cache is being invalidate because project d7d9cacc7c8340e78e071d06bd2401bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:16.322275 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-fe1b3dc2-262f-4829-ba85-36aee157a413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:16.322898 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-fe1b3dc2-262f-4829-ba85-36aee157a413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:16.325394 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 962/1923] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:16 2021] DELETE /identity/v3/projects/d7d9cacc7c8340e78e071d06bd2401bd => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:16.329190 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b3dc2-262f-4829-ba85-36aee157a413 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:16.330763 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-fe1b3dc2-262f-4829-ba85-36aee157a413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:16.387772 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-3536ba29-63ef-4591-9754-ec99a0906801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5e75364ac154c3487844761334ac030'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:16.392716 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b3dc2-262f-4829-ba85-36aee157a413 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:16.397318 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc0f68-ef41-476b-a0d4-cdde02bd2734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:16.398168 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc0f68-ef41-476b-a0d4-cdde02bd2734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:16.398449 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc0f68-ef41-476b-a0d4-cdde02bd2734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:16.398715 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc0f68-ef41-476b-a0d4-cdde02bd2734 admin admin] PATH_INFO: `/v3/users/dd1e97d06ded4b59a2c375b80205c0d5` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:16.399930 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc0f68-ef41-476b-a0d4-cdde02bd2734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd1e97d06ded4b59a2c375b80205c0d5)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:16.402624 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc0f68-ef41-476b-a0d4-cdde02bd2734 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:16.473479 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-3536ba29-63ef-4591-9754-ec99a0906801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5e75364ac154c3487844761334ac030'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:16.481079 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-3536ba29-63ef-4591-9754-ec99a0906801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5e75364ac154c3487844761334ac030'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:16.481720 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-3536ba29-63ef-4591-9754-ec99a0906801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5e75364ac154c3487844761334ac030'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:16.493033 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-3536ba29-63ef-4591-9754-ec99a0906801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5e75364ac154c3487844761334ac030'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:16.499068 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 962/1924] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:16 2021] DELETE /identity/v3/users/e5e75364ac154c3487844761334ac030 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:15:16.503673 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fb70d-25a7-476b-8801-dcb3bef1731d None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:16.503968 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fb70d-25a7-476b-8801-dcb3bef1731d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:16.504252 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fb70d-25a7-476b-8801-dcb3bef1731d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:16.521894 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-5e9fb70d-25a7-476b-8801-dcb3bef1731d None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:16.530462 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-5e9fb70d-25a7-476b-8801-dcb3bef1731d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:16.580743 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 963/1925] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:15:16.593566 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fb70d-25a7-476b-8801-dcb3bef1731d None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:16.593566 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-5e9fb70d-25a7-476b-8801-dcb3bef1731d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:16.603902 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c7bc0f68-ef41-476b-a0d4-cdde02bd2734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd1e97d06ded4b59a2c375b80205c0d5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:16.657851 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fb70d-25a7-476b-8801-dcb3bef1731d None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:16.663176 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5047c-d6c7-4215-966b-ea5ce5709c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:16.664688 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5047c-d6c7-4215-966b-ea5ce5709c94 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:16.665348 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5047c-d6c7-4215-966b-ea5ce5709c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:16.665727 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5047c-d6c7-4215-966b-ea5ce5709c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:16.673833 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c7bc0f68-ef41-476b-a0d4-cdde02bd2734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd1e97d06ded4b59a2c375b80205c0d5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:16.677174 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5047c-d6c7-4215-966b-ea5ce5709c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:16.678683 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5047c-d6c7-4215-966b-ea5ce5709c94 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:16.690145 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 964/1926] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:16.691284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c7bc0f68-ef41-476b-a0d4-cdde02bd2734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd1e97d06ded4b59a2c375b80205c0d5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:16.692018 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c7bc0f68-ef41-476b-a0d4-cdde02bd2734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd1e97d06ded4b59a2c375b80205c0d5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:16.705026 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c7bc0f68-ef41-476b-a0d4-cdde02bd2734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd1e97d06ded4b59a2c375b80205c0d5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:16.712425 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 963/1927] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:16 2021] DELETE /identity/v3/users/dd1e97d06ded4b59a2c375b80205c0d5 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:15:17.280532 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5047c-d6c7-4215-966b-ea5ce5709c94 service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:17.280532 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-ada5047c-d6c7-4215-966b-ea5ce5709c94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:17.282825 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc0f68-ef41-476b-a0d4-cdde02bd2734 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:17.285513 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c7bc0f68-ef41-476b-a0d4-cdde02bd2734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:17.293884 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5047c-d6c7-4215-966b-ea5ce5709c94 service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:17.366526 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59463ba9-7173-4ee5-ac73-d628340e0b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:17.367894 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59463ba9-7173-4ee5-ac73-d628340e0b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:17.368179 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59463ba9-7173-4ee5-ac73-d628340e0b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:17.368515 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59463ba9-7173-4ee5-ac73-d628340e0b81 admin admin] PATH_INFO: `/v3/projects/ea9ac003bc79415f8aac0ee3f69649ad` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:17.370104 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59463ba9-7173-4ee5-ac73-d628340e0b81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea9ac003bc79415f8aac0ee3f69649ad)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:17.373857 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59463ba9-7173-4ee5-ac73-d628340e0b81 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:17.377483 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc0f68-ef41-476b-a0d4-cdde02bd2734 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:17.383797 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed083089-32c8-4d39-bf5c-25234a8870f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:17.385171 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed083089-32c8-4d39-bf5c-25234a8870f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:17.385464 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed083089-32c8-4d39-bf5c-25234a8870f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:17.385741 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed083089-32c8-4d39-bf5c-25234a8870f6 admin admin] PATH_INFO: `/v3/projects/2c066874b4524003b9c1656cc2a19740` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:17.388452 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed083089-32c8-4d39-bf5c-25234a8870f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c066874b4524003b9c1656cc2a19740)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:17.390669 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed083089-32c8-4d39-bf5c-25234a8870f6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:17.526118 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-ed083089-32c8-4d39-bf5c-25234a8870f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c066874b4524003b9c1656cc2a19740', 'request_id': 'req-ed083089-32c8-4d39-bf5c-25234a8870f6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:17.527859 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-59463ba9-7173-4ee5-ac73-d628340e0b81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9ac003bc79415f8aac0ee3f69649ad', 'request_id': 'req-59463ba9-7173-4ee5-ac73-d628340e0b81'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:17.533430 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-ed083089-32c8-4d39-bf5c-25234a8870f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c066874b4524003b9c1656cc2a19740', 'request_id': 'req-ed083089-32c8-4d39-bf5c-25234a8870f6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:17.534426 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-59463ba9-7173-4ee5-ac73-d628340e0b81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9ac003bc79415f8aac0ee3f69649ad', 'request_id': 'req-59463ba9-7173-4ee5-ac73-d628340e0b81'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:17.539032 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-ed083089-32c8-4d39-bf5c-25234a8870f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c066874b4524003b9c1656cc2a19740', 'request_id': 'req-ed083089-32c8-4d39-bf5c-25234a8870f6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:17.539814 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-59463ba9-7173-4ee5-ac73-d628340e0b81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9ac003bc79415f8aac0ee3f69649ad', 'request_id': 'req-59463ba9-7173-4ee5-ac73-d628340e0b81'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:17.654009 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-ed083089-32c8-4d39-bf5c-25234a8870f6 admin admin] The token cache is being invalidate because project 2c066874b4524003b9c1656cc2a19740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:17.654308 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-ed083089-32c8-4d39-bf5c-25234a8870f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:17.654943 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-ed083089-32c8-4d39-bf5c-25234a8870f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:17.656525 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 964/1928] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:17 2021] DELETE /identity/v3/projects/2c066874b4524003b9c1656cc2a19740 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:17.660487 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed083089-32c8-4d39-bf5c-25234a8870f6 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:17.661882 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-ed083089-32c8-4d39-bf5c-25234a8870f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:17.724590 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-59463ba9-7173-4ee5-ac73-d628340e0b81 admin admin] The token cache is being invalidate because project ea9ac003bc79415f8aac0ee3f69649ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:17.724966 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-59463ba9-7173-4ee5-ac73-d628340e0b81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:17.725653 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-59463ba9-7173-4ee5-ac73-d628340e0b81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:17.727176 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 965/1929] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:17 2021] DELETE /identity/v3/projects/ea9ac003bc79415f8aac0ee3f69649ad => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:17.728049 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed083089-32c8-4d39-bf5c-25234a8870f6 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:17.731671 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59463ba9-7173-4ee5-ac73-d628340e0b81 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:17.735733 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-59463ba9-7173-4ee5-ac73-d628340e0b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:17.735897 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e182c90-6cd4-4c88-8cda-83e310d566b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:17.736218 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e182c90-6cd4-4c88-8cda-83e310d566b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:17.736503 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e182c90-6cd4-4c88-8cda-83e310d566b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:17.736783 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e182c90-6cd4-4c88-8cda-83e310d566b8 admin admin] PATH_INFO: `/v3/users/bcddc2fa4a40426898e167760e41fbec` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:17.738014 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e182c90-6cd4-4c88-8cda-83e310d566b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcddc2fa4a40426898e167760e41fbec)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:17.739973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e182c90-6cd4-4c88-8cda-83e310d566b8 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:17.799586 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59463ba9-7173-4ee5-ac73-d628340e0b81 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:17.808401 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba437e-329a-4f71-9368-289a8162ab22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:17.809612 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba437e-329a-4f71-9368-289a8162ab22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:17.810179 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba437e-329a-4f71-9368-289a8162ab22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:17.810665 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba437e-329a-4f71-9368-289a8162ab22 admin admin] PATH_INFO: `/v3/users/cf7f3231a3dc4e87a5ae104122104793` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:17.813867 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba437e-329a-4f71-9368-289a8162ab22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf7f3231a3dc4e87a5ae104122104793)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:17.816279 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba437e-329a-4f71-9368-289a8162ab22 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:17.940090 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8e182c90-6cd4-4c88-8cda-83e310d566b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcddc2fa4a40426898e167760e41fbec'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:18.036908 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8e182c90-6cd4-4c88-8cda-83e310d566b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcddc2fa4a40426898e167760e41fbec'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:18.044773 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8e182c90-6cd4-4c88-8cda-83e310d566b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcddc2fa4a40426898e167760e41fbec'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:18.047375 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8e182c90-6cd4-4c88-8cda-83e310d566b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcddc2fa4a40426898e167760e41fbec'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:18.056624 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8e182c90-6cd4-4c88-8cda-83e310d566b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcddc2fa4a40426898e167760e41fbec'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:18.063057 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 965/1930] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:17 2021] DELETE /identity/v3/users/bcddc2fa4a40426898e167760e41fbec => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:15:18.087739 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-75ba437e-329a-4f71-9368-289a8162ab22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf7f3231a3dc4e87a5ae104122104793'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:18.171055 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-75ba437e-329a-4f71-9368-289a8162ab22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf7f3231a3dc4e87a5ae104122104793'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:18.178868 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-75ba437e-329a-4f71-9368-289a8162ab22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf7f3231a3dc4e87a5ae104122104793'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:18.179889 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-75ba437e-329a-4f71-9368-289a8162ab22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf7f3231a3dc4e87a5ae104122104793'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:18.191395 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-75ba437e-329a-4f71-9368-289a8162ab22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf7f3231a3dc4e87a5ae104122104793'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:18.197047 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 966/1931] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:17 2021] DELETE /identity/v3/users/cf7f3231a3dc4e87a5ae104122104793 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:15:18.503165 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e182c90-6cd4-4c88-8cda-83e310d566b8 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:18.504759 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-8e182c90-6cd4-4c88-8cda-83e310d566b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:18.579306 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e182c90-6cd4-4c88-8cda-83e310d566b8 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:18.633207 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b42e5-64a1-4e41-93eb-0ca0f655361f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:18.634057 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b42e5-64a1-4e41-93eb-0ca0f655361f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:18.634344 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b42e5-64a1-4e41-93eb-0ca0f655361f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:18.634626 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b42e5-64a1-4e41-93eb-0ca0f655361f admin admin] PATH_INFO: `/v3/projects/be97224b38be40f4a409375d09498d82` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:18.636360 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b42e5-64a1-4e41-93eb-0ca0f655361f admin admin] RBAC: Authorizing `identity:delete_project(project_id=be97224b38be40f4a409375d09498d82)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:18.638856 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b42e5-64a1-4e41-93eb-0ca0f655361f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:18.696033 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba437e-329a-4f71-9368-289a8162ab22 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:18.697604 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-75ba437e-329a-4f71-9368-289a8162ab22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:18.711697 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba437e-329a-4f71-9368-289a8162ab22 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:18.716987 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923be837-c436-4bfe-9009-4a7c3b9961e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:18.720527 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923be837-c436-4bfe-9009-4a7c3b9961e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:18.720527 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923be837-c436-4bfe-9009-4a7c3b9961e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:18.720527 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923be837-c436-4bfe-9009-4a7c3b9961e2 admin admin] PATH_INFO: `/v3/projects/c7428447081841efbbecf2c62a621f18` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:18.720527 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923be837-c436-4bfe-9009-4a7c3b9961e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7428447081841efbbecf2c62a621f18)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:18.721491 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923be837-c436-4bfe-9009-4a7c3b9961e2 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:18.786296 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0a8b42e5-64a1-4e41-93eb-0ca0f655361f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be97224b38be40f4a409375d09498d82', 'request_id': 'req-0a8b42e5-64a1-4e41-93eb-0ca0f655361f'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:18.793129 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0a8b42e5-64a1-4e41-93eb-0ca0f655361f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be97224b38be40f4a409375d09498d82', 'request_id': 'req-0a8b42e5-64a1-4e41-93eb-0ca0f655361f'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:18.798399 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0a8b42e5-64a1-4e41-93eb-0ca0f655361f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be97224b38be40f4a409375d09498d82', 'request_id': 'req-0a8b42e5-64a1-4e41-93eb-0ca0f655361f'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:18.867518 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-923be837-c436-4bfe-9009-4a7c3b9961e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7428447081841efbbecf2c62a621f18', 'request_id': 'req-923be837-c436-4bfe-9009-4a7c3b9961e2'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:18.876521 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-923be837-c436-4bfe-9009-4a7c3b9961e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7428447081841efbbecf2c62a621f18', 'request_id': 'req-923be837-c436-4bfe-9009-4a7c3b9961e2'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:18.888858 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-923be837-c436-4bfe-9009-4a7c3b9961e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7428447081841efbbecf2c62a621f18', 'request_id': 'req-923be837-c436-4bfe-9009-4a7c3b9961e2'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:18.907556 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0a8b42e5-64a1-4e41-93eb-0ca0f655361f admin admin] The token cache is being invalidate because project be97224b38be40f4a409375d09498d82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:18.907866 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0a8b42e5-64a1-4e41-93eb-0ca0f655361f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:18.908497 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0a8b42e5-64a1-4e41-93eb-0ca0f655361f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:18.910029 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 966/1932] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:18 2021] DELETE /identity/v3/projects/be97224b38be40f4a409375d09498d82 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:18.926159 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3850e-7245-442b-a541-c532c996d1ea None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:18.926590 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3850e-7245-442b-a541-c532c996d1ea None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:18.926878 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3850e-7245-442b-a541-c532c996d1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:18.946222 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-7af3850e-7245-442b-a541-c532c996d1ea None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:18.947608 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-7af3850e-7245-442b-a541-c532c996d1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:19.009238 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 967/1933] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:15:19.018015 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886fe94-3bf4-42b4-b9d9-bbdce64dd00b None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:19.018292 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886fe94-3bf4-42b4-b9d9-bbdce64dd00b None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:19.018575 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886fe94-3bf4-42b4-b9d9-bbdce64dd00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:19.022023 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-923be837-c436-4bfe-9009-4a7c3b9961e2 admin admin] The token cache is being invalidate because project c7428447081841efbbecf2c62a621f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:19.022317 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-923be837-c436-4bfe-9009-4a7c3b9961e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:19.023215 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-923be837-c436-4bfe-9009-4a7c3b9961e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:19.026061 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 967/1934] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:18 2021] DELETE /identity/v3/projects/c7428447081841efbbecf2c62a621f18 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:19.034151 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9253fc-778f-4afb-84f4-4c5ac185b585 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:19.034440 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9253fc-778f-4afb-84f4-4c5ac185b585 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:19.034747 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9253fc-778f-4afb-84f4-4c5ac185b585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:19.037446 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-c886fe94-3bf4-42b4-b9d9-bbdce64dd00b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:19.038717 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c886fe94-3bf4-42b4-b9d9-bbdce64dd00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:19.047989 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 968/1935] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:15:19.052160 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886fe94-3bf4-42b4-b9d9-bbdce64dd00b None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:19.056784 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-8b9253fc-778f-4afb-84f4-4c5ac185b585 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:19.058188 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-8b9253fc-778f-4afb-84f4-4c5ac185b585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:19.061377 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886fe94-3bf4-42b4-b9d9-bbdce64dd00b None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:19.066695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 968/1936] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:15:19.072205 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bf9ae-f0b6-458e-9170-5ed03fc06c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:19.073905 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bf9ae-f0b6-458e-9170-5ed03fc06c04 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:19.074262 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bf9ae-f0b6-458e-9170-5ed03fc06c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:19.074567 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bf9ae-f0b6-458e-9170-5ed03fc06c04 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:19.075348 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bf9ae-f0b6-458e-9170-5ed03fc06c04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:15:19.075612 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42dfe1-2360-44d9-afdd-409b55e9b1cc None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:19.075721 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bf9ae-f0b6-458e-9170-5ed03fc06c04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:19.075891 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42dfe1-2360-44d9-afdd-409b55e9b1cc None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:19.076153 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42dfe1-2360-44d9-afdd-409b55e9b1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:19.077277 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bf9ae-f0b6-458e-9170-5ed03fc06c04 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:19.090986 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 969/1937] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:15:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 04:15:19.098320 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bf9ae-f0b6-458e-9170-5ed03fc06c04 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:19.098489 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-4d42dfe1-2360-44d9-afdd-409b55e9b1cc None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:19.099725 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-4d42dfe1-2360-44d9-afdd-409b55e9b1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:19.108707 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 969/1938] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:19.109504 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bf9ae-f0b6-458e-9170-5ed03fc06c04 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:19.113077 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42dfe1-2360-44d9-afdd-409b55e9b1cc None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:19.115482 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdef1e4-3a5f-4cfa-9982-3c5cba0621f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:19.116321 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdef1e4-3a5f-4cfa-9982-3c5cba0621f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:19.116765 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdef1e4-3a5f-4cfa-9982-3c5cba0621f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:19.117188 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdef1e4-3a5f-4cfa-9982-3c5cba0621f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:19.119188 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdef1e4-3a5f-4cfa-9982-3c5cba0621f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:19.122206 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdef1e4-3a5f-4cfa-9982-3c5cba0621f7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:19.123602 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42dfe1-2360-44d9-afdd-409b55e9b1cc None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:19.129021 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0968f1-e239-43e9-884a-10f358716387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:19.129760 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0968f1-e239-43e9-884a-10f358716387 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:19.130111 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0968f1-e239-43e9-884a-10f358716387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:19.130516 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0968f1-e239-43e9-884a-10f358716387 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:19.131418 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0968f1-e239-43e9-884a-10f358716387 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:15:19.131790 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0968f1-e239-43e9-884a-10f358716387 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:19.133499 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0968f1-e239-43e9-884a-10f358716387 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:19.153373 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 970/1939] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:15:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 04:15:19.154855 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0968f1-e239-43e9-884a-10f358716387 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:19.164631 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0968f1-e239-43e9-884a-10f358716387 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:19.170442 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3e33f-b537-4b32-9bd7-559d7bcb78e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:19.171086 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3e33f-b537-4b32-9bd7-559d7bcb78e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:19.171404 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3e33f-b537-4b32-9bd7-559d7bcb78e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:19.171681 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3e33f-b537-4b32-9bd7-559d7bcb78e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:19.172383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3e33f-b537-4b32-9bd7-559d7bcb78e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:19.174252 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3e33f-b537-4b32-9bd7-559d7bcb78e2 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:19.223413 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 970/1940] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:15:19 2021] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:15:19.227624 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdef1e4-3a5f-4cfa-9982-3c5cba0621f7 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:19.285951 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdef1e4-3a5f-4cfa-9982-3c5cba0621f7 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:19.293464 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 971/1941] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:15:19 2021] POST /identity/v3/projects => generated 367 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:19.293626 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab376c-1b91-4fe7-a180-cd755f0a7f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:19.293626 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab376c-1b91-4fe7-a180-cd755f0a7f91 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:19.293626 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab376c-1b91-4fe7-a180-cd755f0a7f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:19.293626 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab376c-1b91-4fe7-a180-cd755f0a7f91 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:19.293975 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab376c-1b91-4fe7-a180-cd755f0a7f91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:19.294575 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3e33f-b537-4b32-9bd7-559d7bcb78e2 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:19.295894 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab376c-1b91-4fe7-a180-cd755f0a7f91 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:19.353479 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3e33f-b537-4b32-9bd7-559d7bcb78e2 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:19.358304 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae49ed-30a3-43a3-a7a4-806abc70309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:19.358995 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae49ed-30a3-43a3-a7a4-806abc70309d admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:19.359306 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae49ed-30a3-43a3-a7a4-806abc70309d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:19.359589 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae49ed-30a3-43a3-a7a4-806abc70309d admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:19.360284 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae49ed-30a3-43a3-a7a4-806abc70309d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:19.362184 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae49ed-30a3-43a3-a7a4-806abc70309d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:19.394058 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 971/1942] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:15:19 2021] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:15:19.398135 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab376c-1b91-4fe7-a180-cd755f0a7f91 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:19.408238 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab376c-1b91-4fe7-a180-cd755f0a7f91 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:19.413234 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c88730-306f-45b4-8d64-7c411680f702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:19.413967 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c88730-306f-45b4-8d64-7c411680f702 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:19.414248 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c88730-306f-45b4-8d64-7c411680f702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:19.414522 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c88730-306f-45b4-8d64-7c411680f702 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:19.415563 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c88730-306f-45b4-8d64-7c411680f702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:19.417194 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c88730-306f-45b4-8d64-7c411680f702 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:19.426879 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 972/1943] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:19 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:15:19.430535 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c88730-306f-45b4-8d64-7c411680f702 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:19.440431 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c88730-306f-45b4-8d64-7c411680f702 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:19.445015 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d08a05-5135-419e-8767-3eb1386dab24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:19.449358 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d08a05-5135-419e-8767-3eb1386dab24 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:19.449358 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d08a05-5135-419e-8767-3eb1386dab24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:19.449358 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d08a05-5135-419e-8767-3eb1386dab24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:19.449358 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d08a05-5135-419e-8767-3eb1386dab24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:19.449358 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d08a05-5135-419e-8767-3eb1386dab24 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:19.465537 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 973/1944] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:19 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:15:19.466936 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d08a05-5135-419e-8767-3eb1386dab24 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:19.477553 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d08a05-5135-419e-8767-3eb1386dab24 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:19.483436 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ebb97-4b1d-4c96-afbb-6837bd7de99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:19.484973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ebb97-4b1d-4c96-afbb-6837bd7de99c admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:19.485253 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ebb97-4b1d-4c96-afbb-6837bd7de99c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:19.485531 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ebb97-4b1d-4c96-afbb-6837bd7de99c admin admin] PATH_INFO: `/v3/projects/b50cd74c0d06434da0871915bc7c1568/users/1266e809c6ec4d1391f75faa5055863b/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:19.500833 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ebb97-4b1d-4c96-afbb-6837bd7de99c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b50cd74c0d06434da0871915bc7c1568, user_id=1266e809c6ec4d1391f75faa5055863b, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:19.503473 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ebb97-4b1d-4c96-afbb-6837bd7de99c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:19.512736 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 972/1945] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:15:19 2021] POST /identity/v3/users => generated 284 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:19.516399 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae49ed-30a3-43a3-a7a4-806abc70309d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:19.526312 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae49ed-30a3-43a3-a7a4-806abc70309d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:19.531634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431436e-d0de-4114-99bc-58cd9534d55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:19.532289 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431436e-d0de-4114-99bc-58cd9534d55a admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:19.532569 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431436e-d0de-4114-99bc-58cd9534d55a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:19.533004 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431436e-d0de-4114-99bc-58cd9534d55a admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:19.533734 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431436e-d0de-4114-99bc-58cd9534d55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:19.535315 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431436e-d0de-4114-99bc-58cd9534d55a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:19.547146 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 973/1946] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:19 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:15:19.551254 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431436e-d0de-4114-99bc-58cd9534d55a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:19.560994 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431436e-d0de-4114-99bc-58cd9534d55a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:19.566437 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c40e2c-3766-4921-889f-454cb3673aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:19.567078 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c40e2c-3766-4921-889f-454cb3673aef admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:19.567395 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c40e2c-3766-4921-889f-454cb3673aef admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:19.567669 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c40e2c-3766-4921-889f-454cb3673aef admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:19.568385 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c40e2c-3766-4921-889f-454cb3673aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:19.569993 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c40e2c-3766-4921-889f-454cb3673aef admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:19.581284 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 974/1947] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:19 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:15:19.585140 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c40e2c-3766-4921-889f-454cb3673aef admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:19.594679 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c40e2c-3766-4921-889f-454cb3673aef admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:19.599288 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084564ed-7014-46ea-b7b4-18ba3436c6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:19.600150 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084564ed-7014-46ea-b7b4-18ba3436c6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:19.600445 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084564ed-7014-46ea-b7b4-18ba3436c6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:19.600713 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084564ed-7014-46ea-b7b4-18ba3436c6ee admin admin] PATH_INFO: `/v3/projects/5a51a8bd35444d69a74320e7dccee76a/users/b5dcb8690c4b4e0baf942808787c8ed8/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:19.614733 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084564ed-7014-46ea-b7b4-18ba3436c6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a51a8bd35444d69a74320e7dccee76a, user_id=b5dcb8690c4b4e0baf942808787c8ed8, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:19.617573 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084564ed-7014-46ea-b7b4-18ba3436c6ee admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:19.657192 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 974/1948] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:19 2021] PUT /identity/v3/projects/b50cd74c0d06434da0871915bc7c1568/users/1266e809c6ec4d1391f75faa5055863b/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:15:19.668448 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af86cb-b0ef-4902-8494-0290cc74ad5b None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:19.668736 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af86cb-b0ef-4902-8494-0290cc74ad5b None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:19.669019 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af86cb-b0ef-4902-8494-0290cc74ad5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:19.687332 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 975/1949] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:19 2021] PUT /identity/v3/projects/5a51a8bd35444d69a74320e7dccee76a/users/b5dcb8690c4b4e0baf942808787c8ed8/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:15:19.697861 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-14af86cb-b0ef-4902-8494-0290cc74ad5b None None] MFA Rules not processed for user `1266e809c6ec4d1391f75faa5055863b`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:19.699971 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-14af86cb-b0ef-4902-8494-0290cc74ad5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:19.700115 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58ebb4-a55e-4aaf-9e1d-2a71543eee5f None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:19.700554 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58ebb4-a55e-4aaf-9e1d-2a71543eee5f None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:19.700780 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58ebb4-a55e-4aaf-9e1d-2a71543eee5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:19.728943 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-4e58ebb4-a55e-4aaf-9e1d-2a71543eee5f None None] MFA Rules not processed for user `b5dcb8690c4b4e0baf942808787c8ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:19.730213 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-4e58ebb4-a55e-4aaf-9e1d-2a71543eee5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:19.766454 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 975/1950] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:19 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:15:19.777637 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af86cb-b0ef-4902-8494-0290cc74ad5b None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:19.779084 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-14af86cb-b0ef-4902-8494-0290cc74ad5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:19.794033 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 976/1951] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:19 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:19.800341 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58ebb4-a55e-4aaf-9e1d-2a71543eee5f None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:19.837578 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af86cb-b0ef-4902-8494-0290cc74ad5b None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:19.842074 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc45ea-6b7b-4548-99f3-f6c2044a5e39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:19.842729 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc45ea-6b7b-4548-99f3-f6c2044a5e39 service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:19.843019 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc45ea-6b7b-4548-99f3-f6c2044a5e39 service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:19.843384 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc45ea-6b7b-4548-99f3-f6c2044a5e39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:19.851743 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc45ea-6b7b-4548-99f3-f6c2044a5e39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:19.853190 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc45ea-6b7b-4548-99f3-f6c2044a5e39 service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:19.861124 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58ebb4-a55e-4aaf-9e1d-2a71543eee5f None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:19.862415 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 976/1952] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:19 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:15:19.865970 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4862e-9c64-483b-ae97-03615ed323b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:19.866558 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4862e-9c64-483b-ae97-03615ed323b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:19.866841 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4862e-9c64-483b-ae97-03615ed323b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:19.867115 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4862e-9c64-483b-ae97-03615ed323b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:19.867962 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4862e-9c64-483b-ae97-03615ed323b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:19.869836 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4862e-9c64-483b-ae97-03615ed323b1 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:20.000537 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 977/1953] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:15:19 2021] POST /identity/v3/projects => generated 369 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:15:20.004498 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc45ea-6b7b-4548-99f3-f6c2044a5e39 service cinder] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:20.015906 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc45ea-6b7b-4548-99f3-f6c2044a5e39 service cinder] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:20.078096 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ebf3e-6bd2-4053-9fe7-bb08783b9556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:20.079055 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ebf3e-6bd2-4053-9fe7-bb08783b9556 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:20.079228 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ebf3e-6bd2-4053-9fe7-bb08783b9556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:20.079499 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ebf3e-6bd2-4053-9fe7-bb08783b9556 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:20.080214 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ebf3e-6bd2-4053-9fe7-bb08783b9556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:20.082138 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ebf3e-6bd2-4053-9fe7-bb08783b9556 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:20.213269 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 977/1954] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:15:20 2021] POST /identity/v3/users => generated 291 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:20.216503 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4862e-9c64-483b-ae97-03615ed323b1 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:20.229083 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4862e-9c64-483b-ae97-03615ed323b1 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:20.234063 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3ca12-14e2-4978-8d9e-7c3f2bb390ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:20.234730 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3ca12-14e2-4978-8d9e-7c3f2bb390ba admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:20.235015 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3ca12-14e2-4978-8d9e-7c3f2bb390ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:20.235322 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3ca12-14e2-4978-8d9e-7c3f2bb390ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:20.236232 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3ca12-14e2-4978-8d9e-7c3f2bb390ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:20.237872 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3ca12-14e2-4978-8d9e-7c3f2bb390ba admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:20.249112 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 978/1955] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:20 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:20.255690 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ebf3e-6bd2-4053-9fe7-bb08783b9556 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:20.266570 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ebf3e-6bd2-4053-9fe7-bb08783b9556 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:20.271262 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b856e-3fc4-4956-89d6-a0fe35f9f7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:20.272264 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b856e-3fc4-4956-89d6-a0fe35f9f7ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:20.272550 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b856e-3fc4-4956-89d6-a0fe35f9f7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:20.272825 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b856e-3fc4-4956-89d6-a0fe35f9f7ff admin admin] PATH_INFO: `/v3/projects/4a87e7172a044271b107e07b9929dbb5/users/346d2b9516504b4b8897995c42e5548c/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:20.288596 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b856e-3fc4-4956-89d6-a0fe35f9f7ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a87e7172a044271b107e07b9929dbb5, user_id=346d2b9516504b4b8897995c42e5548c, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:20.291721 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b856e-3fc4-4956-89d6-a0fe35f9f7ff admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:20.380549 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 978/1956] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:20 2021] PUT /identity/v3/projects/4a87e7172a044271b107e07b9929dbb5/users/346d2b9516504b4b8897995c42e5548c/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:20.384425 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3ca12-14e2-4978-8d9e-7c3f2bb390ba admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:20.394511 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3ca12-14e2-4978-8d9e-7c3f2bb390ba admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:20.448234 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99e818-a037-4487-8f61-e436a75fbfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:20.449556 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99e818-a037-4487-8f61-e436a75fbfc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:20.449836 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99e818-a037-4487-8f61-e436a75fbfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:20.450111 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99e818-a037-4487-8f61-e436a75fbfc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:20.450841 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99e818-a037-4487-8f61-e436a75fbfc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:20.452458 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99e818-a037-4487-8f61-e436a75fbfc4 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:20.461872 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 979/1957] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:20 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:20.466412 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b856e-3fc4-4956-89d6-a0fe35f9f7ff admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:20.476842 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b856e-3fc4-4956-89d6-a0fe35f9f7ff admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:20.481825 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abdfd4-1a8c-4742-948a-3cdd318d7219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:20.482753 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abdfd4-1a8c-4742-948a-3cdd318d7219 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:20.483038 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abdfd4-1a8c-4742-948a-3cdd318d7219 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:20.483355 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abdfd4-1a8c-4742-948a-3cdd318d7219 admin admin] PATH_INFO: `/v3/projects/4a87e7172a044271b107e07b9929dbb5/users/346d2b9516504b4b8897995c42e5548c/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:20.485351 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abdfd4-1a8c-4742-948a-3cdd318d7219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a87e7172a044271b107e07b9929dbb5, user_id=346d2b9516504b4b8897995c42e5548c, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:20.487993 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abdfd4-1a8c-4742-948a-3cdd318d7219 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:20.499985 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 979/1958] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:20 2021] PUT /identity/v3/projects/4a87e7172a044271b107e07b9929dbb5/users/346d2b9516504b4b8897995c42e5548c/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:20.511931 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d593b16-9140-46e1-9cd5-77f22b10a41f None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:20.512474 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d593b16-9140-46e1-9cd5-77f22b10a41f None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:20.512668 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d593b16-9140-46e1-9cd5-77f22b10a41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:20.541027 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-2d593b16-9140-46e1-9cd5-77f22b10a41f None None] MFA Rules not processed for user `346d2b9516504b4b8897995c42e5548c`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:20.542628 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-2d593b16-9140-46e1-9cd5-77f22b10a41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:20.610187 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 980/1959] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:20 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:20.621642 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abdfd4-1a8c-4742-948a-3cdd318d7219 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:20.675692 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abdfd4-1a8c-4742-948a-3cdd318d7219 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:20.680209 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5c659-772d-4e8b-b0d5-0bc4a38a8f62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:20.680209 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5c659-772d-4e8b-b0d5-0bc4a38a8f62 service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:20.680405 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5c659-772d-4e8b-b0d5-0bc4a38a8f62 service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:20.680600 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5c659-772d-4e8b-b0d5-0bc4a38a8f62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:20.690410 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5c659-772d-4e8b-b0d5-0bc4a38a8f62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:20.691878 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5c659-772d-4e8b-b0d5-0bc4a38a8f62 service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:20.701900 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 980/1960] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:20 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:20.831897 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d593b16-9140-46e1-9cd5-77f22b10a41f None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:20.833307 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-2d593b16-9140-46e1-9cd5-77f22b10a41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:20.844823 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d593b16-9140-46e1-9cd5-77f22b10a41f None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:20.848362 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf8917-eedc-4ec7-868f-2e72243a3291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:20.849020 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf8917-eedc-4ec7-868f-2e72243a3291 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:20.849302 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf8917-eedc-4ec7-868f-2e72243a3291 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:20.849577 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf8917-eedc-4ec7-868f-2e72243a3291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:20.904727 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf8917-eedc-4ec7-868f-2e72243a3291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:20.906328 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf8917-eedc-4ec7-868f-2e72243a3291 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:20.914898 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 981/1961] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:20 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:24.574961 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5c659-772d-4e8b-b0d5-0bc4a38a8f62 service cinder] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:24.650234 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5c659-772d-4e8b-b0d5-0bc4a38a8f62 service cinder] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:24.655745 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efac31-6b61-40db-ab92-e11fbc21bffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:24.656751 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efac31-6b61-40db-ab92-e11fbc21bffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:24.657155 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efac31-6b61-40db-ab92-e11fbc21bffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:24.657635 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efac31-6b61-40db-ab92-e11fbc21bffd admin admin] PATH_INFO: `/v3/users/1266e809c6ec4d1391f75faa5055863b` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:24.658855 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efac31-6b61-40db-ab92-e11fbc21bffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1266e809c6ec4d1391f75faa5055863b)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:24.660847 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efac31-6b61-40db-ab92-e11fbc21bffd admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:24.876057 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-33efac31-6b61-40db-ab92-e11fbc21bffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1266e809c6ec4d1391f75faa5055863b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:24.976689 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-33efac31-6b61-40db-ab92-e11fbc21bffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1266e809c6ec4d1391f75faa5055863b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:24.985919 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-33efac31-6b61-40db-ab92-e11fbc21bffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1266e809c6ec4d1391f75faa5055863b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:24.986616 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-33efac31-6b61-40db-ab92-e11fbc21bffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1266e809c6ec4d1391f75faa5055863b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:24.998500 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-33efac31-6b61-40db-ab92-e11fbc21bffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1266e809c6ec4d1391f75faa5055863b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:25.005010 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 981/1962] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:24 2021] DELETE /identity/v3/users/1266e809c6ec4d1391f75faa5055863b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:25.009691 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9fe00-798c-46d0-9b3a-c2e5d75cc0bc None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:25.010158 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9fe00-798c-46d0-9b3a-c2e5d75cc0bc None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:25.010271 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9fe00-798c-46d0-9b3a-c2e5d75cc0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:25.031228 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-d2e9fe00-798c-46d0-9b3a-c2e5d75cc0bc None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:25.032805 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-d2e9fe00-798c-46d0-9b3a-c2e5d75cc0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:25.102649 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 982/1963] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:25.115915 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efac31-6b61-40db-ab92-e11fbc21bffd admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:25.117379 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-33efac31-6b61-40db-ab92-e11fbc21bffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:25.176553 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efac31-6b61-40db-ab92-e11fbc21bffd admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:25.180166 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06339ff0-ff17-4804-907d-1ce5cfb7061a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:25.181016 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06339ff0-ff17-4804-907d-1ce5cfb7061a service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:25.181165 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06339ff0-ff17-4804-907d-1ce5cfb7061a service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:25.181337 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06339ff0-ff17-4804-907d-1ce5cfb7061a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:25.190322 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06339ff0-ff17-4804-907d-1ce5cfb7061a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:25.191787 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06339ff0-ff17-4804-907d-1ce5cfb7061a service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:25.201783 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 982/1964] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:25.638262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9fe00-798c-46d0-9b3a-c2e5d75cc0bc None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:25.639906 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-d2e9fe00-798c-46d0-9b3a-c2e5d75cc0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:25.653801 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9fe00-798c-46d0-9b3a-c2e5d75cc0bc None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:25.659061 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f6635-be23-4d41-b091-4e76a5a6abc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:25.660742 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f6635-be23-4d41-b091-4e76a5a6abc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:25.660742 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f6635-be23-4d41-b091-4e76a5a6abc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:25.661197 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f6635-be23-4d41-b091-4e76a5a6abc1 admin admin] PATH_INFO: `/v3/projects/b50cd74c0d06434da0871915bc7c1568` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:25.662798 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f6635-be23-4d41-b091-4e76a5a6abc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b50cd74c0d06434da0871915bc7c1568)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:25.667976 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f6635-be23-4d41-b091-4e76a5a6abc1 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:25.789083 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-cc9f6635-be23-4d41-b091-4e76a5a6abc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b50cd74c0d06434da0871915bc7c1568', 'request_id': 'req-cc9f6635-be23-4d41-b091-4e76a5a6abc1'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:25.796834 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-cc9f6635-be23-4d41-b091-4e76a5a6abc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b50cd74c0d06434da0871915bc7c1568', 'request_id': 'req-cc9f6635-be23-4d41-b091-4e76a5a6abc1'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:25.802497 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-cc9f6635-be23-4d41-b091-4e76a5a6abc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b50cd74c0d06434da0871915bc7c1568', 'request_id': 'req-cc9f6635-be23-4d41-b091-4e76a5a6abc1'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:25.893669 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-cc9f6635-be23-4d41-b091-4e76a5a6abc1 admin admin] The token cache is being invalidate because project b50cd74c0d06434da0871915bc7c1568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:25.894023 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-cc9f6635-be23-4d41-b091-4e76a5a6abc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:25.896145 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-cc9f6635-be23-4d41-b091-4e76a5a6abc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:25.898699 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 983/1965] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:25 2021] DELETE /identity/v3/projects/b50cd74c0d06434da0871915bc7c1568 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:25.911932 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed03ed6-4c77-4602-9afe-9ed7d03c3b9c None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:25.911932 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed03ed6-4c77-4602-9afe-9ed7d03c3b9c None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:25.911932 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed03ed6-4c77-4602-9afe-9ed7d03c3b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:25.937529 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-2ed03ed6-4c77-4602-9afe-9ed7d03c3b9c None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:25.938776 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-2ed03ed6-4c77-4602-9afe-9ed7d03c3b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:26.005638 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 983/1966] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:26.013478 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693b4e9-a0dd-4e10-b372-4834ee967050 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:26.014090 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693b4e9-a0dd-4e10-b372-4834ee967050 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:26.014090 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693b4e9-a0dd-4e10-b372-4834ee967050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:26.032578 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-e693b4e9-a0dd-4e10-b372-4834ee967050 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:26.033795 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e693b4e9-a0dd-4e10-b372-4834ee967050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:26.043781 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 984/1967] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:26.048262 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed03ed6-4c77-4602-9afe-9ed7d03c3b9c None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:26.058797 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed03ed6-4c77-4602-9afe-9ed7d03c3b9c None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:26.064127 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24168c1-2675-4dcc-961f-2359a9aef82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:26.064900 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24168c1-2675-4dcc-961f-2359a9aef82a admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:26.065190 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24168c1-2675-4dcc-961f-2359a9aef82a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:26.065471 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24168c1-2675-4dcc-961f-2359a9aef82a admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:26.066218 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24168c1-2675-4dcc-961f-2359a9aef82a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:15:26.066528 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24168c1-2675-4dcc-961f-2359a9aef82a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:26.068329 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24168c1-2675-4dcc-961f-2359a9aef82a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:26.080928 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 984/1968] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:15:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:15:26.085282 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693b4e9-a0dd-4e10-b372-4834ee967050 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:26.094890 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693b4e9-a0dd-4e10-b372-4834ee967050 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:26.099832 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506a4a9-b1aa-40a0-b150-7cebc6eb09ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:26.100488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506a4a9-b1aa-40a0-b150-7cebc6eb09ae admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:26.101392 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506a4a9-b1aa-40a0-b150-7cebc6eb09ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:26.101875 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506a4a9-b1aa-40a0-b150-7cebc6eb09ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:26.102599 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506a4a9-b1aa-40a0-b150-7cebc6eb09ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:26.105398 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506a4a9-b1aa-40a0-b150-7cebc6eb09ae admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:26.188719 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 985/1969] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:15:26 2021] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:15:26.195409 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24168c1-2675-4dcc-961f-2359a9aef82a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:26.208981 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24168c1-2675-4dcc-961f-2359a9aef82a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:26.291712 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc6c40-7c08-42e9-9f4d-2195e9e8325a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:26.293763 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc6c40-7c08-42e9-9f4d-2195e9e8325a admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:26.294197 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc6c40-7c08-42e9-9f4d-2195e9e8325a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:26.294614 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc6c40-7c08-42e9-9f4d-2195e9e8325a admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:26.295678 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc6c40-7c08-42e9-9f4d-2195e9e8325a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:26.302509 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc6c40-7c08-42e9-9f4d-2195e9e8325a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:26.390040 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 985/1970] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:15:26 2021] POST /identity/v3/users => generated 286 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:15:26.394510 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506a4a9-b1aa-40a0-b150-7cebc6eb09ae admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:26.408864 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506a4a9-b1aa-40a0-b150-7cebc6eb09ae admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:26.422036 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f9f88-a0d0-491f-b9ac-ca97f71f7565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:26.422954 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f9f88-a0d0-491f-b9ac-ca97f71f7565 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:26.423580 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f9f88-a0d0-491f-b9ac-ca97f71f7565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:26.423923 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f9f88-a0d0-491f-b9ac-ca97f71f7565 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:26.424750 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f9f88-a0d0-491f-b9ac-ca97f71f7565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:26.426382 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f9f88-a0d0-491f-b9ac-ca97f71f7565 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:26.449325 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 986/1971] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:26 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:26.451150 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc6c40-7c08-42e9-9f4d-2195e9e8325a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:26.471736 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc6c40-7c08-42e9-9f4d-2195e9e8325a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:26.483565 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22083437-5698-4842-8a1f-109c0cae00e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:26.483565 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22083437-5698-4842-8a1f-109c0cae00e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:26.483565 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22083437-5698-4842-8a1f-109c0cae00e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:26.483565 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22083437-5698-4842-8a1f-109c0cae00e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:26.484091 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22083437-5698-4842-8a1f-109c0cae00e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:26.484091 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22083437-5698-4842-8a1f-109c0cae00e9 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:26.494673 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 986/1972] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:26 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:26.499542 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f9f88-a0d0-491f-b9ac-ca97f71f7565 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:26.513965 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f9f88-a0d0-491f-b9ac-ca97f71f7565 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:26.519859 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3c004-86e5-4573-ab5f-e8dc7b03fe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:26.521209 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3c004-86e5-4573-ab5f-e8dc7b03fe81 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:26.521563 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3c004-86e5-4573-ab5f-e8dc7b03fe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:26.522032 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3c004-86e5-4573-ab5f-e8dc7b03fe81 admin admin] PATH_INFO: `/v3/projects/b2e387ca7bd04e5a871817dd68700ac6/users/0cdbe890eef3446b912a7cdb2eb87745/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:26.544385 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3c004-86e5-4573-ab5f-e8dc7b03fe81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2e387ca7bd04e5a871817dd68700ac6, user_id=0cdbe890eef3446b912a7cdb2eb87745, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:26.560252 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3c004-86e5-4573-ab5f-e8dc7b03fe81 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:26.718926 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 987/1973] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:26 2021] PUT /identity/v3/projects/b2e387ca7bd04e5a871817dd68700ac6/users/0cdbe890eef3446b912a7cdb2eb87745/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:26.730411 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12b68f-face-4901-a0a0-28b4b58ec04b None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:26.730709 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12b68f-face-4901-a0a0-28b4b58ec04b None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:26.730953 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12b68f-face-4901-a0a0-28b4b58ec04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:26.761244 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-9b12b68f-face-4901-a0a0-28b4b58ec04b None None] MFA Rules not processed for user `0cdbe890eef3446b912a7cdb2eb87745`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:26.762578 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-9b12b68f-face-4901-a0a0-28b4b58ec04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:26.826166 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 987/1974] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:26 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:26.838436 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3c004-86e5-4573-ab5f-e8dc7b03fe81 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:26.840335 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-8df3c004-86e5-4573-ab5f-e8dc7b03fe81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:26.897608 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3c004-86e5-4573-ab5f-e8dc7b03fe81 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:26.901348 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa3f05-599c-44fe-b66f-a59fc0d544bd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f52add52aa4586aee0b801ceffd764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:26.902303 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa3f05-599c-44fe-b66f-a59fc0d544bd service glance] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:26.902676 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa3f05-599c-44fe-b66f-a59fc0d544bd service glance] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:26.902948 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa3f05-599c-44fe-b66f-a59fc0d544bd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:26.912222 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa3f05-599c-44fe-b66f-a59fc0d544bd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:26.913623 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa3f05-599c-44fe-b66f-a59fc0d544bd service glance] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:26.923130 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 988/1975] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:26 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:27.145416 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b12b68f-face-4901-a0a0-28b4b58ec04b None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:27.146976 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-9b12b68f-face-4901-a0a0-28b4b58ec04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:27.220948 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b12b68f-face-4901-a0a0-28b4b58ec04b None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:27.226257 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85f0b7-63fa-420c-917c-856e26ba0774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:27.227369 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85f0b7-63fa-420c-917c-856e26ba0774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:27.227650 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85f0b7-63fa-420c-917c-856e26ba0774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:27.227922 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85f0b7-63fa-420c-917c-856e26ba0774 admin admin] PATH_INFO: `/v3/users/b5dcb8690c4b4e0baf942808787c8ed8` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:27.229339 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85f0b7-63fa-420c-917c-856e26ba0774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5dcb8690c4b4e0baf942808787c8ed8)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:27.232199 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85f0b7-63fa-420c-917c-856e26ba0774 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:27.422916 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa3f05-599c-44fe-b66f-a59fc0d544bd service glance] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:27.424385 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-b3aa3f05-599c-44fe-b66f-a59fc0d544bd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:27.449918 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa3f05-599c-44fe-b66f-a59fc0d544bd service glance] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:27.456753 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a266a-1400-45b3-8a8d-04e9b8aa312d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:27.457753 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a266a-1400-45b3-8a8d-04e9b8aa312d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:27.458035 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a266a-1400-45b3-8a8d-04e9b8aa312d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:27.458309 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a266a-1400-45b3-8a8d-04e9b8aa312d admin admin] PATH_INFO: `/v3/users/beeeda545efa4628b7c8bdc7abab1f32` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:27.459638 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a266a-1400-45b3-8a8d-04e9b8aa312d admin admin] RBAC: Authorizing `identity:delete_user(user_id=beeeda545efa4628b7c8bdc7abab1f32)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:27.461608 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a266a-1400-45b3-8a8d-04e9b8aa312d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:27.562899 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-eb85f0b7-63fa-420c-917c-856e26ba0774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5dcb8690c4b4e0baf942808787c8ed8'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:27.654229 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-eb85f0b7-63fa-420c-917c-856e26ba0774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5dcb8690c4b4e0baf942808787c8ed8'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:27.662770 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-eb85f0b7-63fa-420c-917c-856e26ba0774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5dcb8690c4b4e0baf942808787c8ed8'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:27.663509 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-eb85f0b7-63fa-420c-917c-856e26ba0774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5dcb8690c4b4e0baf942808787c8ed8'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:27.669409 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f96a266a-1400-45b3-8a8d-04e9b8aa312d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beeeda545efa4628b7c8bdc7abab1f32'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:27.681743 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-eb85f0b7-63fa-420c-917c-856e26ba0774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5dcb8690c4b4e0baf942808787c8ed8'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:27.687771 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 988/1976] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:27 2021] DELETE /identity/v3/users/b5dcb8690c4b4e0baf942808787c8ed8 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:27.692504 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbed6d1-8355-4b38-a2ec-6a77079c1fa0 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:27.696432 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbed6d1-8355-4b38-a2ec-6a77079c1fa0 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:27.696432 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbed6d1-8355-4b38-a2ec-6a77079c1fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:27.712031 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-9fbed6d1-8355-4b38-a2ec-6a77079c1fa0 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:27.713223 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-9fbed6d1-8355-4b38-a2ec-6a77079c1fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:27.770768 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f96a266a-1400-45b3-8a8d-04e9b8aa312d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beeeda545efa4628b7c8bdc7abab1f32'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:27.779362 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 989/1977] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:15:27.786949 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbed6d1-8355-4b38-a2ec-6a77079c1fa0 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:27.787926 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f96a266a-1400-45b3-8a8d-04e9b8aa312d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beeeda545efa4628b7c8bdc7abab1f32'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:27.788898 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f96a266a-1400-45b3-8a8d-04e9b8aa312d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beeeda545efa4628b7c8bdc7abab1f32'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:27.789016 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-9fbed6d1-8355-4b38-a2ec-6a77079c1fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:27.802185 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f96a266a-1400-45b3-8a8d-04e9b8aa312d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beeeda545efa4628b7c8bdc7abab1f32'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:27.808043 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 989/1978] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:27 2021] DELETE /identity/v3/users/beeeda545efa4628b7c8bdc7abab1f32 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:27.857100 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbed6d1-8355-4b38-a2ec-6a77079c1fa0 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:27.949014 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c53c20-2c83-4903-a554-e345e5f61b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:27.949770 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c53c20-2c83-4903-a554-e345e5f61b6c service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:27.950080 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c53c20-2c83-4903-a554-e345e5f61b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:27.950359 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c53c20-2c83-4903-a554-e345e5f61b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:27.952852 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-77c53c20-2c83-4903-a554-e345e5f61b6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:28.041086 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c53c20-2c83-4903-a554-e345e5f61b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:28.043712 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c53c20-2c83-4903-a554-e345e5f61b6c service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:28.055434 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 990/1979] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:15:28.096704 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a266a-1400-45b3-8a8d-04e9b8aa312d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:28.098541 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-f96a266a-1400-45b3-8a8d-04e9b8aa312d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:28.118405 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a266a-1400-45b3-8a8d-04e9b8aa312d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:28.127370 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fbf68-a4ab-439c-9f8e-5c5a644cc681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:28.128938 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fbf68-a4ab-439c-9f8e-5c5a644cc681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:28.137590 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fbf68-a4ab-439c-9f8e-5c5a644cc681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:28.137955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fbf68-a4ab-439c-9f8e-5c5a644cc681 admin admin] PATH_INFO: `/v3/projects/d63df76f0e6143769f3c277ddefb7623` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:28.141538 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7fbf68-a4ab-439c-9f8e-5c5a644cc681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63df76f0e6143769f3c277ddefb7623)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:28.143705 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7fbf68-a4ab-439c-9f8e-5c5a644cc681 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:28.280604 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ff7fbf68-a4ab-439c-9f8e-5c5a644cc681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63df76f0e6143769f3c277ddefb7623', 'request_id': 'req-ff7fbf68-a4ab-439c-9f8e-5c5a644cc681'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:28.287282 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ff7fbf68-a4ab-439c-9f8e-5c5a644cc681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63df76f0e6143769f3c277ddefb7623', 'request_id': 'req-ff7fbf68-a4ab-439c-9f8e-5c5a644cc681'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:28.293577 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ff7fbf68-a4ab-439c-9f8e-5c5a644cc681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63df76f0e6143769f3c277ddefb7623', 'request_id': 'req-ff7fbf68-a4ab-439c-9f8e-5c5a644cc681'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:28.382054 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ff7fbf68-a4ab-439c-9f8e-5c5a644cc681 admin admin] The token cache is being invalidate because project d63df76f0e6143769f3c277ddefb7623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:28.382342 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ff7fbf68-a4ab-439c-9f8e-5c5a644cc681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:28.383135 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ff7fbf68-a4ab-439c-9f8e-5c5a644cc681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:28.385259 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 990/1980] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:28 2021] DELETE /identity/v3/projects/d63df76f0e6143769f3c277ddefb7623 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:28.389923 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c53c20-2c83-4903-a554-e345e5f61b6c service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:28.399330 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c53c20-2c83-4903-a554-e345e5f61b6c service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:28.460490 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfceffbc-5b99-4083-b0fc-d75d8d3b1aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:28.461362 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfceffbc-5b99-4083-b0fc-d75d8d3b1aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:28.461632 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfceffbc-5b99-4083-b0fc-d75d8d3b1aec admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:28.461905 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfceffbc-5b99-4083-b0fc-d75d8d3b1aec admin admin] PATH_INFO: `/v3/users/d9a9dfd4ced84b21ad645ad13354717f` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:28.463091 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfceffbc-5b99-4083-b0fc-d75d8d3b1aec admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9a9dfd4ced84b21ad645ad13354717f)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:28.465904 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfceffbc-5b99-4083-b0fc-d75d8d3b1aec admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:28.629856 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fbf68-a4ab-439c-9f8e-5c5a644cc681 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:28.631492 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-ff7fbf68-a4ab-439c-9f8e-5c5a644cc681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:28.656547 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fbf68-a4ab-439c-9f8e-5c5a644cc681 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:28.661688 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac682334-93e2-453b-b767-8501aae8630c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:28.662554 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac682334-93e2-453b-b767-8501aae8630c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:28.662842 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac682334-93e2-453b-b767-8501aae8630c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:28.663122 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac682334-93e2-453b-b767-8501aae8630c admin admin] PATH_INFO: `/v3/projects/5a51a8bd35444d69a74320e7dccee76a` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:28.665832 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac682334-93e2-453b-b767-8501aae8630c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a51a8bd35444d69a74320e7dccee76a)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:28.670045 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac682334-93e2-453b-b767-8501aae8630c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:28.730811 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-cfceffbc-5b99-4083-b0fc-d75d8d3b1aec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9a9dfd4ced84b21ad645ad13354717f'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:28.808758 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-cfceffbc-5b99-4083-b0fc-d75d8d3b1aec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9a9dfd4ced84b21ad645ad13354717f'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:28.823767 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-cfceffbc-5b99-4083-b0fc-d75d8d3b1aec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9a9dfd4ced84b21ad645ad13354717f'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:28.825225 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-cfceffbc-5b99-4083-b0fc-d75d8d3b1aec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9a9dfd4ced84b21ad645ad13354717f'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:28.839756 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-cfceffbc-5b99-4083-b0fc-d75d8d3b1aec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9a9dfd4ced84b21ad645ad13354717f'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:28.848339 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 991/1981] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:28 2021] DELETE /identity/v3/users/d9a9dfd4ced84b21ad645ad13354717f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:28.880200 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ac682334-93e2-453b-b767-8501aae8630c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a51a8bd35444d69a74320e7dccee76a', 'request_id': 'req-ac682334-93e2-453b-b767-8501aae8630c'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:28.900681 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ac682334-93e2-453b-b767-8501aae8630c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a51a8bd35444d69a74320e7dccee76a', 'request_id': 'req-ac682334-93e2-453b-b767-8501aae8630c'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:28.908631 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ac682334-93e2-453b-b767-8501aae8630c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a51a8bd35444d69a74320e7dccee76a', 'request_id': 'req-ac682334-93e2-453b-b767-8501aae8630c'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:29.022424 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ac682334-93e2-453b-b767-8501aae8630c admin admin] The token cache is being invalidate because project 5a51a8bd35444d69a74320e7dccee76a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:29.022813 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ac682334-93e2-453b-b767-8501aae8630c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:29.024029 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ac682334-93e2-453b-b767-8501aae8630c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:29.025774 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 991/1982] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:28 2021] DELETE /identity/v3/projects/5a51a8bd35444d69a74320e7dccee76a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:29.030372 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfceffbc-5b99-4083-b0fc-d75d8d3b1aec admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:29.031852 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-cfceffbc-5b99-4083-b0fc-d75d8d3b1aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:29.116947 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfceffbc-5b99-4083-b0fc-d75d8d3b1aec admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:29.178930 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d7f94-2457-49af-b227-0bc08980f1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:29.179827 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d7f94-2457-49af-b227-0bc08980f1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:29.180113 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d7f94-2457-49af-b227-0bc08980f1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:29.180392 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d7f94-2457-49af-b227-0bc08980f1f8 admin admin] PATH_INFO: `/v3/users/346d2b9516504b4b8897995c42e5548c` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:29.181663 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d7f94-2457-49af-b227-0bc08980f1f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=346d2b9516504b4b8897995c42e5548c)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:29.184511 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d7f94-2457-49af-b227-0bc08980f1f8 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:29.221034 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac682334-93e2-453b-b767-8501aae8630c admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:29.221034 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-ac682334-93e2-453b-b767-8501aae8630c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:29.221034 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac682334-93e2-453b-b767-8501aae8630c admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:29.221896 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba056a48-6dab-40ce-8391-6a80ac16a9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:29.222095 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba056a48-6dab-40ce-8391-6a80ac16a9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:29.222549 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba056a48-6dab-40ce-8391-6a80ac16a9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:29.222825 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba056a48-6dab-40ce-8391-6a80ac16a9cc admin admin] PATH_INFO: `/v3/projects/a96b3d44323a46409290066d369c7daa` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:29.224141 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba056a48-6dab-40ce-8391-6a80ac16a9cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a96b3d44323a46409290066d369c7daa)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:29.226032 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba056a48-6dab-40ce-8391-6a80ac16a9cc admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:29.459713 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-483d7f94-2457-49af-b227-0bc08980f1f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '346d2b9516504b4b8897995c42e5548c'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:29.461043 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ba056a48-6dab-40ce-8391-6a80ac16a9cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a96b3d44323a46409290066d369c7daa', 'request_id': 'req-ba056a48-6dab-40ce-8391-6a80ac16a9cc'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:29.468314 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ba056a48-6dab-40ce-8391-6a80ac16a9cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a96b3d44323a46409290066d369c7daa', 'request_id': 'req-ba056a48-6dab-40ce-8391-6a80ac16a9cc'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:29.473944 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ba056a48-6dab-40ce-8391-6a80ac16a9cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a96b3d44323a46409290066d369c7daa', 'request_id': 'req-ba056a48-6dab-40ce-8391-6a80ac16a9cc'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:29.539808 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-483d7f94-2457-49af-b227-0bc08980f1f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '346d2b9516504b4b8897995c42e5548c'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:29.548162 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-483d7f94-2457-49af-b227-0bc08980f1f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '346d2b9516504b4b8897995c42e5548c'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:29.549047 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-483d7f94-2457-49af-b227-0bc08980f1f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '346d2b9516504b4b8897995c42e5548c'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:29.561843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-483d7f94-2457-49af-b227-0bc08980f1f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '346d2b9516504b4b8897995c42e5548c'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:29.567929 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 992/1983] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:29 2021] DELETE /identity/v3/users/346d2b9516504b4b8897995c42e5548c => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:29.569447 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d7f94-2457-49af-b227-0bc08980f1f8 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:29.570914 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-483d7f94-2457-49af-b227-0bc08980f1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:29.612100 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ba056a48-6dab-40ce-8391-6a80ac16a9cc admin admin] The token cache is being invalidate because project a96b3d44323a46409290066d369c7daa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:29.619243 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ba056a48-6dab-40ce-8391-6a80ac16a9cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:29.619243 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ba056a48-6dab-40ce-8391-6a80ac16a9cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:29.619243 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 992/1984] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:29 2021] DELETE /identity/v3/projects/a96b3d44323a46409290066d369c7daa => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:15:29.621906 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec8609-825d-45db-92a3-7e11533cc31a None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:29.622283 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec8609-825d-45db-92a3-7e11533cc31a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:29.622637 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec8609-825d-45db-92a3-7e11533cc31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:29.642345 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-a1ec8609-825d-45db-92a3-7e11533cc31a None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:29.647723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-a1ec8609-825d-45db-92a3-7e11533cc31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:29.658036 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d7f94-2457-49af-b227-0bc08980f1f8 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:29.658262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 993/1985] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:15:29.663919 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce5b16-1dfd-41b8-9a57-b059f8d7c4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:29.664853 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce5b16-1dfd-41b8-9a57-b059f8d7c4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:29.665992 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce5b16-1dfd-41b8-9a57-b059f8d7c4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:29.666278 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce5b16-1dfd-41b8-9a57-b059f8d7c4f4 admin admin] PATH_INFO: `/v3/users/0e40a9461975424ab1166ff50aaa9aca` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:29.667732 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03a7e8-0580-4d7f-bef7-5b1a61a91a1c None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:29.668126 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03a7e8-0580-4d7f-bef7-5b1a61a91a1c None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:29.668501 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03a7e8-0580-4d7f-bef7-5b1a61a91a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:29.671557 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce5b16-1dfd-41b8-9a57-b059f8d7c4f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e40a9461975424ab1166ff50aaa9aca)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:29.676503 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce5b16-1dfd-41b8-9a57-b059f8d7c4f4 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:29.701023 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-1c03a7e8-0580-4d7f-bef7-5b1a61a91a1c None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:29.704838 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-1c03a7e8-0580-4d7f-bef7-5b1a61a91a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:29.710409 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 994/1986] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:15:29.715878 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03a7e8-0580-4d7f-bef7-5b1a61a91a1c None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:29.733575 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03a7e8-0580-4d7f-bef7-5b1a61a91a1c None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:29.733575 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfd830-6644-4da1-bcf5-d54ad2aecdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:29.733575 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfd830-6644-4da1-bcf5-d54ad2aecdd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:29.733575 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfd830-6644-4da1-bcf5-d54ad2aecdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:29.734040 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfd830-6644-4da1-bcf5-d54ad2aecdd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:29.734040 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfd830-6644-4da1-bcf5-d54ad2aecdd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:15:29.734185 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfd830-6644-4da1-bcf5-d54ad2aecdd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:29.735795 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfd830-6644-4da1-bcf5-d54ad2aecdd1 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:29.750241 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 995/1987] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:15:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:15:29.761671 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfd830-6644-4da1-bcf5-d54ad2aecdd1 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:29.778754 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfd830-6644-4da1-bcf5-d54ad2aecdd1 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:29.785737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21b4a2-b53e-4a2e-bee4-5016449c555f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:29.785737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21b4a2-b53e-4a2e-bee4-5016449c555f admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:29.785737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21b4a2-b53e-4a2e-bee4-5016449c555f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:29.785737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21b4a2-b53e-4a2e-bee4-5016449c555f admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:29.786335 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21b4a2-b53e-4a2e-bee4-5016449c555f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:29.788345 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21b4a2-b53e-4a2e-bee4-5016449c555f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:29.904539 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 996/1988] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:15:29 2021] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:15:29.908545 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21b4a2-b53e-4a2e-bee4-5016449c555f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:29.937133 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-9dce5b16-1dfd-41b8-9a57-b059f8d7c4f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e40a9461975424ab1166ff50aaa9aca'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:29.992844 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21b4a2-b53e-4a2e-bee4-5016449c555f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:29.999008 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6d54c-e7cc-496c-ad5b-1e0627caa348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:30.005496 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6d54c-e7cc-496c-ad5b-1e0627caa348 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:30.005496 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6d54c-e7cc-496c-ad5b-1e0627caa348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:30.005496 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6d54c-e7cc-496c-ad5b-1e0627caa348 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:30.005496 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6d54c-e7cc-496c-ad5b-1e0627caa348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:30.005496 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6d54c-e7cc-496c-ad5b-1e0627caa348 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:30.023710 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-9dce5b16-1dfd-41b8-9a57-b059f8d7c4f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e40a9461975424ab1166ff50aaa9aca'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:30.032460 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-9dce5b16-1dfd-41b8-9a57-b059f8d7c4f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e40a9461975424ab1166ff50aaa9aca'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:30.033314 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-9dce5b16-1dfd-41b8-9a57-b059f8d7c4f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e40a9461975424ab1166ff50aaa9aca'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:30.047184 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-9dce5b16-1dfd-41b8-9a57-b059f8d7c4f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e40a9461975424ab1166ff50aaa9aca'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:30.053755 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 993/1989] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:29 2021] DELETE /identity/v3/users/0e40a9461975424ab1166ff50aaa9aca => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:30.064055 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062a432-f8c7-4253-a9b3-1323c79dbd83 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:30.064055 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062a432-f8c7-4253-a9b3-1323c79dbd83 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:30.064055 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062a432-f8c7-4253-a9b3-1323c79dbd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:30.081433 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-9062a432-f8c7-4253-a9b3-1323c79dbd83 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:30.082653 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-9062a432-f8c7-4253-a9b3-1323c79dbd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:30.092371 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 997/1990] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:15:29 2021] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:15:30.097984 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6d54c-e7cc-496c-ad5b-1e0627caa348 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:30.097984 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-49b6d54c-e7cc-496c-ad5b-1e0627caa348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:30.119892 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6d54c-e7cc-496c-ad5b-1e0627caa348 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:30.152961 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 994/1991] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:30.152961 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062a432-f8c7-4253-a9b3-1323c79dbd83 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:30.169577 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-9062a432-f8c7-4253-a9b3-1323c79dbd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:30.185946 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062a432-f8c7-4253-a9b3-1323c79dbd83 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:30.191546 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9134a9-1c2f-493d-8fc8-e04786144b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:30.192205 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9134a9-1c2f-493d-8fc8-e04786144b8b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:30.192486 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9134a9-1c2f-493d-8fc8-e04786144b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:30.192762 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9134a9-1c2f-493d-8fc8-e04786144b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:30.193486 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9134a9-1c2f-493d-8fc8-e04786144b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:30.195102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9134a9-1c2f-493d-8fc8-e04786144b8b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:30.201093 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49755d-2633-4f28-b8ae-e5aefdba1ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:30.202279 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49755d-2633-4f28-b8ae-e5aefdba1ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:30.202665 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49755d-2633-4f28-b8ae-e5aefdba1ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:30.203038 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49755d-2633-4f28-b8ae-e5aefdba1ff6 admin admin] PATH_INFO: `/v3/projects/4a87e7172a044271b107e07b9929dbb5` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:30.204611 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49755d-2633-4f28-b8ae-e5aefdba1ff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a87e7172a044271b107e07b9929dbb5)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:30.205903 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 995/1992] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:30 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:30.206718 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9134a9-1c2f-493d-8fc8-e04786144b8b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:30.207513 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49755d-2633-4f28-b8ae-e5aefdba1ff6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:30.208373 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-6f9134a9-1c2f-493d-8fc8-e04786144b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:30.269080 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9134a9-1c2f-493d-8fc8-e04786144b8b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:30.273526 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f402acc-19e5-42c0-abb1-70a55f9346b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:30.274173 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f402acc-19e5-42c0-abb1-70a55f9346b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:30.274479 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f402acc-19e5-42c0-abb1-70a55f9346b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:30.274751 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f402acc-19e5-42c0-abb1-70a55f9346b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:30.285126 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f402acc-19e5-42c0-abb1-70a55f9346b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:30.286542 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f402acc-19e5-42c0-abb1-70a55f9346b3 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:30.296699 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 996/1993] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:30.297470 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f402acc-19e5-42c0-abb1-70a55f9346b3 service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:30.306246 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f402acc-19e5-42c0-abb1-70a55f9346b3 service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:30.316231 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c9b02-a4c6-4eb5-b202-a6bfa4f399be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:30.316231 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c9b02-a4c6-4eb5-b202-a6bfa4f399be admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:30.316231 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c9b02-a4c6-4eb5-b202-a6bfa4f399be admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:30.316231 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c9b02-a4c6-4eb5-b202-a6bfa4f399be admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:30.316598 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c9b02-a4c6-4eb5-b202-a6bfa4f399be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:30.316598 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c9b02-a4c6-4eb5-b202-a6bfa4f399be admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:30.329517 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 997/1994] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:30 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:30.331743 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c9b02-a4c6-4eb5-b202-a6bfa4f399be admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:30.349980 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c9b02-a4c6-4eb5-b202-a6bfa4f399be admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:30.356471 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c7c5e-0a0a-448a-a479-a1edb6747cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:30.357572 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c7c5e-0a0a-448a-a479-a1edb6747cac admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:30.357864 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c7c5e-0a0a-448a-a479-a1edb6747cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:30.358143 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c7c5e-0a0a-448a-a479-a1edb6747cac admin admin] PATH_INFO: `/v3/projects/7bbc966c88734a62b174d4a7e0e8d95d/users/d60979dfa4af4cf091713083de89851c/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:30.375519 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c7c5e-0a0a-448a-a479-a1edb6747cac admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bbc966c88734a62b174d4a7e0e8d95d, user_id=d60979dfa4af4cf091713083de89851c, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:30.378205 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c7c5e-0a0a-448a-a479-a1edb6747cac admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:30.514119 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 998/1995] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:30 2021] PUT /identity/v3/projects/7bbc966c88734a62b174d4a7e0e8d95d/users/d60979dfa4af4cf091713083de89851c/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:15:30.523511 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-7b49755d-2633-4f28-b8ae-e5aefdba1ff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a87e7172a044271b107e07b9929dbb5', 'request_id': 'req-7b49755d-2633-4f28-b8ae-e5aefdba1ff6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:30.524250 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e26bc3-3b90-4382-849e-970938f84557 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:30.524544 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e26bc3-3b90-4382-849e-970938f84557 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:30.524823 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e26bc3-3b90-4382-849e-970938f84557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:30.529904 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-7b49755d-2633-4f28-b8ae-e5aefdba1ff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a87e7172a044271b107e07b9929dbb5', 'request_id': 'req-7b49755d-2633-4f28-b8ae-e5aefdba1ff6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:30.536029 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-7b49755d-2633-4f28-b8ae-e5aefdba1ff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a87e7172a044271b107e07b9929dbb5', 'request_id': 'req-7b49755d-2633-4f28-b8ae-e5aefdba1ff6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:30.551218 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-95e26bc3-3b90-4382-849e-970938f84557 None None] MFA Rules not processed for user `d60979dfa4af4cf091713083de89851c`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:30.552581 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-95e26bc3-3b90-4382-849e-970938f84557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:30.642092 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 999/1996] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:30 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:15:30.649405 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e26bc3-3b90-4382-849e-970938f84557 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:30.651132 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-95e26bc3-3b90-4382-849e-970938f84557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:30.653908 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-7b49755d-2633-4f28-b8ae-e5aefdba1ff6 admin admin] The token cache is being invalidate because project 4a87e7172a044271b107e07b9929dbb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:30.654418 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-7b49755d-2633-4f28-b8ae-e5aefdba1ff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:30.655848 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-7b49755d-2633-4f28-b8ae-e5aefdba1ff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:30.659128 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 998/1997] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:30 2021] DELETE /identity/v3/projects/4a87e7172a044271b107e07b9929dbb5 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:30.668111 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f765c-50e0-45ea-a751-78fb8c5de688 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:30.668111 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f765c-50e0-45ea-a751-78fb8c5de688 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:30.669025 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f765c-50e0-45ea-a751-78fb8c5de688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:30.698304 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-290f765c-50e0-45ea-a751-78fb8c5de688 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:30.700722 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-290f765c-50e0-45ea-a751-78fb8c5de688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:30.741768 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e26bc3-3b90-4382-849e-970938f84557 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:30.746782 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63349c-90c4-4f73-b8c5-e60ce204c4f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:30.747509 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63349c-90c4-4f73-b8c5-e60ce204c4f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:30.747802 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63349c-90c4-4f73-b8c5-e60ce204c4f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:30.748160 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63349c-90c4-4f73-b8c5-e60ce204c4f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:30.750489 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-1e63349c-90c4-4f73-b8c5-e60ce204c4f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:30.779414 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63349c-90c4-4f73-b8c5-e60ce204c4f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:30.780808 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63349c-90c4-4f73-b8c5-e60ce204c4f3 service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:30.781617 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 999/1998] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:30.789322 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759effd5-f885-47f7-bea6-a772eab386ec None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:30.789606 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759effd5-f885-47f7-bea6-a772eab386ec None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:30.790192 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759effd5-f885-47f7-bea6-a772eab386ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:30.791119 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1000/1999] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:30 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:15:30.809709 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-759effd5-f885-47f7-bea6-a772eab386ec None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:30.810901 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-759effd5-f885-47f7-bea6-a772eab386ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:30.813238 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63349c-90c4-4f73-b8c5-e60ce204c4f3 service cinder] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:30.814578 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-1e63349c-90c4-4f73-b8c5-e60ce204c4f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:30.818925 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1000/2000] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:30.822885 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759effd5-f885-47f7-bea6-a772eab386ec None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:30.831988 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759effd5-f885-47f7-bea6-a772eab386ec None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:30.834265 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63349c-90c4-4f73-b8c5-e60ce204c4f3 service cinder] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:30.837464 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7d7d1-a58e-425b-859d-f81c3329771c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:30.838244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7d7d1-a58e-425b-859d-f81c3329771c admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:30.838523 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7d7d1-a58e-425b-859d-f81c3329771c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:30.839361 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7d7d1-a58e-425b-859d-f81c3329771c admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:30.839756 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bf420-302e-4291-845a-acfe7a3a2357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:30.840100 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7d7d1-a58e-425b-859d-f81c3329771c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:15:30.840437 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7d7d1-a58e-425b-859d-f81c3329771c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:30.840827 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bf420-302e-4291-845a-acfe7a3a2357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:30.841210 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bf420-302e-4291-845a-acfe7a3a2357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:30.841492 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bf420-302e-4291-845a-acfe7a3a2357 admin admin] PATH_INFO: `/v3/users/d60979dfa4af4cf091713083de89851c` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:30.842101 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7d7d1-a58e-425b-859d-f81c3329771c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:30.842767 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bf420-302e-4291-845a-acfe7a3a2357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d60979dfa4af4cf091713083de89851c)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:30.844767 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bf420-302e-4291-845a-acfe7a3a2357 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:30.858008 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1001/2001] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:15:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 04:15:30.861748 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7d7d1-a58e-425b-859d-f81c3329771c admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:30.866448 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-79d7d7d1-a58e-425b-859d-f81c3329771c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:30.884686 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7d7d1-a58e-425b-859d-f81c3329771c admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:30.892101 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ac874-ad25-4b52-907e-d63b58ce0418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:30.892101 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ac874-ad25-4b52-907e-d63b58ce0418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:30.892101 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ac874-ad25-4b52-907e-d63b58ce0418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:30.892101 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ac874-ad25-4b52-907e-d63b58ce0418 admin admin] PATH_INFO: `/v3/projects/20d6b836bad84f94b912abfa13f5f3e7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:30.894481 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ac874-ad25-4b52-907e-d63b58ce0418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20d6b836bad84f94b912abfa13f5f3e7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:30.896438 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ac874-ad25-4b52-907e-d63b58ce0418 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:31.074787 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-735ac874-ad25-4b52-907e-d63b58ce0418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20d6b836bad84f94b912abfa13f5f3e7', 'request_id': 'req-735ac874-ad25-4b52-907e-d63b58ce0418'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:31.084265 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-735ac874-ad25-4b52-907e-d63b58ce0418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20d6b836bad84f94b912abfa13f5f3e7', 'request_id': 'req-735ac874-ad25-4b52-907e-d63b58ce0418'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:31.093933 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-000bf420-302e-4291-845a-acfe7a3a2357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd60979dfa4af4cf091713083de89851c'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:31.096234 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-735ac874-ad25-4b52-907e-d63b58ce0418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20d6b836bad84f94b912abfa13f5f3e7', 'request_id': 'req-735ac874-ad25-4b52-907e-d63b58ce0418'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:31.205575 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-000bf420-302e-4291-845a-acfe7a3a2357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd60979dfa4af4cf091713083de89851c'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:31.215525 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-000bf420-302e-4291-845a-acfe7a3a2357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd60979dfa4af4cf091713083de89851c'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:31.216291 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-000bf420-302e-4291-845a-acfe7a3a2357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd60979dfa4af4cf091713083de89851c'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:31.235201 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-000bf420-302e-4291-845a-acfe7a3a2357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd60979dfa4af4cf091713083de89851c'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:31.241286 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1001/2002] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:30 2021] DELETE /identity/v3/users/d60979dfa4af4cf091713083de89851c => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:15:31.241843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bf420-302e-4291-845a-acfe7a3a2357 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:31.243126 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-000bf420-302e-4291-845a-acfe7a3a2357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:31.309058 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bf420-302e-4291-845a-acfe7a3a2357 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:31.314839 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37533bd0-96b7-4284-ba86-1d85d05c33a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:31.315612 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37533bd0-96b7-4284-ba86-1d85d05c33a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:31.315876 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37533bd0-96b7-4284-ba86-1d85d05c33a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:31.316155 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37533bd0-96b7-4284-ba86-1d85d05c33a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:31.316871 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37533bd0-96b7-4284-ba86-1d85d05c33a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:31.318763 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37533bd0-96b7-4284-ba86-1d85d05c33a1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:31.326385 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-735ac874-ad25-4b52-907e-d63b58ce0418 admin admin] The token cache is being invalidate because project 20d6b836bad84f94b912abfa13f5f3e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:31.326950 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-735ac874-ad25-4b52-907e-d63b58ce0418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:31.327874 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-735ac874-ad25-4b52-907e-d63b58ce0418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:31.329707 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1002/2003] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:30 2021] DELETE /identity/v3/projects/20d6b836bad84f94b912abfa13f5f3e7 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:15:31.331263 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ac89d-bc1e-436a-b1ca-98386bfe62f8 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:31.338372 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ac89d-bc1e-436a-b1ca-98386bfe62f8 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:31.338770 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ac89d-bc1e-436a-b1ca-98386bfe62f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:31.356629 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-758ac89d-bc1e-436a-b1ca-98386bfe62f8 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:31.358066 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-758ac89d-bc1e-436a-b1ca-98386bfe62f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:31.365962 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1003/2004] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:31.371142 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ac89d-bc1e-436a-b1ca-98386bfe62f8 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:31.371142 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-758ac89d-bc1e-436a-b1ca-98386bfe62f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:31.380095 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ac89d-bc1e-436a-b1ca-98386bfe62f8 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:31.384681 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04749c1d-01bd-4c54-8404-c7788e1710d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:31.385562 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04749c1d-01bd-4c54-8404-c7788e1710d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:31.385849 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04749c1d-01bd-4c54-8404-c7788e1710d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:31.386123 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04749c1d-01bd-4c54-8404-c7788e1710d6 admin admin] PATH_INFO: `/v3/users/05ce7c7c660448aeab0af5cef8e24e17` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:31.387363 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04749c1d-01bd-4c54-8404-c7788e1710d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ce7c7c660448aeab0af5cef8e24e17)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:31.389258 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04749c1d-01bd-4c54-8404-c7788e1710d6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:31.437125 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1002/2005] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:15:31 2021] POST /identity/v3/projects => generated 367 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:31.438065 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37533bd0-96b7-4284-ba86-1d85d05c33a1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:31.439850 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-37533bd0-96b7-4284-ba86-1d85d05c33a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:31.499165 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37533bd0-96b7-4284-ba86-1d85d05c33a1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:31.502812 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aecb70-fbf5-4e12-8549-d51e7882c939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:31.503503 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aecb70-fbf5-4e12-8549-d51e7882c939 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:31.503791 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aecb70-fbf5-4e12-8549-d51e7882c939 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:31.504070 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aecb70-fbf5-4e12-8549-d51e7882c939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:31.562560 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aecb70-fbf5-4e12-8549-d51e7882c939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:31.563928 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aecb70-fbf5-4e12-8549-d51e7882c939 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:31.573870 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1003/2006] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:31.574763 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aecb70-fbf5-4e12-8549-d51e7882c939 service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:31.576414 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-41aecb70-fbf5-4e12-8549-d51e7882c939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:31.577112 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-04749c1d-01bd-4c54-8404-c7788e1710d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ce7c7c660448aeab0af5cef8e24e17'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:31.590314 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aecb70-fbf5-4e12-8549-d51e7882c939 service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:31.595656 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b200b35-2339-438c-b7a4-29be29110580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:31.596318 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b200b35-2339-438c-b7a4-29be29110580 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:31.596602 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b200b35-2339-438c-b7a4-29be29110580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:31.596880 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b200b35-2339-438c-b7a4-29be29110580 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:31.597606 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b200b35-2339-438c-b7a4-29be29110580 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:31.599537 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b200b35-2339-438c-b7a4-29be29110580 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:31.702394 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-04749c1d-01bd-4c54-8404-c7788e1710d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ce7c7c660448aeab0af5cef8e24e17'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:31.711765 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-04749c1d-01bd-4c54-8404-c7788e1710d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ce7c7c660448aeab0af5cef8e24e17'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:31.711765 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-04749c1d-01bd-4c54-8404-c7788e1710d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ce7c7c660448aeab0af5cef8e24e17'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:31.723058 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-04749c1d-01bd-4c54-8404-c7788e1710d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ce7c7c660448aeab0af5cef8e24e17'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:31.728820 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1004/2007] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:31 2021] DELETE /identity/v3/users/05ce7c7c660448aeab0af5cef8e24e17 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:31.738373 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1004/2008] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:15:31 2021] POST /identity/v3/users => generated 284 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:31.748401 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04749c1d-01bd-4c54-8404-c7788e1710d6 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:31.749901 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-04749c1d-01bd-4c54-8404-c7788e1710d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:31.831158 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04749c1d-01bd-4c54-8404-c7788e1710d6 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:31.834291 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e1505-cbcc-4625-8e5b-7cad79ea1746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:31.835036 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e1505-cbcc-4625-8e5b-7cad79ea1746 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:31.835433 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e1505-cbcc-4625-8e5b-7cad79ea1746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:31.835758 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e1505-cbcc-4625-8e5b-7cad79ea1746 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:31.836535 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e1505-cbcc-4625-8e5b-7cad79ea1746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:31.838132 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e1505-cbcc-4625-8e5b-7cad79ea1746 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:31.851305 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1005/2009] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:31 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:31.856142 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b200b35-2339-438c-b7a4-29be29110580 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:31.873995 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b200b35-2339-438c-b7a4-29be29110580 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:31.879078 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03d8aa-fdf8-412c-b458-e5886c5dd362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:31.879922 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03d8aa-fdf8-412c-b458-e5886c5dd362 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:31.880290 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03d8aa-fdf8-412c-b458-e5886c5dd362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:31.880625 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03d8aa-fdf8-412c-b458-e5886c5dd362 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:31.881438 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03d8aa-fdf8-412c-b458-e5886c5dd362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:31.883098 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03d8aa-fdf8-412c-b458-e5886c5dd362 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:31.900088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1005/2010] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:31 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:31.900231 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e1505-cbcc-4625-8e5b-7cad79ea1746 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:31.909028 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e1505-cbcc-4625-8e5b-7cad79ea1746 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:31.913743 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380d257-f2d9-4ab7-a6d0-9d4b10a414c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:31.914644 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380d257-f2d9-4ab7-a6d0-9d4b10a414c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:31.915185 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380d257-f2d9-4ab7-a6d0-9d4b10a414c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:31.915496 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380d257-f2d9-4ab7-a6d0-9d4b10a414c5 admin admin] PATH_INFO: `/v3/projects/4b771c4205834d2b88274cac1653fdbb/users/ca2c93f062f4488cb6f915c26d061f79/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:31.933204 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380d257-f2d9-4ab7-a6d0-9d4b10a414c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b771c4205834d2b88274cac1653fdbb, user_id=ca2c93f062f4488cb6f915c26d061f79, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:31.940229 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380d257-f2d9-4ab7-a6d0-9d4b10a414c5 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:32.017928 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03d8aa-fdf8-412c-b458-e5886c5dd362 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:32.020027 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-4f03d8aa-fdf8-412c-b458-e5886c5dd362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:32.044982 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03d8aa-fdf8-412c-b458-e5886c5dd362 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:32.053524 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1006/2011] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:31 2021] PUT /identity/v3/projects/4b771c4205834d2b88274cac1653fdbb/users/ca2c93f062f4488cb6f915c26d061f79/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:32.055102 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544f3e8-c85b-4257-9e40-9788e4739239 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:32.057129 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544f3e8-c85b-4257-9e40-9788e4739239 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:32.057129 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544f3e8-c85b-4257-9e40-9788e4739239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:32.093407 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-a544f3e8-c85b-4257-9e40-9788e4739239 None None] MFA Rules not processed for user `ca2c93f062f4488cb6f915c26d061f79`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:32.095332 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-a544f3e8-c85b-4257-9e40-9788e4739239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:32.127018 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e056bdd-4c50-49f9-b7c1-e585cb1b6337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:32.128067 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e056bdd-4c50-49f9-b7c1-e585cb1b6337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:32.128358 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e056bdd-4c50-49f9-b7c1-e585cb1b6337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:32.128635 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e056bdd-4c50-49f9-b7c1-e585cb1b6337 admin admin] PATH_INFO: `/v3/projects/7bbc966c88734a62b174d4a7e0e8d95d` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:32.130184 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e056bdd-4c50-49f9-b7c1-e585cb1b6337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bbc966c88734a62b174d4a7e0e8d95d)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:32.133755 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e056bdd-4c50-49f9-b7c1-e585cb1b6337 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:32.200236 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1007/2012] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:32 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:32.201710 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19fdc7-d540-4a59-8505-3f3650e24288 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:32.206184 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19fdc7-d540-4a59-8505-3f3650e24288 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:32.206184 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19fdc7-d540-4a59-8505-3f3650e24288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:32.220740 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-be19fdc7-d540-4a59-8505-3f3650e24288 None None] MFA Rules not processed for user `882a63823deb40dcb93ddc76f81ab9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:32.221965 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-be19fdc7-d540-4a59-8505-3f3650e24288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:32.275307 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1008/2013] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:32 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:32.276881 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19fdc7-d540-4a59-8505-3f3650e24288 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:32.291963 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19fdc7-d540-4a59-8505-3f3650e24288 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:32.308324 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1a537-7e3d-49f9-a282-63f403a62fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:32.308324 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1a537-7e3d-49f9-a282-63f403a62fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:32.308324 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1a537-7e3d-49f9-a282-63f403a62fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:32.308324 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1a537-7e3d-49f9-a282-63f403a62fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:32.308726 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1a537-7e3d-49f9-a282-63f403a62fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:32.308726 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1a537-7e3d-49f9-a282-63f403a62fa8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:32.334784 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8e056bdd-4c50-49f9-b7c1-e585cb1b6337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bbc966c88734a62b174d4a7e0e8d95d', 'request_id': 'req-8e056bdd-4c50-49f9-b7c1-e585cb1b6337'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:32.343456 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8e056bdd-4c50-49f9-b7c1-e585cb1b6337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bbc966c88734a62b174d4a7e0e8d95d', 'request_id': 'req-8e056bdd-4c50-49f9-b7c1-e585cb1b6337'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:32.350029 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8e056bdd-4c50-49f9-b7c1-e585cb1b6337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bbc966c88734a62b174d4a7e0e8d95d', 'request_id': 'req-8e056bdd-4c50-49f9-b7c1-e585cb1b6337'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:32.430984 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1009/2014] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:15:32 2021] POST /identity/v3/projects => generated 365 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:32.432170 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1a537-7e3d-49f9-a282-63f403a62fa8 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:32.435973 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e9c1a537-7e3d-49f9-a282-63f403a62fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:32.453236 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8e056bdd-4c50-49f9-b7c1-e585cb1b6337 admin admin] The token cache is being invalidate because project 7bbc966c88734a62b174d4a7e0e8d95d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:32.455690 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8e056bdd-4c50-49f9-b7c1-e585cb1b6337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:32.455690 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8e056bdd-4c50-49f9-b7c1-e585cb1b6337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:32.457329 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1006/2015] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:32 2021] DELETE /identity/v3/projects/7bbc966c88734a62b174d4a7e0e8d95d => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:32.458386 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e056bdd-4c50-49f9-b7c1-e585cb1b6337 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:32.460350 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-8e056bdd-4c50-49f9-b7c1-e585cb1b6337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:32.531370 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1a537-7e3d-49f9-a282-63f403a62fa8 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:32.535544 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e056bdd-4c50-49f9-b7c1-e585cb1b6337 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:32.536341 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36a82f-022d-47cf-9b3d-4712648c3fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:32.537203 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36a82f-022d-47cf-9b3d-4712648c3fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:32.539615 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36a82f-022d-47cf-9b3d-4712648c3fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:32.540476 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36a82f-022d-47cf-9b3d-4712648c3fcc admin admin] PATH_INFO: `/v3/projects/1352f0cb379b4fccb0d0f3d11d767aa9` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:32.540914 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39c3a8-40d9-4fbb-acb6-b08d6bc72c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:32.541844 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39c3a8-40d9-4fbb-acb6-b08d6bc72c05 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:32.542481 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39c3a8-40d9-4fbb-acb6-b08d6bc72c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:32.542844 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36a82f-022d-47cf-9b3d-4712648c3fcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1352f0cb379b4fccb0d0f3d11d767aa9)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:32.542945 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39c3a8-40d9-4fbb-acb6-b08d6bc72c05 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:32.543715 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39c3a8-40d9-4fbb-acb6-b08d6bc72c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:32.545377 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36a82f-022d-47cf-9b3d-4712648c3fcc admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:32.545763 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39c3a8-40d9-4fbb-acb6-b08d6bc72c05 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:32.638369 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1007/2016] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:15:32 2021] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:32.639882 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27773968-6d64-4a21-9cca-32cd0b08752e None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:32.640427 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27773968-6d64-4a21-9cca-32cd0b08752e None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:32.640717 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27773968-6d64-4a21-9cca-32cd0b08752e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:32.659914 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-27773968-6d64-4a21-9cca-32cd0b08752e None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:32.661190 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-27773968-6d64-4a21-9cca-32cd0b08752e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:32.670703 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1008/2017] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:32.671577 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27773968-6d64-4a21-9cca-32cd0b08752e None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:32.686051 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27773968-6d64-4a21-9cca-32cd0b08752e None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:32.692037 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa0ff5-b9dc-4de6-96b4-67311c61580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:32.692709 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa0ff5-b9dc-4de6-96b4-67311c61580d admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:32.692999 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa0ff5-b9dc-4de6-96b4-67311c61580d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:32.693281 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa0ff5-b9dc-4de6-96b4-67311c61580d admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:32.694028 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa0ff5-b9dc-4de6-96b4-67311c61580d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:32.695780 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa0ff5-b9dc-4de6-96b4-67311c61580d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:32.710532 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1009/2018] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:32 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:32.710532 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9702019-5ed4-41a9-8531-0b8eb7d0b8dc None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:32.710532 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9702019-5ed4-41a9-8531-0b8eb7d0b8dc None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:32.710532 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9702019-5ed4-41a9-8531-0b8eb7d0b8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:32.710921 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-bc36a82f-022d-47cf-9b3d-4712648c3fcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1352f0cb379b4fccb0d0f3d11d767aa9', 'request_id': 'req-bc36a82f-022d-47cf-9b3d-4712648c3fcc'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:32.717820 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-bc36a82f-022d-47cf-9b3d-4712648c3fcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1352f0cb379b4fccb0d0f3d11d767aa9', 'request_id': 'req-bc36a82f-022d-47cf-9b3d-4712648c3fcc'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:32.723778 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-bc36a82f-022d-47cf-9b3d-4712648c3fcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1352f0cb379b4fccb0d0f3d11d767aa9', 'request_id': 'req-bc36a82f-022d-47cf-9b3d-4712648c3fcc'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:32.730384 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-e9702019-5ed4-41a9-8531-0b8eb7d0b8dc None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:32.731633 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-e9702019-5ed4-41a9-8531-0b8eb7d0b8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:32.807942 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1010/2019] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:32.808930 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9702019-5ed4-41a9-8531-0b8eb7d0b8dc None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:32.820647 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-bc36a82f-022d-47cf-9b3d-4712648c3fcc admin admin] The token cache is being invalidate because project 1352f0cb379b4fccb0d0f3d11d767aa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:32.821078 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-bc36a82f-022d-47cf-9b3d-4712648c3fcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:32.821866 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-bc36a82f-022d-47cf-9b3d-4712648c3fcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:32.824840 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1010/2020] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:32 2021] DELETE /identity/v3/projects/1352f0cb379b4fccb0d0f3d11d767aa9 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:32.825761 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36a82f-022d-47cf-9b3d-4712648c3fcc admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:32.828638 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-bc36a82f-022d-47cf-9b3d-4712648c3fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:32.833490 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9702019-5ed4-41a9-8531-0b8eb7d0b8dc None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:32.838333 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a611471-0ea7-4f4b-9a5d-ff5259e6c865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:32.839197 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a611471-0ea7-4f4b-9a5d-ff5259e6c865 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:32.839676 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a611471-0ea7-4f4b-9a5d-ff5259e6c865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:32.839954 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a611471-0ea7-4f4b-9a5d-ff5259e6c865 admin admin] PATH_INFO: `/v3/projects/e4ddff26900b4765a22d478dedd50b54/users/392ac8c8ea634203ac304360b859045a/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:32.856341 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a611471-0ea7-4f4b-9a5d-ff5259e6c865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4ddff26900b4765a22d478dedd50b54, user_id=392ac8c8ea634203ac304360b859045a, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:32.859106 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a611471-0ea7-4f4b-9a5d-ff5259e6c865 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:32.865498 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36a82f-022d-47cf-9b3d-4712648c3fcc admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:32.875342 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d54e4d-edd3-4805-92c8-b2e2a1b78c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:32.880737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d54e4d-edd3-4805-92c8-b2e2a1b78c27 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:32.880737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d54e4d-edd3-4805-92c8-b2e2a1b78c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:32.880737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d54e4d-edd3-4805-92c8-b2e2a1b78c27 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:32.880737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d54e4d-edd3-4805-92c8-b2e2a1b78c27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:15:32.880737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d54e4d-edd3-4805-92c8-b2e2a1b78c27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:32.880737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d54e4d-edd3-4805-92c8-b2e2a1b78c27 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:32.892683 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1011/2021] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:15:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:15:32.897001 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3277f-7352-4895-8d3c-07efbd6ca724 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:32.897373 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3277f-7352-4895-8d3c-07efbd6ca724 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:32.898022 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3277f-7352-4895-8d3c-07efbd6ca724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:32.918468 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-39a3277f-7352-4895-8d3c-07efbd6ca724 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:32.919771 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-39a3277f-7352-4895-8d3c-07efbd6ca724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:32.927804 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1012/2022] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:32.928571 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3277f-7352-4895-8d3c-07efbd6ca724 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:32.941833 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3277f-7352-4895-8d3c-07efbd6ca724 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:32.949309 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1011/2023] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:32 2021] PUT /identity/v3/projects/e4ddff26900b4765a22d478dedd50b54/users/392ac8c8ea634203ac304360b859045a/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:32.950931 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af3ca6-a38c-4581-a9cb-d0c9487de729 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:32.951254 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af3ca6-a38c-4581-a9cb-d0c9487de729 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:32.952746 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af3ca6-a38c-4581-a9cb-d0c9487de729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:32.986093 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-a9af3ca6-a38c-4581-a9cb-d0c9487de729 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:32.987356 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-a9af3ca6-a38c-4581-a9cb-d0c9487de729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:33.014665 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849578e6-ea8a-4da8-a08b-5b36f1124dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:33.026723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849578e6-ea8a-4da8-a08b-5b36f1124dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:33.027292 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849578e6-ea8a-4da8-a08b-5b36f1124dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:33.027585 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849578e6-ea8a-4da8-a08b-5b36f1124dd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:33.028346 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849578e6-ea8a-4da8-a08b-5b36f1124dd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:33.030703 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849578e6-ea8a-4da8-a08b-5b36f1124dd2 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:33.052590 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1012/2024] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:33.053434 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af3ca6-a38c-4581-a9cb-d0c9487de729 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:33.055230 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-a9af3ca6-a38c-4581-a9cb-d0c9487de729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:33.068089 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af3ca6-a38c-4581-a9cb-d0c9487de729 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:33.073042 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99e116-7ff1-47c6-8870-fc0d66f3c2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:33.073715 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99e116-7ff1-47c6-8870-fc0d66f3c2fe admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:33.073999 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99e116-7ff1-47c6-8870-fc0d66f3c2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:33.074280 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99e116-7ff1-47c6-8870-fc0d66f3c2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:33.075026 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99e116-7ff1-47c6-8870-fc0d66f3c2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:33.076679 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99e116-7ff1-47c6-8870-fc0d66f3c2fe admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:33.087538 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1013/2025] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:33 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:33.092286 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99e116-7ff1-47c6-8870-fc0d66f3c2fe admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:33.099315 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99e116-7ff1-47c6-8870-fc0d66f3c2fe admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:33.104082 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4b522-bc53-4a49-81ad-ac8781daf8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:33.104962 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4b522-bc53-4a49-81ad-ac8781daf8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:33.105159 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4b522-bc53-4a49-81ad-ac8781daf8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:33.105458 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4b522-bc53-4a49-81ad-ac8781daf8b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:33.106270 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4b522-bc53-4a49-81ad-ac8781daf8b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:15:33.106607 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4b522-bc53-4a49-81ad-ac8781daf8b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:33.108186 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4b522-bc53-4a49-81ad-ac8781daf8b8 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:33.121543 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1014/2026] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:15:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:15:33.126926 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4b522-bc53-4a49-81ad-ac8781daf8b8 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:33.142456 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4b522-bc53-4a49-81ad-ac8781daf8b8 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:33.149074 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9054e67-00b4-4f85-9047-52654aba6290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:33.150312 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9054e67-00b4-4f85-9047-52654aba6290 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:33.150737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9054e67-00b4-4f85-9047-52654aba6290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:33.151157 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9054e67-00b4-4f85-9047-52654aba6290 admin admin] PATH_INFO: `/v3/projects/e4ddff26900b4765a22d478dedd50b54/users/392ac8c8ea634203ac304360b859045a/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:33.153675 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9054e67-00b4-4f85-9047-52654aba6290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4ddff26900b4765a22d478dedd50b54, user_id=392ac8c8ea634203ac304360b859045a, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:33.156647 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9054e67-00b4-4f85-9047-52654aba6290 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:33.171634 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1015/2027] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:33 2021] PUT /identity/v3/projects/e4ddff26900b4765a22d478dedd50b54/users/392ac8c8ea634203ac304360b859045a/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:33.175286 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1013/2028] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:15:32 2021] POST /identity/v3/projects => generated 375 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:33.175859 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9054e67-00b4-4f85-9047-52654aba6290 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:33.180161 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849578e6-ea8a-4da8-a08b-5b36f1124dd2 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:33.266301 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9054e67-00b4-4f85-9047-52654aba6290 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:33.298469 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849578e6-ea8a-4da8-a08b-5b36f1124dd2 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:33.306244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdeb79-7b55-487d-ba80-cd5f3dcf1158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:33.309571 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdeb79-7b55-487d-ba80-cd5f3dcf1158 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:33.309899 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdeb79-7b55-487d-ba80-cd5f3dcf1158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:33.310242 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdeb79-7b55-487d-ba80-cd5f3dcf1158 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:33.310981 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdeb79-7b55-487d-ba80-cd5f3dcf1158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:33.313229 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdeb79-7b55-487d-ba80-cd5f3dcf1158 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:33.341729 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da5069-8252-4125-9d32-74c90605e5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:33.342472 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da5069-8252-4125-9d32-74c90605e5df admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:33.342912 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da5069-8252-4125-9d32-74c90605e5df admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:33.343311 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da5069-8252-4125-9d32-74c90605e5df admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:33.344685 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da5069-8252-4125-9d32-74c90605e5df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:33.346640 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da5069-8252-4125-9d32-74c90605e5df admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:33.389611 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1014/2029] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:15:33 2021] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:33.391021 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d85e3-f7e6-4446-8261-ea136f95658d None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:33.391341 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d85e3-f7e6-4446-8261-ea136f95658d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:33.391622 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d85e3-f7e6-4446-8261-ea136f95658d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:33.418915 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-ed1d85e3-f7e6-4446-8261-ea136f95658d None None] MFA Rules not processed for user `392ac8c8ea634203ac304360b859045a`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:33.420184 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-ed1d85e3-f7e6-4446-8261-ea136f95658d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:33.424413 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1016/2030] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:15:33 2021] POST /identity/v3/projects => generated 363 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:33.425223 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da5069-8252-4125-9d32-74c90605e5df admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:33.508122 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1015/2031] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:33 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:33.508122 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d85e3-f7e6-4446-8261-ea136f95658d None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:33.518652 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da5069-8252-4125-9d32-74c90605e5df admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:33.521623 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d85e3-f7e6-4446-8261-ea136f95658d None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:33.524673 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed17fba-4dca-4994-b73b-b15129eff6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:33.525419 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed17fba-4dca-4994-b73b-b15129eff6ee admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:33.525780 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed17fba-4dca-4994-b73b-b15129eff6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:33.526289 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed17fba-4dca-4994-b73b-b15129eff6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:33.526921 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31008739-f5ee-474f-8cc4-98ebce189623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:33.527249 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed17fba-4dca-4994-b73b-b15129eff6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:33.527832 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31008739-f5ee-474f-8cc4-98ebce189623 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:33.528184 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31008739-f5ee-474f-8cc4-98ebce189623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:33.528699 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31008739-f5ee-474f-8cc4-98ebce189623 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:33.529199 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed17fba-4dca-4994-b73b-b15129eff6ee admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:33.529712 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31008739-f5ee-474f-8cc4-98ebce189623 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:33.531885 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31008739-f5ee-474f-8cc4-98ebce189623 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:33.539789 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1017/2032] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:33 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:33.541212 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed17fba-4dca-4994-b73b-b15129eff6ee admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:33.544748 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-4ed17fba-4dca-4994-b73b-b15129eff6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:33.612485 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed17fba-4dca-4994-b73b-b15129eff6ee admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:33.616516 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e004dc7-aa87-42da-8a5d-431a527374c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:33.617265 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e004dc7-aa87-42da-8a5d-431a527374c4 service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:33.617574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e004dc7-aa87-42da-8a5d-431a527374c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:33.617848 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e004dc7-aa87-42da-8a5d-431a527374c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:33.661981 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1016/2033] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:15:33 2021] POST /identity/v3/users => generated 282 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:33.665335 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31008739-f5ee-474f-8cc4-98ebce189623 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:33.678976 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31008739-f5ee-474f-8cc4-98ebce189623 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:33.686925 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d2381-84bd-4e58-97be-25e60d23d2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:33.687789 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d2381-84bd-4e58-97be-25e60d23d2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:33.688077 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d2381-84bd-4e58-97be-25e60d23d2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:33.688361 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d2381-84bd-4e58-97be-25e60d23d2b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:33.689110 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d2381-84bd-4e58-97be-25e60d23d2b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:33.690323 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e004dc7-aa87-42da-8a5d-431a527374c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:33.690931 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d2381-84bd-4e58-97be-25e60d23d2b2 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:33.691846 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e004dc7-aa87-42da-8a5d-431a527374c4 service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:33.703411 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1018/2034] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:33 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:33.704110 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e004dc7-aa87-42da-8a5d-431a527374c4 service cinder] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:33.718997 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e004dc7-aa87-42da-8a5d-431a527374c4 service cinder] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:33.723584 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1017/2035] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:33 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:33.724754 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d2381-84bd-4e58-97be-25e60d23d2b2 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:33.724891 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d33b2a-bdd3-47b4-892d-6555704cafe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:33.725463 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d33b2a-bdd3-47b4-892d-6555704cafe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:33.725980 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d33b2a-bdd3-47b4-892d-6555704cafe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:33.726262 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d33b2a-bdd3-47b4-892d-6555704cafe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:33.726806 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-709d2381-84bd-4e58-97be-25e60d23d2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:33.727053 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d33b2a-bdd3-47b4-892d-6555704cafe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:33.729792 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d33b2a-bdd3-47b4-892d-6555704cafe9 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:33.741712 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1019/2036] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:33 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:33.742520 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d33b2a-bdd3-47b4-892d-6555704cafe9 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:33.748494 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d2381-84bd-4e58-97be-25e60d23d2b2 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:33.755457 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53825389-e31e-4eff-8c82-528c9cd328dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:33.756467 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53825389-e31e-4eff-8c82-528c9cd328dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:33.756753 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53825389-e31e-4eff-8c82-528c9cd328dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:33.757247 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53825389-e31e-4eff-8c82-528c9cd328dd admin admin] PATH_INFO: `/v3/users/9c04ecf61bb2468a99223a57cb41fd18` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:33.758908 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53825389-e31e-4eff-8c82-528c9cd328dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c04ecf61bb2468a99223a57cb41fd18)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:33.761235 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53825389-e31e-4eff-8c82-528c9cd328dd admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:33.761392 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d33b2a-bdd3-47b4-892d-6555704cafe9 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:33.770495 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241d713-dfdd-4722-b9dd-51ad91ac5dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:33.775643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241d713-dfdd-4722-b9dd-51ad91ac5dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:33.776536 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241d713-dfdd-4722-b9dd-51ad91ac5dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:33.776906 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241d713-dfdd-4722-b9dd-51ad91ac5dd9 admin admin] PATH_INFO: `/v3/projects/3013e5c1cded4f4abe40529634315ed6/users/8f6c2ad8844e4db98a741ecc694ba934/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:33.809146 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241d713-dfdd-4722-b9dd-51ad91ac5dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3013e5c1cded4f4abe40529634315ed6, user_id=8f6c2ad8844e4db98a741ecc694ba934, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:33.811960 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241d713-dfdd-4722-b9dd-51ad91ac5dd9 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:33.966493 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1020/2037] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:33 2021] PUT /identity/v3/projects/3013e5c1cded4f4abe40529634315ed6/users/8f6c2ad8844e4db98a741ecc694ba934/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:33.968759 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241d713-dfdd-4722-b9dd-51ad91ac5dd9 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:34.031064 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241d713-dfdd-4722-b9dd-51ad91ac5dd9 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:34.035994 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1692dd5-978c-47a1-8e49-0b4d0ea8c444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:34.036656 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1692dd5-978c-47a1-8e49-0b4d0ea8c444 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:34.036944 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1692dd5-978c-47a1-8e49-0b4d0ea8c444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:34.037222 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1692dd5-978c-47a1-8e49-0b4d0ea8c444 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:34.037982 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1692dd5-978c-47a1-8e49-0b4d0ea8c444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:34.039723 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1692dd5-978c-47a1-8e49-0b4d0ea8c444 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:34.050144 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1021/2038] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:33 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:34.051383 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1fcda-0d45-49db-9530-9c2874f24b41 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:34.051670 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1fcda-0d45-49db-9530-9c2874f24b41 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:34.051947 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1fcda-0d45-49db-9530-9c2874f24b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:34.070154 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-53825389-e31e-4eff-8c82-528c9cd328dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c04ecf61bb2468a99223a57cb41fd18'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:34.079871 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-c1f1fcda-0d45-49db-9530-9c2874f24b41 None None] MFA Rules not processed for user `8f6c2ad8844e4db98a741ecc694ba934`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:34.081090 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c1f1fcda-0d45-49db-9530-9c2874f24b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:34.150914 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1022/2039] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:34 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:34.152032 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1fcda-0d45-49db-9530-9c2874f24b41 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:34.210068 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1fcda-0d45-49db-9530-9c2874f24b41 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:34.213833 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a86b52-adef-4098-8d60-d96ed8b9152a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:34.214576 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a86b52-adef-4098-8d60-d96ed8b9152a service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:34.214855 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a86b52-adef-4098-8d60-d96ed8b9152a service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:34.215129 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a86b52-adef-4098-8d60-d96ed8b9152a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:34.216990 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-47a86b52-adef-4098-8d60-d96ed8b9152a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:34.228663 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-53825389-e31e-4eff-8c82-528c9cd328dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c04ecf61bb2468a99223a57cb41fd18'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:34.239485 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-53825389-e31e-4eff-8c82-528c9cd328dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c04ecf61bb2468a99223a57cb41fd18'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:34.240385 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-53825389-e31e-4eff-8c82-528c9cd328dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c04ecf61bb2468a99223a57cb41fd18'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:34.253202 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-53825389-e31e-4eff-8c82-528c9cd328dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c04ecf61bb2468a99223a57cb41fd18'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:34.259797 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1018/2040] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:33 2021] DELETE /identity/v3/users/9c04ecf61bb2468a99223a57cb41fd18 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:34.261206 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53825389-e31e-4eff-8c82-528c9cd328dd admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:34.262369 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-53825389-e31e-4eff-8c82-528c9cd328dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:34.288884 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a86b52-adef-4098-8d60-d96ed8b9152a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:34.293308 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a86b52-adef-4098-8d60-d96ed8b9152a service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:34.303258 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1023/2041] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:34 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:34.304381 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a86b52-adef-4098-8d60-d96ed8b9152a service cinder] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:34.319008 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a86b52-adef-4098-8d60-d96ed8b9152a service cinder] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:34.396493 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d5f60-823f-42c4-9a7a-68f091f76310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:34.398046 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d5f60-823f-42c4-9a7a-68f091f76310 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:34.398323 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d5f60-823f-42c4-9a7a-68f091f76310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:34.399022 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d5f60-823f-42c4-9a7a-68f091f76310 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:34.399379 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d5f60-823f-42c4-9a7a-68f091f76310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:34.403339 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d5f60-823f-42c4-9a7a-68f091f76310 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:34.404945 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53825389-e31e-4eff-8c82-528c9cd328dd admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:34.410961 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0f0e7-401d-4d13-904a-c756371d0088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:34.412318 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0f0e7-401d-4d13-904a-c756371d0088 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:34.412318 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0f0e7-401d-4d13-904a-c756371d0088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:34.412596 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0f0e7-401d-4d13-904a-c756371d0088 admin admin] PATH_INFO: `/v3/projects/76641e6b40df406ab78ee47c674e3d5f/users/ab29aff8912e4f21910eb6adf5edb8e3/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:34.440617 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de0f0e7-401d-4d13-904a-c756371d0088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76641e6b40df406ab78ee47c674e3d5f, user_id=ab29aff8912e4f21910eb6adf5edb8e3, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:34.447655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de0f0e7-401d-4d13-904a-c756371d0088 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:34.514694 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1024/2042] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:15:34 2021] POST /identity/v3/projects => generated 375 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:34.516953 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d5f60-823f-42c4-9a7a-68f091f76310 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:34.518718 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-0c9d5f60-823f-42c4-9a7a-68f091f76310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:34.582807 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d5f60-823f-42c4-9a7a-68f091f76310 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:34.588307 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1019/2043] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:34 2021] PUT /identity/v3/projects/76641e6b40df406ab78ee47c674e3d5f/users/ab29aff8912e4f21910eb6adf5edb8e3/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:34.589951 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0f0e7-401d-4d13-904a-c756371d0088 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:34.591648 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-3de0f0e7-401d-4d13-904a-c756371d0088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:34.653977 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa09798-d426-489f-8b2b-fe02da9be423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:34.654653 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa09798-d426-489f-8b2b-fe02da9be423 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:34.654962 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa09798-d426-489f-8b2b-fe02da9be423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:34.655261 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa09798-d426-489f-8b2b-fe02da9be423 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:34.655991 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa09798-d426-489f-8b2b-fe02da9be423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:34.657906 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa09798-d426-489f-8b2b-fe02da9be423 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:34.666116 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0f0e7-401d-4d13-904a-c756371d0088 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:34.672482 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae335f-e5b5-4959-89da-257a009442f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:34.673383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae335f-e5b5-4959-89da-257a009442f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:34.673650 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae335f-e5b5-4959-89da-257a009442f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:34.673937 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae335f-e5b5-4959-89da-257a009442f0 admin admin] PATH_INFO: `/v3/projects/04145637610344c69dd78ebf3ecd92ed` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:34.675203 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae335f-e5b5-4959-89da-257a009442f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04145637610344c69dd78ebf3ecd92ed)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:34.677297 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae335f-e5b5-4959-89da-257a009442f0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:34.754275 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1025/2044] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:15:34 2021] POST /identity/v3/users => generated 288 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:15:34.755633 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13e3ab-c794-438f-ad8a-2b6d98c3a5c4 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:34.755924 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13e3ab-c794-438f-ad8a-2b6d98c3a5c4 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:34.756204 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13e3ab-c794-438f-ad8a-2b6d98c3a5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:34.783255 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-ff13e3ab-c794-438f-ad8a-2b6d98c3a5c4 None None] MFA Rules not processed for user `ab29aff8912e4f21910eb6adf5edb8e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:34.784518 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-ff13e3ab-c794-438f-ad8a-2b6d98c3a5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:34.797641 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-4bae335f-e5b5-4959-89da-257a009442f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04145637610344c69dd78ebf3ecd92ed', 'request_id': 'req-4bae335f-e5b5-4959-89da-257a009442f0'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:34.803614 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-4bae335f-e5b5-4959-89da-257a009442f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04145637610344c69dd78ebf3ecd92ed', 'request_id': 'req-4bae335f-e5b5-4959-89da-257a009442f0'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:34.809171 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-4bae335f-e5b5-4959-89da-257a009442f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04145637610344c69dd78ebf3ecd92ed', 'request_id': 'req-4bae335f-e5b5-4959-89da-257a009442f0'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:34.850670 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1026/2045] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:34 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:34.851376 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13e3ab-c794-438f-ad8a-2b6d98c3a5c4 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:34.921624 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-4bae335f-e5b5-4959-89da-257a009442f0 admin admin] The token cache is being invalidate because project 04145637610344c69dd78ebf3ecd92ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:34.921984 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-4bae335f-e5b5-4959-89da-257a009442f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:34.922637 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-4bae335f-e5b5-4959-89da-257a009442f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:34.930848 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1020/2046] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:34 2021] DELETE /identity/v3/projects/04145637610344c69dd78ebf3ecd92ed => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:34.930848 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae335f-e5b5-4959-89da-257a009442f0 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:34.930848 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-4bae335f-e5b5-4959-89da-257a009442f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:34.931658 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13e3ab-c794-438f-ad8a-2b6d98c3a5c4 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:34.939353 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a881b6a-b3a2-40d0-bd74-d15ee5db5569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:34.940156 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a881b6a-b3a2-40d0-bd74-d15ee5db5569 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:34.940462 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a881b6a-b3a2-40d0-bd74-d15ee5db5569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:34.940712 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a881b6a-b3a2-40d0-bd74-d15ee5db5569 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:34.941461 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a881b6a-b3a2-40d0-bd74-d15ee5db5569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:34.943069 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a881b6a-b3a2-40d0-bd74-d15ee5db5569 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:34.950550 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae335f-e5b5-4959-89da-257a009442f0 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:34.954714 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1027/2047] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:34 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:34.956304 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dd286-dea3-40e3-a31d-b765f62770ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:34.956430 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7af4a-f03c-4c7b-8e45-a4e6b497436d None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:34.956703 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7af4a-f03c-4c7b-8e45-a4e6b497436d None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:34.957043 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7af4a-f03c-4c7b-8e45-a4e6b497436d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:34.957627 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dd286-dea3-40e3-a31d-b765f62770ea admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:34.958054 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dd286-dea3-40e3-a31d-b765f62770ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:34.958528 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dd286-dea3-40e3-a31d-b765f62770ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:34.959658 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6dd286-dea3-40e3-a31d-b765f62770ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:34.970601 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6dd286-dea3-40e3-a31d-b765f62770ea admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:34.978056 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-eaa7af4a-f03c-4c7b-8e45-a4e6b497436d None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:34.980106 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-eaa7af4a-f03c-4c7b-8e45-a4e6b497436d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:34.988389 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1028/2048] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:34.989473 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7af4a-f03c-4c7b-8e45-a4e6b497436d None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:34.990722 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-eaa7af4a-f03c-4c7b-8e45-a4e6b497436d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:35.003406 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7af4a-f03c-4c7b-8e45-a4e6b497436d None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:35.008257 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93758fd0-ff3d-4626-9379-e8d78d21eb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:35.008912 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93758fd0-ff3d-4626-9379-e8d78d21eb1b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:35.009195 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93758fd0-ff3d-4626-9379-e8d78d21eb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:35.009545 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93758fd0-ff3d-4626-9379-e8d78d21eb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:35.010284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93758fd0-ff3d-4626-9379-e8d78d21eb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:35.012439 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93758fd0-ff3d-4626-9379-e8d78d21eb1b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:35.022639 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1029/2049] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:34 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:35.023981 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c246051-19da-45be-98a5-fcc5ebabe9bb None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:35.024267 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c246051-19da-45be-98a5-fcc5ebabe9bb None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:35.024538 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c246051-19da-45be-98a5-fcc5ebabe9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:35.043474 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-7c246051-19da-45be-98a5-fcc5ebabe9bb None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:35.044703 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-7c246051-19da-45be-98a5-fcc5ebabe9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:35.053080 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1030/2050] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:35.053887 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c246051-19da-45be-98a5-fcc5ebabe9bb None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:35.063267 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c246051-19da-45be-98a5-fcc5ebabe9bb None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:35.067901 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9533a7-245a-446c-bb50-ad8a73a78322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:35.068767 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9533a7-245a-446c-bb50-ad8a73a78322 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:35.069050 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9533a7-245a-446c-bb50-ad8a73a78322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:35.069324 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9533a7-245a-446c-bb50-ad8a73a78322 admin admin] PATH_INFO: `/v3/projects/525ea43fe1f74636a2d4637ab6bef409/users/b72c728a64564c368b99743a74fa69fa/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:35.084467 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9533a7-245a-446c-bb50-ad8a73a78322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=525ea43fe1f74636a2d4637ab6bef409, user_id=b72c728a64564c368b99743a74fa69fa, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:35.087091 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9533a7-245a-446c-bb50-ad8a73a78322 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:35.094600 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1021/2051] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:15:34 2021] POST /identity/v3/projects => generated 365 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:35.094600 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dd286-dea3-40e3-a31d-b765f62770ea admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:35.162363 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dd286-dea3-40e3-a31d-b765f62770ea admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:35.167728 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf09b1c-f972-4e5e-87ef-7e4519eb8694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:35.168384 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf09b1c-f972-4e5e-87ef-7e4519eb8694 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:35.168669 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf09b1c-f972-4e5e-87ef-7e4519eb8694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:35.168943 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf09b1c-f972-4e5e-87ef-7e4519eb8694 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:35.169672 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf09b1c-f972-4e5e-87ef-7e4519eb8694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:15:35.169974 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf09b1c-f972-4e5e-87ef-7e4519eb8694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:35.171578 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf09b1c-f972-4e5e-87ef-7e4519eb8694 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:35.183419 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1031/2052] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:35 2021] PUT /identity/v3/projects/525ea43fe1f74636a2d4637ab6bef409/users/b72c728a64564c368b99743a74fa69fa/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:35.184453 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9533a7-245a-446c-bb50-ad8a73a78322 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:35.187131 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1022/2053] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:15:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:15:35.188059 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf09b1c-f972-4e5e-87ef-7e4519eb8694 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:35.199106 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf09b1c-f972-4e5e-87ef-7e4519eb8694 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:35.264772 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d510af-ed6e-49e4-8b69-de5c868f9db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:35.265514 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d510af-ed6e-49e4-8b69-de5c868f9db6 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:35.265890 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d510af-ed6e-49e4-8b69-de5c868f9db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:35.266289 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d510af-ed6e-49e4-8b69-de5c868f9db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:35.267064 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d510af-ed6e-49e4-8b69-de5c868f9db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:35.267683 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9533a7-245a-446c-bb50-ad8a73a78322 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:35.269487 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d510af-ed6e-49e4-8b69-de5c868f9db6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:35.272780 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa02ee-66a7-4dec-862e-e72d70f9510e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:35.273515 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa02ee-66a7-4dec-862e-e72d70f9510e admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:35.273873 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa02ee-66a7-4dec-862e-e72d70f9510e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:35.274224 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa02ee-66a7-4dec-862e-e72d70f9510e admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:35.274998 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa02ee-66a7-4dec-862e-e72d70f9510e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:35.277897 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa02ee-66a7-4dec-862e-e72d70f9510e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:35.392290 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1032/2054] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:15:35 2021] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:35.393806 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ce3ca-e68d-4e24-884d-91b5bf0c4804 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:35.394114 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1023/2055] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:15:35 2021] POST /identity/v3/projects => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:35.394390 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ce3ca-e68d-4e24-884d-91b5bf0c4804 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:35.394672 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ce3ca-e68d-4e24-884d-91b5bf0c4804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:35.396146 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d510af-ed6e-49e4-8b69-de5c868f9db6 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:35.426671 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-552ce3ca-e68d-4e24-884d-91b5bf0c4804 None None] MFA Rules not processed for user `b72c728a64564c368b99743a74fa69fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:35.427821 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-552ce3ca-e68d-4e24-884d-91b5bf0c4804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:35.479186 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d510af-ed6e-49e4-8b69-de5c868f9db6 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:35.484628 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fd128-8d1e-4408-b8d6-3b61cae3c817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:35.485852 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fd128-8d1e-4408-b8d6-3b61cae3c817 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:35.486106 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fd128-8d1e-4408-b8d6-3b61cae3c817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:35.486390 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fd128-8d1e-4408-b8d6-3b61cae3c817 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:35.487138 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3fd128-8d1e-4408-b8d6-3b61cae3c817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:35.488736 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3fd128-8d1e-4408-b8d6-3b61cae3c817 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:35.498052 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1033/2056] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:35 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:35.499001 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ce3ca-e68d-4e24-884d-91b5bf0c4804 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:35.503403 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1024/2057] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:35 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:35.503403 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fd128-8d1e-4408-b8d6-3b61cae3c817 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:35.513010 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fd128-8d1e-4408-b8d6-3b61cae3c817 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:35.513206 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ce3ca-e68d-4e24-884d-91b5bf0c4804 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:35.517754 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36262f44-62ea-429c-938d-2bf8a101e6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:35.517988 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8585590-8ef3-4e0a-a9e7-6f222adaaf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:35.518389 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36262f44-62ea-429c-938d-2bf8a101e6a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:35.518489 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8585590-8ef3-4e0a-a9e7-6f222adaaf18 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:35.518671 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36262f44-62ea-429c-938d-2bf8a101e6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:35.518779 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8585590-8ef3-4e0a-a9e7-6f222adaaf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:35.518943 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36262f44-62ea-429c-938d-2bf8a101e6a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:35.519032 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8585590-8ef3-4e0a-a9e7-6f222adaaf18 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:35.519668 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36262f44-62ea-429c-938d-2bf8a101e6a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:35.519774 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8585590-8ef3-4e0a-a9e7-6f222adaaf18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:35.521538 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36262f44-62ea-429c-938d-2bf8a101e6a0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:35.521812 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8585590-8ef3-4e0a-a9e7-6f222adaaf18 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:35.644687 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1034/2058] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:15:35 2021] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:35.645699 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8585590-8ef3-4e0a-a9e7-6f222adaaf18 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:35.646873 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1025/2059] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:15:35 2021] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:15:35.649711 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36262f44-62ea-429c-938d-2bf8a101e6a0 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:35.660676 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8585590-8ef3-4e0a-a9e7-6f222adaaf18 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:35.728743 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36262f44-62ea-429c-938d-2bf8a101e6a0 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:35.732284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190a37c-e810-4ca9-9cc4-419367d2b138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:35.733844 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190a37c-e810-4ca9-9cc4-419367d2b138 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:35.733844 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190a37c-e810-4ca9-9cc4-419367d2b138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:35.734073 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190a37c-e810-4ca9-9cc4-419367d2b138 admin admin] PATH_INFO: `/v3/projects/24c4944a2bd740d7a70f88d42f4e9276/users/58b6355208614360a2c720e65f103c33/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:35.734774 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78728c4-591a-4a68-8698-04048faf32b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:35.735575 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78728c4-591a-4a68-8698-04048faf32b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:35.735931 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78728c4-591a-4a68-8698-04048faf32b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:35.736841 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78728c4-591a-4a68-8698-04048faf32b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:35.737263 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78728c4-591a-4a68-8698-04048faf32b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:35.739373 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78728c4-591a-4a68-8698-04048faf32b0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:35.753927 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190a37c-e810-4ca9-9cc4-419367d2b138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24c4944a2bd740d7a70f88d42f4e9276, user_id=58b6355208614360a2c720e65f103c33, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:35.756717 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190a37c-e810-4ca9-9cc4-419367d2b138 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:35.854035 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1026/2060] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:15:35 2021] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:15:35.854035 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78728c4-591a-4a68-8698-04048faf32b0 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:35.862226 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78728c4-591a-4a68-8698-04048faf32b0 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:35.867358 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6cf875-5f71-4141-a634-b3bc57bcf9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:35.868056 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6cf875-5f71-4141-a634-b3bc57bcf9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:35.868345 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6cf875-5f71-4141-a634-b3bc57bcf9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:35.868627 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6cf875-5f71-4141-a634-b3bc57bcf9a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:35.869412 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6cf875-5f71-4141-a634-b3bc57bcf9a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:35.872339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6cf875-5f71-4141-a634-b3bc57bcf9a3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:35.883633 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1027/2061] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:35 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:35.884854 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6cf875-5f71-4141-a634-b3bc57bcf9a3 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:35.891749 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1035/2062] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:35 2021] PUT /identity/v3/projects/24c4944a2bd740d7a70f88d42f4e9276/users/58b6355208614360a2c720e65f103c33/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:35.892757 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190a37c-e810-4ca9-9cc4-419367d2b138 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:35.899797 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6cf875-5f71-4141-a634-b3bc57bcf9a3 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:35.960001 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82395a12-a7b3-430c-ae86-376fe8eb1c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:35.961490 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82395a12-a7b3-430c-ae86-376fe8eb1c07 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:35.961794 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82395a12-a7b3-430c-ae86-376fe8eb1c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:35.962079 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82395a12-a7b3-430c-ae86-376fe8eb1c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:35.963288 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82395a12-a7b3-430c-ae86-376fe8eb1c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:35.965271 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190a37c-e810-4ca9-9cc4-419367d2b138 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:35.965919 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82395a12-a7b3-430c-ae86-376fe8eb1c07 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:35.970192 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1637895-cb1d-45a6-b254-f14db9b2c0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:35.970960 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1637895-cb1d-45a6-b254-f14db9b2c0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:35.971512 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1637895-cb1d-45a6-b254-f14db9b2c0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:35.971886 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1637895-cb1d-45a6-b254-f14db9b2c0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:35.972745 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1637895-cb1d-45a6-b254-f14db9b2c0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:35.974770 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1637895-cb1d-45a6-b254-f14db9b2c0b2 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:35.976593 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1028/2063] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:35 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:35.982396 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82395a12-a7b3-430c-ae86-376fe8eb1c07 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:35.990156 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1036/2064] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:35 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:35.990156 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1637895-cb1d-45a6-b254-f14db9b2c0b2 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:35.992583 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82395a12-a7b3-430c-ae86-376fe8eb1c07 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:35.997994 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4f46c-c6db-47c4-b960-985869af2eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:35.998656 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4f46c-c6db-47c4-b960-985869af2eae admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:35.998937 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4f46c-c6db-47c4-b960-985869af2eae admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:35.999269 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4f46c-c6db-47c4-b960-985869af2eae admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:35.999981 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4f46c-c6db-47c4-b960-985869af2eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:36.000985 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1637895-cb1d-45a6-b254-f14db9b2c0b2 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:36.001653 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4f46c-c6db-47c4-b960-985869af2eae admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:36.005974 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec634d-a61e-4a55-b6ce-ed1389df64f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:36.006912 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec634d-a61e-4a55-b6ce-ed1389df64f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:36.007296 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec634d-a61e-4a55-b6ce-ed1389df64f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:36.007630 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec634d-a61e-4a55-b6ce-ed1389df64f9 admin admin] PATH_INFO: `/v3/projects/b470e86383554e74a093944c32239b2a/users/e57c18ce3a9c4eb9ac004aa8d50ea791/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:36.012533 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1029/2065] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:35 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:36.016509 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4f46c-c6db-47c4-b960-985869af2eae admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:36.024988 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec634d-a61e-4a55-b6ce-ed1389df64f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b470e86383554e74a093944c32239b2a, user_id=e57c18ce3a9c4eb9ac004aa8d50ea791, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:36.028593 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec634d-a61e-4a55-b6ce-ed1389df64f9 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:36.028890 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4f46c-c6db-47c4-b960-985869af2eae admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:36.034490 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d2158-610d-49e6-b283-886bac220d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:36.035567 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d2158-610d-49e6-b283-886bac220d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:36.035982 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d2158-610d-49e6-b283-886bac220d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:36.036386 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d2158-610d-49e6-b283-886bac220d99 admin admin] PATH_INFO: `/v3/projects/29e43451921e484d8ae90b7f916f64d4/users/4588f7fb2e604e44a7450f734e7e695a/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:36.054214 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d2158-610d-49e6-b283-886bac220d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e43451921e484d8ae90b7f916f64d4, user_id=4588f7fb2e604e44a7450f734e7e695a, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:36.057178 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d2158-610d-49e6-b283-886bac220d99 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:36.148652 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1037/2066] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:35 2021] PUT /identity/v3/projects/b470e86383554e74a093944c32239b2a/users/e57c18ce3a9c4eb9ac004aa8d50ea791/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:36.149558 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec634d-a61e-4a55-b6ce-ed1389df64f9 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:36.194651 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1030/2067] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:36 2021] PUT /identity/v3/projects/29e43451921e484d8ae90b7f916f64d4/users/4588f7fb2e604e44a7450f734e7e695a/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:36.198434 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d2158-610d-49e6-b283-886bac220d99 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:36.281354 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec634d-a61e-4a55-b6ce-ed1389df64f9 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:36.326705 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d2158-610d-49e6-b283-886bac220d99 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:36.341512 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80645e-3c60-4ff5-a6c7-3885c8219281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:36.342345 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80645e-3c60-4ff5-a6c7-3885c8219281 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:36.342742 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80645e-3c60-4ff5-a6c7-3885c8219281 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:36.343096 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80645e-3c60-4ff5-a6c7-3885c8219281 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:36.343938 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80645e-3c60-4ff5-a6c7-3885c8219281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:36.345708 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80645e-3c60-4ff5-a6c7-3885c8219281 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:36.356921 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1031/2068] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:36 2021] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:36.358378 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064885f-8dfc-4f78-a235-42344a447df9 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:36.358670 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064885f-8dfc-4f78-a235-42344a447df9 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:36.358952 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064885f-8dfc-4f78-a235-42344a447df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:36.380979 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645243ca-0d83-4966-8bc7-e985bbf9811e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:36.382016 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645243ca-0d83-4966-8bc7-e985bbf9811e admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:36.382306 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645243ca-0d83-4966-8bc7-e985bbf9811e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:36.382585 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645243ca-0d83-4966-8bc7-e985bbf9811e admin admin] PATH_INFO: `/v3/projects/24c4944a2bd740d7a70f88d42f4e9276/users/58b6355208614360a2c720e65f103c33/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:36.384828 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645243ca-0d83-4966-8bc7-e985bbf9811e admin admin] RBAC: Authorizing `identity:create_grant(project_id=24c4944a2bd740d7a70f88d42f4e9276, user_id=58b6355208614360a2c720e65f103c33, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:36.388754 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645243ca-0d83-4966-8bc7-e985bbf9811e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:36.394207 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-e064885f-8dfc-4f78-a235-42344a447df9 None None] MFA Rules not processed for user `4588f7fb2e604e44a7450f734e7e695a`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:36.396298 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e064885f-8dfc-4f78-a235-42344a447df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:36.403257 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1038/2069] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:36 2021] PUT /identity/v3/projects/24c4944a2bd740d7a70f88d42f4e9276/users/58b6355208614360a2c720e65f103c33/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:36.404239 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645243ca-0d83-4966-8bc7-e985bbf9811e admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:36.484633 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1032/2070] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:36 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:36.486122 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b27a4-f090-4d99-a351-0d8f4c1cc6a3 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:36.486408 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b27a4-f090-4d99-a351-0d8f4c1cc6a3 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:36.486683 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b27a4-f090-4d99-a351-0d8f4c1cc6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:36.519592 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-367b27a4-f090-4d99-a351-0d8f4c1cc6a3 None None] MFA Rules not processed for user `58b6355208614360a2c720e65f103c33`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:36.520471 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645243ca-0d83-4966-8bc7-e985bbf9811e admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:36.520950 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-367b27a4-f090-4d99-a351-0d8f4c1cc6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:36.526241 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3ee46-4ea5-4e6a-a739-17b281e4ce0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:36.527235 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3ee46-4ea5-4e6a-a739-17b281e4ce0b admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:36.527513 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3ee46-4ea5-4e6a-a739-17b281e4ce0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:36.527785 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3ee46-4ea5-4e6a-a739-17b281e4ce0b admin admin] PATH_INFO: `/v3/projects/b470e86383554e74a093944c32239b2a/users/e57c18ce3a9c4eb9ac004aa8d50ea791/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:36.529834 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3ee46-4ea5-4e6a-a739-17b281e4ce0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b470e86383554e74a093944c32239b2a, user_id=e57c18ce3a9c4eb9ac004aa8d50ea791, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:36.532724 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3ee46-4ea5-4e6a-a739-17b281e4ce0b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:36.544817 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1039/2071] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:36 2021] PUT /identity/v3/projects/b470e86383554e74a093944c32239b2a/users/e57c18ce3a9c4eb9ac004aa8d50ea791/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:36.545768 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3ee46-4ea5-4e6a-a739-17b281e4ce0b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:36.547836 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-eaa3ee46-4ea5-4e6a-a739-17b281e4ce0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:36.599467 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1033/2072] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:36 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:36.601159 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ec817-d7f1-4505-8b5a-118f89392823 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:36.601557 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ec817-d7f1-4505-8b5a-118f89392823 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:36.602379 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ec817-d7f1-4505-8b5a-118f89392823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:36.607056 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3ee46-4ea5-4e6a-a739-17b281e4ce0b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:36.611170 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfc441-7c9e-4b05-a18a-ee86ca87d05f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:36.611836 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfc441-7c9e-4b05-a18a-ee86ca87d05f service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:36.612118 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfc441-7c9e-4b05-a18a-ee86ca87d05f service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:36.612397 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfc441-7c9e-4b05-a18a-ee86ca87d05f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:36.633934 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-e43ec817-d7f1-4505-8b5a-118f89392823 None None] MFA Rules not processed for user `e57c18ce3a9c4eb9ac004aa8d50ea791`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:36.635431 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e43ec817-d7f1-4505-8b5a-118f89392823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:36.690394 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfc441-7c9e-4b05-a18a-ee86ca87d05f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:36.691974 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfc441-7c9e-4b05-a18a-ee86ca87d05f service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:36.709180 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1040/2073] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:36 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:36.765293 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1034/2074] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:36 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:36.766224 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ec817-d7f1-4505-8b5a-118f89392823 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:36.766533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfc441-7c9e-4b05-a18a-ee86ca87d05f service cinder] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:36.779507 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ec817-d7f1-4505-8b5a-118f89392823 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:36.783845 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c4063-09e3-44a8-bf85-61f5dcd88ec7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:36.784611 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c4063-09e3-44a8-bf85-61f5dcd88ec7 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:36.785128 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c4063-09e3-44a8-bf85-61f5dcd88ec7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:36.785560 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c4063-09e3-44a8-bf85-61f5dcd88ec7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:36.844081 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfc441-7c9e-4b05-a18a-ee86ca87d05f service cinder] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:36.849739 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f91bc4-4218-48f7-b8a5-05b36cdc0174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:36.850487 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f91bc4-4218-48f7-b8a5-05b36cdc0174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:36.850877 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f91bc4-4218-48f7-b8a5-05b36cdc0174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:36.851269 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f91bc4-4218-48f7-b8a5-05b36cdc0174 admin admin] PATH_INFO: `/v3/users/4588f7fb2e604e44a7450f734e7e695a` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:36.852596 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f91bc4-4218-48f7-b8a5-05b36cdc0174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4588f7fb2e604e44a7450f734e7e695a)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:36.856208 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f91bc4-4218-48f7-b8a5-05b36cdc0174 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:36.869322 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c4063-09e3-44a8-bf85-61f5dcd88ec7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:36.872369 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c4063-09e3-44a8-bf85-61f5dcd88ec7 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:36.890194 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1035/2075] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:36 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:36.891050 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c4063-09e3-44a8-bf85-61f5dcd88ec7 service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:36.892655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-0e6c4063-09e3-44a8-bf85-61f5dcd88ec7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:36.905507 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c4063-09e3-44a8-bf85-61f5dcd88ec7 service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:36.908984 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf242725-ff7a-45bd-a744-2acc9b532f91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:36.909833 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf242725-ff7a-45bd-a744-2acc9b532f91 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:36.914015 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf242725-ff7a-45bd-a744-2acc9b532f91 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:36.914015 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf242725-ff7a-45bd-a744-2acc9b532f91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:36.914015 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-bf242725-ff7a-45bd-a744-2acc9b532f91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:36.978422 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf242725-ff7a-45bd-a744-2acc9b532f91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:36.980323 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf242725-ff7a-45bd-a744-2acc9b532f91 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:36.991802 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1036/2076] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:36 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:37.139851 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c4f91bc4-4218-48f7-b8a5-05b36cdc0174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4588f7fb2e604e44a7450f734e7e695a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:37.216335 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf242725-ff7a-45bd-a744-2acc9b532f91 service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:37.225600 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf242725-ff7a-45bd-a744-2acc9b532f91 service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:37.229919 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfe814-1ca5-4166-9f43-316e4b8f619a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:37.231100 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfe814-1ca5-4166-9f43-316e4b8f619a service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:37.231100 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfe814-1ca5-4166-9f43-316e4b8f619a service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:37.231298 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfe814-1ca5-4166-9f43-316e4b8f619a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:37.233432 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-51dfe814-1ca5-4166-9f43-316e4b8f619a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:37.285339 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c4f91bc4-4218-48f7-b8a5-05b36cdc0174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4588f7fb2e604e44a7450f734e7e695a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:37.293673 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c4f91bc4-4218-48f7-b8a5-05b36cdc0174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4588f7fb2e604e44a7450f734e7e695a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:37.296978 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c4f91bc4-4218-48f7-b8a5-05b36cdc0174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4588f7fb2e604e44a7450f734e7e695a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:37.297086 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dfe814-1ca5-4166-9f43-316e4b8f619a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:37.297692 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dfe814-1ca5-4166-9f43-316e4b8f619a service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:37.308591 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1037/2077] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:37 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:37.310513 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c4f91bc4-4218-48f7-b8a5-05b36cdc0174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4588f7fb2e604e44a7450f734e7e695a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:37.317958 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1041/2078] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:36 2021] DELETE /identity/v3/users/4588f7fb2e604e44a7450f734e7e695a => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:37.322562 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af028b7f-981a-4bb5-9cc2-ffe59e1cc730 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:37.323473 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af028b7f-981a-4bb5-9cc2-ffe59e1cc730 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:37.323972 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af028b7f-981a-4bb5-9cc2-ffe59e1cc730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:37.344810 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-af028b7f-981a-4bb5-9cc2-ffe59e1cc730 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:37.346010 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-af028b7f-981a-4bb5-9cc2-ffe59e1cc730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:37.414598 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1038/2079] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:37.431625 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f91bc4-4218-48f7-b8a5-05b36cdc0174 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:37.434214 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c4f91bc4-4218-48f7-b8a5-05b36cdc0174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:37.499089 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f91bc4-4218-48f7-b8a5-05b36cdc0174 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:37.503538 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc46c7-1b9d-4c38-bc8c-e5595086523f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:37.503722 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc46c7-1b9d-4c38-bc8c-e5595086523f service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:37.504141 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc46c7-1b9d-4c38-bc8c-e5595086523f service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:37.504811 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc46c7-1b9d-4c38-bc8c-e5595086523f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:37.515649 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc46c7-1b9d-4c38-bc8c-e5595086523f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:37.517114 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc46c7-1b9d-4c38-bc8c-e5595086523f service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:37.530543 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1042/2080] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:15:38.001454 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af028b7f-981a-4bb5-9cc2-ffe59e1cc730 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:38.002878 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-af028b7f-981a-4bb5-9cc2-ffe59e1cc730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:38.015481 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af028b7f-981a-4bb5-9cc2-ffe59e1cc730 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:38.022729 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf664f87-533e-4fde-9f6c-694120c09be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:38.024191 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf664f87-533e-4fde-9f6c-694120c09be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:38.028619 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf664f87-533e-4fde-9f6c-694120c09be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:38.028619 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf664f87-533e-4fde-9f6c-694120c09be1 admin admin] PATH_INFO: `/v3/projects/29e43451921e484d8ae90b7f916f64d4` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:38.028619 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf664f87-533e-4fde-9f6c-694120c09be1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29e43451921e484d8ae90b7f916f64d4)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:38.029207 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf664f87-533e-4fde-9f6c-694120c09be1 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:38.182843 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-bf664f87-533e-4fde-9f6c-694120c09be1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29e43451921e484d8ae90b7f916f64d4', 'request_id': 'req-bf664f87-533e-4fde-9f6c-694120c09be1'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:38.189975 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-bf664f87-533e-4fde-9f6c-694120c09be1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29e43451921e484d8ae90b7f916f64d4', 'request_id': 'req-bf664f87-533e-4fde-9f6c-694120c09be1'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:38.196450 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-bf664f87-533e-4fde-9f6c-694120c09be1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29e43451921e484d8ae90b7f916f64d4', 'request_id': 'req-bf664f87-533e-4fde-9f6c-694120c09be1'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:38.312921 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-bf664f87-533e-4fde-9f6c-694120c09be1 admin admin] The token cache is being invalidate because project 29e43451921e484d8ae90b7f916f64d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:38.313709 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-bf664f87-533e-4fde-9f6c-694120c09be1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:38.314689 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-bf664f87-533e-4fde-9f6c-694120c09be1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:38.317685 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1039/2081] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:38 2021] DELETE /identity/v3/projects/29e43451921e484d8ae90b7f916f64d4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:38.324278 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d59a61-a2e8-4f5b-87bc-34031c21ad79 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:38.327567 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d59a61-a2e8-4f5b-87bc-34031c21ad79 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:38.328082 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d59a61-a2e8-4f5b-87bc-34031c21ad79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:38.353138 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-11d59a61-a2e8-4f5b-87bc-34031c21ad79 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:38.354103 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-11d59a61-a2e8-4f5b-87bc-34031c21ad79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:38.430962 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1043/2082] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:15:38.433846 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040fff4-7df2-442c-902a-d2ef67aaeb68 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:38.434217 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040fff4-7df2-442c-902a-d2ef67aaeb68 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:38.434575 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040fff4-7df2-442c-902a-d2ef67aaeb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:38.456498 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-6040fff4-7df2-442c-902a-d2ef67aaeb68 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:38.457746 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-6040fff4-7df2-442c-902a-d2ef67aaeb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:38.466598 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1040/2083] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:38.470950 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d59a61-a2e8-4f5b-87bc-34031c21ad79 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:38.481185 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d59a61-a2e8-4f5b-87bc-34031c21ad79 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:38.486188 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097bd3b-06e8-4ac7-8226-d549d63ba4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:38.486895 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097bd3b-06e8-4ac7-8226-d549d63ba4af admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:38.487178 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097bd3b-06e8-4ac7-8226-d549d63ba4af admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:38.487484 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097bd3b-06e8-4ac7-8226-d549d63ba4af admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:38.488229 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097bd3b-06e8-4ac7-8226-d549d63ba4af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:15:38.488541 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097bd3b-06e8-4ac7-8226-d549d63ba4af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:38.490128 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097bd3b-06e8-4ac7-8226-d549d63ba4af admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:38.506094 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1044/2084] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:15:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:15:38.511486 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040fff4-7df2-442c-902a-d2ef67aaeb68 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:38.521879 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040fff4-7df2-442c-902a-d2ef67aaeb68 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:38.527486 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d1be9-1fa7-4600-a98a-2c13aecf4d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:38.528520 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d1be9-1fa7-4600-a98a-2c13aecf4d64 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:38.528520 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d1be9-1fa7-4600-a98a-2c13aecf4d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:38.528775 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d1be9-1fa7-4600-a98a-2c13aecf4d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:38.529509 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d1be9-1fa7-4600-a98a-2c13aecf4d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:38.531415 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d1be9-1fa7-4600-a98a-2c13aecf4d64 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:38.682620 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1041/2085] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:15:38 2021] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:38.684473 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097bd3b-06e8-4ac7-8226-d549d63ba4af admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:38.696570 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097bd3b-06e8-4ac7-8226-d549d63ba4af admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:38.757776 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd7c53-b259-4386-8464-0484c7632046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:38.758605 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd7c53-b259-4386-8464-0484c7632046 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:38.758886 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd7c53-b259-4386-8464-0484c7632046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:38.759161 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd7c53-b259-4386-8464-0484c7632046 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:38.759896 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd7c53-b259-4386-8464-0484c7632046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:38.762614 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd7c53-b259-4386-8464-0484c7632046 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:38.904229 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1045/2086] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:15:38 2021] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:38.905703 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d1be9-1fa7-4600-a98a-2c13aecf4d64 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:38.917434 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d1be9-1fa7-4600-a98a-2c13aecf4d64 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:38.923715 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cec953-e4b9-4bb7-a2fb-65da21a42d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:38.924934 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cec953-e4b9-4bb7-a2fb-65da21a42d6f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:38.925325 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cec953-e4b9-4bb7-a2fb-65da21a42d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:38.925781 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cec953-e4b9-4bb7-a2fb-65da21a42d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:38.926652 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cec953-e4b9-4bb7-a2fb-65da21a42d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:38.928520 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cec953-e4b9-4bb7-a2fb-65da21a42d6f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:38.940740 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1042/2087] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:38 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:38.944470 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd7c53-b259-4386-8464-0484c7632046 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:38.958934 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd7c53-b259-4386-8464-0484c7632046 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:38.969902 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a348ba1-8d8b-48b6-a865-cb801cbfdf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:38.969902 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a348ba1-8d8b-48b6-a865-cb801cbfdf7e admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:38.969902 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a348ba1-8d8b-48b6-a865-cb801cbfdf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:38.969902 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a348ba1-8d8b-48b6-a865-cb801cbfdf7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:38.970385 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a348ba1-8d8b-48b6-a865-cb801cbfdf7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:38.970385 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a348ba1-8d8b-48b6-a865-cb801cbfdf7e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:38.984041 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1046/2088] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:38 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:15:38.985130 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cec953-e4b9-4bb7-a2fb-65da21a42d6f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:38.999550 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cec953-e4b9-4bb7-a2fb-65da21a42d6f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:39.019754 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919751a-9907-4adb-87b2-b39d738e755b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:39.021170 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919751a-9907-4adb-87b2-b39d738e755b admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:39.021551 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919751a-9907-4adb-87b2-b39d738e755b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:39.021925 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919751a-9907-4adb-87b2-b39d738e755b admin admin] PATH_INFO: `/v3/projects/28f855b1c5bc4af599cabb30b768eb4e/users/f00b0784616945adbcc319f14c720a63/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:39.053023 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919751a-9907-4adb-87b2-b39d738e755b admin admin] RBAC: Authorizing `identity:create_grant(project_id=28f855b1c5bc4af599cabb30b768eb4e, user_id=f00b0784616945adbcc319f14c720a63, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:39.055748 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919751a-9907-4adb-87b2-b39d738e755b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:39.128803 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1043/2089] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:38 2021] PUT /identity/v3/projects/28f855b1c5bc4af599cabb30b768eb4e/users/f00b0784616945adbcc319f14c720a63/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:39.141056 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3c1f7-5031-4433-9c59-7bd3342c91fb None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:39.141341 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3c1f7-5031-4433-9c59-7bd3342c91fb None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:39.141634 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3c1f7-5031-4433-9c59-7bd3342c91fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:39.186114 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-19c3c1f7-5031-4433-9c59-7bd3342c91fb None None] MFA Rules not processed for user `f00b0784616945adbcc319f14c720a63`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:39.186114 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-19c3c1f7-5031-4433-9c59-7bd3342c91fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:39.259576 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1047/2090] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:39 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:39.341525 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919751a-9907-4adb-87b2-b39d738e755b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:39.343240 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-0919751a-9907-4adb-87b2-b39d738e755b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:39.402039 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919751a-9907-4adb-87b2-b39d738e755b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:39.403083 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b42d7-0e97-4b57-9976-f44db34a76cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:39.403732 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b42d7-0e97-4b57-9976-f44db34a76cf service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:39.404014 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b42d7-0e97-4b57-9976-f44db34a76cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:39.404293 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b42d7-0e97-4b57-9976-f44db34a76cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:39.413509 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b42d7-0e97-4b57-9976-f44db34a76cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:39.415253 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b42d7-0e97-4b57-9976-f44db34a76cf service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:39.424671 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1044/2091] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:39 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:40.173320 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3c1f7-5031-4433-9c59-7bd3342c91fb None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:40.186462 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3c1f7-5031-4433-9c59-7bd3342c91fb None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:40.196009 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8fffa-f3d0-492c-945e-5accf1c38cdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:40.196834 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8fffa-f3d0-492c-945e-5accf1c38cdd service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:40.197188 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8fffa-f3d0-492c-945e-5accf1c38cdd service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:40.197531 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8fffa-f3d0-492c-945e-5accf1c38cdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:40.200259 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-a5a8fffa-f3d0-492c-945e-5accf1c38cdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:40.267847 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8fffa-f3d0-492c-945e-5accf1c38cdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:40.269357 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8fffa-f3d0-492c-945e-5accf1c38cdd service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:40.285414 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1048/2092] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:40 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:42.484516 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b42d7-0e97-4b57-9976-f44db34a76cf service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:42.486743 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-137b42d7-0e97-4b57-9976-f44db34a76cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:42.674959 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b42d7-0e97-4b57-9976-f44db34a76cf service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:42.680699 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45280d7-e2d1-435c-aa5f-d2dc26fcde28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:42.682038 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45280d7-e2d1-435c-aa5f-d2dc26fcde28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:42.683486 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45280d7-e2d1-435c-aa5f-d2dc26fcde28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:42.683486 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45280d7-e2d1-435c-aa5f-d2dc26fcde28 admin admin] PATH_INFO: `/v3/users/ab29aff8912e4f21910eb6adf5edb8e3` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:42.684608 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45280d7-e2d1-435c-aa5f-d2dc26fcde28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab29aff8912e4f21910eb6adf5edb8e3)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:42.693653 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45280d7-e2d1-435c-aa5f-d2dc26fcde28 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:42.936413 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8fffa-f3d0-492c-945e-5accf1c38cdd service cinder] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:42.938076 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-a5a8fffa-f3d0-492c-945e-5accf1c38cdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:42.955734 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8fffa-f3d0-492c-945e-5accf1c38cdd service cinder] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:42.961092 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e836c-402e-4f2d-8382-f4eb5423f575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:42.962095 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e836c-402e-4f2d-8382-f4eb5423f575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:42.962514 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e836c-402e-4f2d-8382-f4eb5423f575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:42.962822 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e836c-402e-4f2d-8382-f4eb5423f575 admin admin] PATH_INFO: `/v3/users/ca2c93f062f4488cb6f915c26d061f79` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:42.969890 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e836c-402e-4f2d-8382-f4eb5423f575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca2c93f062f4488cb6f915c26d061f79)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:42.969890 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e836c-402e-4f2d-8382-f4eb5423f575 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:43.009880 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d45280d7-e2d1-435c-aa5f-d2dc26fcde28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab29aff8912e4f21910eb6adf5edb8e3'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:43.098921 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d45280d7-e2d1-435c-aa5f-d2dc26fcde28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab29aff8912e4f21910eb6adf5edb8e3'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:43.106955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d45280d7-e2d1-435c-aa5f-d2dc26fcde28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab29aff8912e4f21910eb6adf5edb8e3'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:43.107799 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d45280d7-e2d1-435c-aa5f-d2dc26fcde28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab29aff8912e4f21910eb6adf5edb8e3'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:43.119412 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d45280d7-e2d1-435c-aa5f-d2dc26fcde28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab29aff8912e4f21910eb6adf5edb8e3'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:43.125521 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1045/2093] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:42 2021] DELETE /identity/v3/users/ab29aff8912e4f21910eb6adf5edb8e3 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:43.128655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45280d7-e2d1-435c-aa5f-d2dc26fcde28 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:43.129486 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-d45280d7-e2d1-435c-aa5f-d2dc26fcde28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:43.201492 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-a41e836c-402e-4f2d-8382-f4eb5423f575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca2c93f062f4488cb6f915c26d061f79'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:43.306308 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-a41e836c-402e-4f2d-8382-f4eb5423f575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca2c93f062f4488cb6f915c26d061f79'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:43.315446 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-a41e836c-402e-4f2d-8382-f4eb5423f575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca2c93f062f4488cb6f915c26d061f79'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:43.316088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-a41e836c-402e-4f2d-8382-f4eb5423f575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca2c93f062f4488cb6f915c26d061f79'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:43.318638 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45280d7-e2d1-435c-aa5f-d2dc26fcde28 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:43.325081 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9f07a-624a-497c-a080-3a5d7ef64cbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:43.325867 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9f07a-624a-497c-a080-3a5d7ef64cbf service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:43.326193 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9f07a-624a-497c-a080-3a5d7ef64cbf service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:43.326688 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9f07a-624a-497c-a080-3a5d7ef64cbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:43.329120 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-c4a9f07a-624a-497c-a080-3a5d7ef64cbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:43.329823 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-a41e836c-402e-4f2d-8382-f4eb5423f575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca2c93f062f4488cb6f915c26d061f79'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:43.335964 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1049/2094] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:42 2021] DELETE /identity/v3/users/ca2c93f062f4488cb6f915c26d061f79 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:43.337321 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa8bb5-2cb9-4efb-986f-b30aadc22730 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:43.337612 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa8bb5-2cb9-4efb-986f-b30aadc22730 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:43.337890 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa8bb5-2cb9-4efb-986f-b30aadc22730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:43.366040 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-11aa8bb5-2cb9-4efb-986f-b30aadc22730 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:43.367262 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-11aa8bb5-2cb9-4efb-986f-b30aadc22730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:43.410965 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9f07a-624a-497c-a080-3a5d7ef64cbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:43.412780 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9f07a-624a-497c-a080-3a5d7ef64cbf service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:43.423338 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1046/2095] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:43 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:43.424878 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87549c-2d40-4897-84c1-40d75bf0bd06 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:43.425257 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87549c-2d40-4897-84c1-40d75bf0bd06 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:43.425588 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87549c-2d40-4897-84c1-40d75bf0bd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:43.443379 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1050/2096] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:43.445286 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-da87549c-2d40-4897-84c1-40d75bf0bd06 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:43.446692 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-da87549c-2d40-4897-84c1-40d75bf0bd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:43.455357 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa8bb5-2cb9-4efb-986f-b30aadc22730 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:43.456416 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1047/2097] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:43.457843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-11aa8bb5-2cb9-4efb-986f-b30aadc22730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:43.473883 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87549c-2d40-4897-84c1-40d75bf0bd06 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:43.475361 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-da87549c-2d40-4897-84c1-40d75bf0bd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:43.523063 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa8bb5-2cb9-4efb-986f-b30aadc22730 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:43.530211 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cce4ef-b25c-46e4-9494-1d7d9c0c0849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:43.531713 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cce4ef-b25c-46e4-9494-1d7d9c0c0849 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:43.534083 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cce4ef-b25c-46e4-9494-1d7d9c0c0849 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:43.535139 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cce4ef-b25c-46e4-9494-1d7d9c0c0849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:43.553245 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cce4ef-b25c-46e4-9494-1d7d9c0c0849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:43.555713 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cce4ef-b25c-46e4-9494-1d7d9c0c0849 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:43.558667 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87549c-2d40-4897-84c1-40d75bf0bd06 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:43.563307 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf1304-efe5-49f5-a7f0-967963e44afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:43.570160 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf1304-efe5-49f5-a7f0-967963e44afd service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:43.570160 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf1304-efe5-49f5-a7f0-967963e44afd service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:43.570160 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf1304-efe5-49f5-a7f0-967963e44afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:43.570636 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1051/2098] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:15:43.578704 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf1304-efe5-49f5-a7f0-967963e44afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:43.580405 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf1304-efe5-49f5-a7f0-967963e44afd service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:43.592974 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1048/2099] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:15:44.099044 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cce4ef-b25c-46e4-9494-1d7d9c0c0849 service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:44.100975 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-42cce4ef-b25c-46e4-9494-1d7d9c0c0849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:44.138009 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cce4ef-b25c-46e4-9494-1d7d9c0c0849 service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:44.142809 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3bed8-7164-41bd-bc0a-69dbc39645d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:44.143741 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3bed8-7164-41bd-bc0a-69dbc39645d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:44.144070 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3bed8-7164-41bd-bc0a-69dbc39645d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:44.144357 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3bed8-7164-41bd-bc0a-69dbc39645d5 admin admin] PATH_INFO: `/v3/projects/4b771c4205834d2b88274cac1653fdbb` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:44.145549 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3bed8-7164-41bd-bc0a-69dbc39645d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b771c4205834d2b88274cac1653fdbb)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:44.147821 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3bed8-7164-41bd-bc0a-69dbc39645d5 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:44.219049 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf1304-efe5-49f5-a7f0-967963e44afd service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:44.221397 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-ddbf1304-efe5-49f5-a7f0-967963e44afd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:44.239665 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf1304-efe5-49f5-a7f0-967963e44afd service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:44.244584 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83f514-0d22-4a63-8fde-05452df93d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:44.246190 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83f514-0d22-4a63-8fde-05452df93d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:44.246439 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83f514-0d22-4a63-8fde-05452df93d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:44.246715 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83f514-0d22-4a63-8fde-05452df93d82 admin admin] PATH_INFO: `/v3/projects/76641e6b40df406ab78ee47c674e3d5f` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:44.248189 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83f514-0d22-4a63-8fde-05452df93d82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76641e6b40df406ab78ee47c674e3d5f)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:44.250231 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83f514-0d22-4a63-8fde-05452df93d82 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:44.328534 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2dd3bed8-7164-41bd-bc0a-69dbc39645d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b771c4205834d2b88274cac1653fdbb', 'request_id': 'req-2dd3bed8-7164-41bd-bc0a-69dbc39645d5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:44.334866 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2dd3bed8-7164-41bd-bc0a-69dbc39645d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b771c4205834d2b88274cac1653fdbb', 'request_id': 'req-2dd3bed8-7164-41bd-bc0a-69dbc39645d5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:44.341302 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2dd3bed8-7164-41bd-bc0a-69dbc39645d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b771c4205834d2b88274cac1653fdbb', 'request_id': 'req-2dd3bed8-7164-41bd-bc0a-69dbc39645d5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:44.393812 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-eb83f514-0d22-4a63-8fde-05452df93d82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76641e6b40df406ab78ee47c674e3d5f', 'request_id': 'req-eb83f514-0d22-4a63-8fde-05452df93d82'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:44.399878 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-eb83f514-0d22-4a63-8fde-05452df93d82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76641e6b40df406ab78ee47c674e3d5f', 'request_id': 'req-eb83f514-0d22-4a63-8fde-05452df93d82'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:44.405745 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-eb83f514-0d22-4a63-8fde-05452df93d82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76641e6b40df406ab78ee47c674e3d5f', 'request_id': 'req-eb83f514-0d22-4a63-8fde-05452df93d82'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:44.465653 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2dd3bed8-7164-41bd-bc0a-69dbc39645d5 admin admin] The token cache is being invalidate because project 4b771c4205834d2b88274cac1653fdbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:44.465948 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2dd3bed8-7164-41bd-bc0a-69dbc39645d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:44.466674 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2dd3bed8-7164-41bd-bc0a-69dbc39645d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:44.468273 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1052/2100] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:44 2021] DELETE /identity/v3/projects/4b771c4205834d2b88274cac1653fdbb => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:44.472409 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3bed8-7164-41bd-bc0a-69dbc39645d5 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:44.473810 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-2dd3bed8-7164-41bd-bc0a-69dbc39645d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:44.542412 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3bed8-7164-41bd-bc0a-69dbc39645d5 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:44.597349 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0c869-11a1-4d8b-9dbf-a0092367eb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:44.598379 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0c869-11a1-4d8b-9dbf-a0092367eb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:44.598661 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0c869-11a1-4d8b-9dbf-a0092367eb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:44.598936 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0c869-11a1-4d8b-9dbf-a0092367eb77 admin admin] PATH_INFO: `/v3/users/392ac8c8ea634203ac304360b859045a` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:44.599082 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-eb83f514-0d22-4a63-8fde-05452df93d82 admin admin] The token cache is being invalidate because project 76641e6b40df406ab78ee47c674e3d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:44.599559 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-eb83f514-0d22-4a63-8fde-05452df93d82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:44.600046 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-eb83f514-0d22-4a63-8fde-05452df93d82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:44.600331 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0c869-11a1-4d8b-9dbf-a0092367eb77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=392ac8c8ea634203ac304360b859045a)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:44.601692 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1049/2101] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:44 2021] DELETE /identity/v3/projects/76641e6b40df406ab78ee47c674e3d5f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:15:44.602336 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0c869-11a1-4d8b-9dbf-a0092367eb77 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:44.607150 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83f514-0d22-4a63-8fde-05452df93d82 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:44.609176 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-eb83f514-0d22-4a63-8fde-05452df93d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:44.622531 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83f514-0d22-4a63-8fde-05452df93d82 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:44.628015 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb039d8-94ad-4c1f-bbeb-3d7461c4a9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:44.631094 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb039d8-94ad-4c1f-bbeb-3d7461c4a9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:44.631094 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb039d8-94ad-4c1f-bbeb-3d7461c4a9af admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:44.631094 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb039d8-94ad-4c1f-bbeb-3d7461c4a9af admin admin] PATH_INFO: `/v3/users/58b6355208614360a2c720e65f103c33` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:44.631094 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb039d8-94ad-4c1f-bbeb-3d7461c4a9af admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b6355208614360a2c720e65f103c33)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:44.632605 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb039d8-94ad-4c1f-bbeb-3d7461c4a9af admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:44.887512 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-fdd0c869-11a1-4d8b-9dbf-a0092367eb77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '392ac8c8ea634203ac304360b859045a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:44.902195 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-cbb039d8-94ad-4c1f-bbeb-3d7461c4a9af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b6355208614360a2c720e65f103c33'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:44.985513 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-fdd0c869-11a1-4d8b-9dbf-a0092367eb77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '392ac8c8ea634203ac304360b859045a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:44.993126 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-fdd0c869-11a1-4d8b-9dbf-a0092367eb77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '392ac8c8ea634203ac304360b859045a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:44.993781 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-fdd0c869-11a1-4d8b-9dbf-a0092367eb77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '392ac8c8ea634203ac304360b859045a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:45.006235 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-fdd0c869-11a1-4d8b-9dbf-a0092367eb77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '392ac8c8ea634203ac304360b859045a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:45.033794 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1053/2102] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:44 2021] DELETE /identity/v3/users/392ac8c8ea634203ac304360b859045a => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:15:45.037187 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0c869-11a1-4d8b-9dbf-a0092367eb77 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:45.038764 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-fdd0c869-11a1-4d8b-9dbf-a0092367eb77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:45.045625 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-cbb039d8-94ad-4c1f-bbeb-3d7461c4a9af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b6355208614360a2c720e65f103c33'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:45.064251 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-cbb039d8-94ad-4c1f-bbeb-3d7461c4a9af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b6355208614360a2c720e65f103c33'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:45.065814 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-cbb039d8-94ad-4c1f-bbeb-3d7461c4a9af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b6355208614360a2c720e65f103c33'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:45.083448 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-cbb039d8-94ad-4c1f-bbeb-3d7461c4a9af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b6355208614360a2c720e65f103c33'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:45.092728 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1050/2103] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:44 2021] DELETE /identity/v3/users/58b6355208614360a2c720e65f103c33 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:15:45.122711 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0c869-11a1-4d8b-9dbf-a0092367eb77 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:45.185754 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb6d72-41a3-4de3-9baf-17c79b728529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:45.186633 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb6d72-41a3-4de3-9baf-17c79b728529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:45.198822 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb6d72-41a3-4de3-9baf-17c79b728529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:45.198822 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb6d72-41a3-4de3-9baf-17c79b728529 admin admin] PATH_INFO: `/v3/users/f00b0784616945adbcc319f14c720a63` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:45.198822 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb6d72-41a3-4de3-9baf-17c79b728529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f00b0784616945adbcc319f14c720a63)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:45.198822 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb6d72-41a3-4de3-9baf-17c79b728529 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:45.436194 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-70bb6d72-41a3-4de3-9baf-17c79b728529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f00b0784616945adbcc319f14c720a63'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:45.585363 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-70bb6d72-41a3-4de3-9baf-17c79b728529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f00b0784616945adbcc319f14c720a63'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:45.594379 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-70bb6d72-41a3-4de3-9baf-17c79b728529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f00b0784616945adbcc319f14c720a63'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:45.595092 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-70bb6d72-41a3-4de3-9baf-17c79b728529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f00b0784616945adbcc319f14c720a63'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:45.607705 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-70bb6d72-41a3-4de3-9baf-17c79b728529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f00b0784616945adbcc319f14c720a63'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:45.613557 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1054/2104] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:45 2021] DELETE /identity/v3/users/f00b0784616945adbcc319f14c720a63 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:45.618173 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2a825-0c8d-4dd3-be6f-92d717c0c93e None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:45.618624 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2a825-0c8d-4dd3-be6f-92d717c0c93e None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:45.618740 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2a825-0c8d-4dd3-be6f-92d717c0c93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:45.637910 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-3bc2a825-0c8d-4dd3-be6f-92d717c0c93e None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:45.639101 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-3bc2a825-0c8d-4dd3-be6f-92d717c0c93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:45.707043 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1051/2105] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:15:45.718197 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb6d72-41a3-4de3-9baf-17c79b728529 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:45.721708 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-70bb6d72-41a3-4de3-9baf-17c79b728529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:45.723105 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2a825-0c8d-4dd3-be6f-92d717c0c93e None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:45.726297 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-3bc2a825-0c8d-4dd3-be6f-92d717c0c93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:45.738961 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2a825-0c8d-4dd3-be6f-92d717c0c93e None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:45.744468 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163a9d7-513f-4d0b-9af4-9b53d21d7cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:45.745318 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163a9d7-513f-4d0b-9af4-9b53d21d7cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:45.745672 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163a9d7-513f-4d0b-9af4-9b53d21d7cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:45.746080 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163a9d7-513f-4d0b-9af4-9b53d21d7cd3 admin admin] PATH_INFO: `/v3/projects/e4ddff26900b4765a22d478dedd50b54` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:45.747601 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163a9d7-513f-4d0b-9af4-9b53d21d7cd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4ddff26900b4765a22d478dedd50b54)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:45.749471 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163a9d7-513f-4d0b-9af4-9b53d21d7cd3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:45.796436 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb6d72-41a3-4de3-9baf-17c79b728529 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:45.800181 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db2214-221e-4fae-8bfb-26848d192e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:45.800813 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db2214-221e-4fae-8bfb-26848d192e36 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:45.801097 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db2214-221e-4fae-8bfb-26848d192e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:45.801369 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db2214-221e-4fae-8bfb-26848d192e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:45.810389 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db2214-221e-4fae-8bfb-26848d192e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:45.811906 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db2214-221e-4fae-8bfb-26848d192e36 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:45.821448 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1055/2106] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:15:45.822292 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db2214-221e-4fae-8bfb-26848d192e36 service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:45.824182 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-25db2214-221e-4fae-8bfb-26848d192e36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:45.837146 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db2214-221e-4fae-8bfb-26848d192e36 service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:45.842684 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199be0c9-4e8c-4e4a-95f5-7862928527ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:45.844252 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199be0c9-4e8c-4e4a-95f5-7862928527ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:45.844590 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199be0c9-4e8c-4e4a-95f5-7862928527ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:45.844876 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199be0c9-4e8c-4e4a-95f5-7862928527ef admin admin] PATH_INFO: `/v3/projects/24c4944a2bd740d7a70f88d42f4e9276` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:45.846105 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199be0c9-4e8c-4e4a-95f5-7862928527ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=24c4944a2bd740d7a70f88d42f4e9276)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:45.848057 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199be0c9-4e8c-4e4a-95f5-7862928527ef admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:45.902268 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2163a9d7-513f-4d0b-9af4-9b53d21d7cd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4ddff26900b4765a22d478dedd50b54', 'request_id': 'req-2163a9d7-513f-4d0b-9af4-9b53d21d7cd3'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:45.908219 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2163a9d7-513f-4d0b-9af4-9b53d21d7cd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4ddff26900b4765a22d478dedd50b54', 'request_id': 'req-2163a9d7-513f-4d0b-9af4-9b53d21d7cd3'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:45.915559 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2163a9d7-513f-4d0b-9af4-9b53d21d7cd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4ddff26900b4765a22d478dedd50b54', 'request_id': 'req-2163a9d7-513f-4d0b-9af4-9b53d21d7cd3'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:45.980993 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-199be0c9-4e8c-4e4a-95f5-7862928527ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24c4944a2bd740d7a70f88d42f4e9276', 'request_id': 'req-199be0c9-4e8c-4e4a-95f5-7862928527ef'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:45.987021 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-199be0c9-4e8c-4e4a-95f5-7862928527ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24c4944a2bd740d7a70f88d42f4e9276', 'request_id': 'req-199be0c9-4e8c-4e4a-95f5-7862928527ef'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:45.992588 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-199be0c9-4e8c-4e4a-95f5-7862928527ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24c4944a2bd740d7a70f88d42f4e9276', 'request_id': 'req-199be0c9-4e8c-4e4a-95f5-7862928527ef'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:46.001811 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2163a9d7-513f-4d0b-9af4-9b53d21d7cd3 admin admin] The token cache is being invalidate because project e4ddff26900b4765a22d478dedd50b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:46.002099 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2163a9d7-513f-4d0b-9af4-9b53d21d7cd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:46.002744 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2163a9d7-513f-4d0b-9af4-9b53d21d7cd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:46.004379 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1052/2107] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:45 2021] DELETE /identity/v3/projects/e4ddff26900b4765a22d478dedd50b54 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:46.009766 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a172f1-14c9-401a-8175-9570841ac1cc None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:46.010294 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a172f1-14c9-401a-8175-9570841ac1cc None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:46.010686 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a172f1-14c9-401a-8175-9570841ac1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:46.029699 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-c3a172f1-14c9-401a-8175-9570841ac1cc None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:46.031021 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-c3a172f1-14c9-401a-8175-9570841ac1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:46.064234 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-199be0c9-4e8c-4e4a-95f5-7862928527ef admin admin] The token cache is being invalidate because project 24c4944a2bd740d7a70f88d42f4e9276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:46.064871 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-199be0c9-4e8c-4e4a-95f5-7862928527ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:46.065548 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-199be0c9-4e8c-4e4a-95f5-7862928527ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:46.073437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1056/2108] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:45 2021] DELETE /identity/v3/projects/24c4944a2bd740d7a70f88d42f4e9276 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:46.075471 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b15f24-2ba7-4655-8eee-04505d4ccb36 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:46.075777 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b15f24-2ba7-4655-8eee-04505d4ccb36 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:46.076005 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b15f24-2ba7-4655-8eee-04505d4ccb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:46.104828 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-06b15f24-2ba7-4655-8eee-04505d4ccb36 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:46.104828 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-06b15f24-2ba7-4655-8eee-04505d4ccb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:46.119102 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1053/2109] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:15:46.127989 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3b70d-4cca-4e48-8cd4-a09e677c6b79 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:46.128535 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3b70d-4cca-4e48-8cd4-a09e677c6b79 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:46.129051 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3b70d-4cca-4e48-8cd4-a09e677c6b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:46.147971 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-91b3b70d-4cca-4e48-8cd4-a09e677c6b79 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:46.149189 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-91b3b70d-4cca-4e48-8cd4-a09e677c6b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:46.159268 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1054/2110] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:46.163068 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3b70d-4cca-4e48-8cd4-a09e677c6b79 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:46.174114 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3b70d-4cca-4e48-8cd4-a09e677c6b79 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:46.179880 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b2f3c-8525-461e-b1cc-1e115d6156aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:46.180587 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b2f3c-8525-461e-b1cc-1e115d6156aa admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:46.180868 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b2f3c-8525-461e-b1cc-1e115d6156aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:46.181135 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b2f3c-8525-461e-b1cc-1e115d6156aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:46.181886 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b2f3c-8525-461e-b1cc-1e115d6156aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:15:46.182221 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b2f3c-8525-461e-b1cc-1e115d6156aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:46.183878 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b2f3c-8525-461e-b1cc-1e115d6156aa admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:46.199290 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1055/2111] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:15:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:15:46.202019 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b2f3c-8525-461e-b1cc-1e115d6156aa admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:46.212618 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b2f3c-8525-461e-b1cc-1e115d6156aa admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:46.218866 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dadc0-31b3-498c-8f4b-222f634c4e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:46.219595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dadc0-31b3-498c-8f4b-222f634c4e61 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:46.219874 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dadc0-31b3-498c-8f4b-222f634c4e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:46.220473 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dadc0-31b3-498c-8f4b-222f634c4e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:46.221245 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3dadc0-31b3-498c-8f4b-222f634c4e61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:46.223133 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3dadc0-31b3-498c-8f4b-222f634c4e61 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:46.305350 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1057/2112] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:46.307135 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715ae81-a34c-4109-93de-bb078f7d5742 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:46.313001 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715ae81-a34c-4109-93de-bb078f7d5742 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:46.313001 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715ae81-a34c-4109-93de-bb078f7d5742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:46.329199 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-5715ae81-a34c-4109-93de-bb078f7d5742 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:46.330414 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-5715ae81-a34c-4109-93de-bb078f7d5742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:46.344603 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1056/2113] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:15:46 2021] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:15:46.345522 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dadc0-31b3-498c-8f4b-222f634c4e61 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:46.347165 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1058/2114] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:15:46.348608 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-df3dadc0-31b3-498c-8f4b-222f634c4e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:46.351999 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715ae81-a34c-4109-93de-bb078f7d5742 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:46.365125 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715ae81-a34c-4109-93de-bb078f7d5742 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:46.431623 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7cea1-d3f0-437a-a550-415aef2bc89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:46.432243 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7cea1-d3f0-437a-a550-415aef2bc89a admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:46.432523 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7cea1-d3f0-437a-a550-415aef2bc89a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:46.432799 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7cea1-d3f0-437a-a550-415aef2bc89a admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:46.433499 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7cea1-d3f0-437a-a550-415aef2bc89a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:46.435445 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7cea1-d3f0-437a-a550-415aef2bc89a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:46.435566 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dadc0-31b3-498c-8f4b-222f634c4e61 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:46.440395 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745fb0c-1779-4d6e-a0e5-e9e6f1990187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:46.441321 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745fb0c-1779-4d6e-a0e5-e9e6f1990187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:46.441679 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745fb0c-1779-4d6e-a0e5-e9e6f1990187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:46.442052 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745fb0c-1779-4d6e-a0e5-e9e6f1990187 admin admin] PATH_INFO: `/v3/projects/28f855b1c5bc4af599cabb30b768eb4e` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:46.443376 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745fb0c-1779-4d6e-a0e5-e9e6f1990187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28f855b1c5bc4af599cabb30b768eb4e)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:46.445313 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745fb0c-1779-4d6e-a0e5-e9e6f1990187 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:46.599572 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1059/2115] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:15:46 2021] POST /identity/v3/users => generated 292 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:46.600539 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7cea1-d3f0-437a-a550-415aef2bc89a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:46.609900 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7cea1-d3f0-437a-a550-415aef2bc89a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:46.614465 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c40d5-23b4-444e-b46c-d063b42b2158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:46.615087 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c40d5-23b4-444e-b46c-d063b42b2158 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:46.615405 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c40d5-23b4-444e-b46c-d063b42b2158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:46.615682 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c40d5-23b4-444e-b46c-d063b42b2158 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:46.616405 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c40d5-23b4-444e-b46c-d063b42b2158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:15:46.616709 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c40d5-23b4-444e-b46c-d063b42b2158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:46.618269 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c40d5-23b4-444e-b46c-d063b42b2158 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:46.630594 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1060/2116] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:15:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:15:46.631465 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c40d5-23b4-444e-b46c-d063b42b2158 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:46.642003 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c40d5-23b4-444e-b46c-d063b42b2158 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:46.649811 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-1745fb0c-1779-4d6e-a0e5-e9e6f1990187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28f855b1c5bc4af599cabb30b768eb4e', 'request_id': 'req-1745fb0c-1779-4d6e-a0e5-e9e6f1990187'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:46.657005 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-1745fb0c-1779-4d6e-a0e5-e9e6f1990187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28f855b1c5bc4af599cabb30b768eb4e', 'request_id': 'req-1745fb0c-1779-4d6e-a0e5-e9e6f1990187'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:46.670662 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-1745fb0c-1779-4d6e-a0e5-e9e6f1990187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28f855b1c5bc4af599cabb30b768eb4e', 'request_id': 'req-1745fb0c-1779-4d6e-a0e5-e9e6f1990187'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:46.699311 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4d1c0-b047-4cec-96a1-995b7435cd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:46.699976 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4d1c0-b047-4cec-96a1-995b7435cd52 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:46.700260 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4d1c0-b047-4cec-96a1-995b7435cd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:46.701229 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4d1c0-b047-4cec-96a1-995b7435cd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:46.701977 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4d1c0-b047-4cec-96a1-995b7435cd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:46.703588 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4d1c0-b047-4cec-96a1-995b7435cd52 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:46.713923 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1061/2117] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:46 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:46.714386 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4d1c0-b047-4cec-96a1-995b7435cd52 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:46.724182 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4d1c0-b047-4cec-96a1-995b7435cd52 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:46.728748 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f1342-356c-4a43-95e6-2f6d9ffd7505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:46.729413 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f1342-356c-4a43-95e6-2f6d9ffd7505 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:46.737109 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f1342-356c-4a43-95e6-2f6d9ffd7505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:46.737109 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f1342-356c-4a43-95e6-2f6d9ffd7505 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:46.737109 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f1342-356c-4a43-95e6-2f6d9ffd7505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:46.737109 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f1342-356c-4a43-95e6-2f6d9ffd7505 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:46.816317 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-1745fb0c-1779-4d6e-a0e5-e9e6f1990187 admin admin] The token cache is being invalidate because project 28f855b1c5bc4af599cabb30b768eb4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:46.816609 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-1745fb0c-1779-4d6e-a0e5-e9e6f1990187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:46.817245 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-1745fb0c-1779-4d6e-a0e5-e9e6f1990187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:46.818787 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1057/2118] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:46 2021] DELETE /identity/v3/projects/28f855b1c5bc4af599cabb30b768eb4e => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:46.819733 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745fb0c-1779-4d6e-a0e5-e9e6f1990187 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:46.820984 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-1745fb0c-1779-4d6e-a0e5-e9e6f1990187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:46.833417 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745fb0c-1779-4d6e-a0e5-e9e6f1990187 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:46.838025 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad75e05-cefb-45ba-baea-cc80697012aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:46.839548 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad75e05-cefb-45ba-baea-cc80697012aa admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:46.839837 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad75e05-cefb-45ba-baea-cc80697012aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:46.840116 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad75e05-cefb-45ba-baea-cc80697012aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:46.840892 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad75e05-cefb-45ba-baea-cc80697012aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:46.842413 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad75e05-cefb-45ba-baea-cc80697012aa admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:46.852403 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1058/2119] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:46 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:46.853737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b208489-ff04-49b2-b6ef-6a9d02d93049 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:46.854942 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b208489-ff04-49b2-b6ef-6a9d02d93049 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:46.855247 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b208489-ff04-49b2-b6ef-6a9d02d93049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:46.872940 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-4b208489-ff04-49b2-b6ef-6a9d02d93049 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:46.874124 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-4b208489-ff04-49b2-b6ef-6a9d02d93049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:46.882152 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1059/2120] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:46.882947 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b208489-ff04-49b2-b6ef-6a9d02d93049 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:46.895881 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b208489-ff04-49b2-b6ef-6a9d02d93049 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:46.901303 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdee69f-f186-4ae4-acf1-ceac11898549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:46.902344 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdee69f-f186-4ae4-acf1-ceac11898549 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:46.902867 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdee69f-f186-4ae4-acf1-ceac11898549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:46.903099 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdee69f-f186-4ae4-acf1-ceac11898549 admin admin] PATH_INFO: `/v3/projects/feb880e4bb504caba2fd40061e8ea63e/users/1a15a0ee0d0c4dcbb7888ca913df0f6b/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:46.918227 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1062/2121] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:15:46 2021] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:46.918227 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39056da5-8011-4822-bdcb-3020a1e4dd9d None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:46.918227 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39056da5-8011-4822-bdcb-3020a1e4dd9d None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:46.918227 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39056da5-8011-4822-bdcb-3020a1e4dd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:46.922205 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdee69f-f186-4ae4-acf1-ceac11898549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb880e4bb504caba2fd40061e8ea63e, user_id=1a15a0ee0d0c4dcbb7888ca913df0f6b, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:46.925015 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdee69f-f186-4ae4-acf1-ceac11898549 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:46.931386 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-39056da5-8011-4822-bdcb-3020a1e4dd9d None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:46.932668 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-39056da5-8011-4822-bdcb-3020a1e4dd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:46.991648 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1063/2122] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:46.991648 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39056da5-8011-4822-bdcb-3020a1e4dd9d None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:46.991648 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-39056da5-8011-4822-bdcb-3020a1e4dd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:47.006340 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39056da5-8011-4822-bdcb-3020a1e4dd9d None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:47.011734 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba831a0f-5e6f-466e-ae5f-94e34086b50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:47.012393 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba831a0f-5e6f-466e-ae5f-94e34086b50d admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:47.012672 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba831a0f-5e6f-466e-ae5f-94e34086b50d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:47.012954 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba831a0f-5e6f-466e-ae5f-94e34086b50d admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:47.013682 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba831a0f-5e6f-466e-ae5f-94e34086b50d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:47.015580 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba831a0f-5e6f-466e-ae5f-94e34086b50d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:47.034722 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1060/2123] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:46 2021] PUT /identity/v3/projects/feb880e4bb504caba2fd40061e8ea63e/users/1a15a0ee0d0c4dcbb7888ca913df0f6b/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:47.035844 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdee69f-f186-4ae4-acf1-ceac11898549 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:47.103118 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdee69f-f186-4ae4-acf1-ceac11898549 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:47.108024 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe541b74-242d-44fe-bbb8-3acb4a22b9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:47.108671 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe541b74-242d-44fe-bbb8-3acb4a22b9dd admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:47.108950 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe541b74-242d-44fe-bbb8-3acb4a22b9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:47.112548 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe541b74-242d-44fe-bbb8-3acb4a22b9dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:47.112548 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe541b74-242d-44fe-bbb8-3acb4a22b9dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:15:47.112548 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe541b74-242d-44fe-bbb8-3acb4a22b9dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:47.112548 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe541b74-242d-44fe-bbb8-3acb4a22b9dd admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:47.123354 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1061/2124] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:15:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:15:47.127489 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9a050-3e1f-4937-b95f-162acf097556 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:47.127775 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9a050-3e1f-4937-b95f-162acf097556 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:47.128077 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9a050-3e1f-4937-b95f-162acf097556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:47.138253 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1064/2125] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:15:46 2021] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:47.138885 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba831a0f-5e6f-466e-ae5f-94e34086b50d admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:47.149102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba831a0f-5e6f-466e-ae5f-94e34086b50d admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:47.154827 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17486a-8962-4474-9e18-3ea7f17bacef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:47.155587 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17486a-8962-4474-9e18-3ea7f17bacef admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:47.155705 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-abe9a050-3e1f-4937-b95f-162acf097556 None None] MFA Rules not processed for user `1a15a0ee0d0c4dcbb7888ca913df0f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:47.155812 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17486a-8962-4474-9e18-3ea7f17bacef admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:47.156088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17486a-8962-4474-9e18-3ea7f17bacef admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:47.156749 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-abe9a050-3e1f-4937-b95f-162acf097556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:47.156855 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17486a-8962-4474-9e18-3ea7f17bacef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:47.158679 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17486a-8962-4474-9e18-3ea7f17bacef admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:47.222245 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1062/2126] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:47 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:47.223117 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9a050-3e1f-4937-b95f-162acf097556 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:47.232846 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9a050-3e1f-4937-b95f-162acf097556 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:47.237846 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bf818-8598-4d0c-855f-50c1de2f381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:47.238436 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bf818-8598-4d0c-855f-50c1de2f381b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:47.238747 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bf818-8598-4d0c-855f-50c1de2f381b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:47.239022 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bf818-8598-4d0c-855f-50c1de2f381b admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:47.239782 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bf818-8598-4d0c-855f-50c1de2f381b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:47.241444 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bf818-8598-4d0c-855f-50c1de2f381b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:47.253907 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1065/2127] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:15:47 2021] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:47.253907 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17486a-8962-4474-9e18-3ea7f17bacef admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:47.254236 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1063/2128] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:47 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:47.254848 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bf818-8598-4d0c-855f-50c1de2f381b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:47.255961 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-7c17486a-8962-4474-9e18-3ea7f17bacef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:47.265736 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bf818-8598-4d0c-855f-50c1de2f381b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:47.328269 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17486a-8962-4474-9e18-3ea7f17bacef admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:47.342187 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565a0e1-c411-4e26-8694-d7ce0fcbf644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:47.342989 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565a0e1-c411-4e26-8694-d7ce0fcbf644 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:47.343152 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565a0e1-c411-4e26-8694-d7ce0fcbf644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:47.343850 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565a0e1-c411-4e26-8694-d7ce0fcbf644 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:47.344727 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565a0e1-c411-4e26-8694-d7ce0fcbf644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:47.346620 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565a0e1-c411-4e26-8694-d7ce0fcbf644 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:47.348901 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68b0e5-945a-49eb-9afc-c7cb9309785d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:47.349639 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68b0e5-945a-49eb-9afc-c7cb9309785d service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:47.349998 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68b0e5-945a-49eb-9afc-c7cb9309785d service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:47.350314 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68b0e5-945a-49eb-9afc-c7cb9309785d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:47.413263 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68b0e5-945a-49eb-9afc-c7cb9309785d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:47.415033 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68b0e5-945a-49eb-9afc-c7cb9309785d service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:47.424827 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1066/2129] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:47 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:47.425482 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68b0e5-945a-49eb-9afc-c7cb9309785d service cinder] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:47.445490 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1064/2130] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:15:47 2021] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:15:47.447472 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68b0e5-945a-49eb-9afc-c7cb9309785d service cinder] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:47.449614 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565a0e1-c411-4e26-8694-d7ce0fcbf644 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:47.455109 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f6aa5-d4fa-435a-9df6-d183fdb36575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:47.455918 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f6aa5-d4fa-435a-9df6-d183fdb36575 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:47.456317 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f6aa5-d4fa-435a-9df6-d183fdb36575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:47.457280 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f6aa5-d4fa-435a-9df6-d183fdb36575 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:47.457925 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f6aa5-d4fa-435a-9df6-d183fdb36575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:47.460548 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f6aa5-d4fa-435a-9df6-d183fdb36575 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:47.461817 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565a0e1-c411-4e26-8694-d7ce0fcbf644 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:47.469655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f0c6d-bbe7-4b3f-8023-7d9267b33113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:47.470759 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f0c6d-bbe7-4b3f-8023-7d9267b33113 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:47.471117 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f0c6d-bbe7-4b3f-8023-7d9267b33113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:47.471507 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f0c6d-bbe7-4b3f-8023-7d9267b33113 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:47.472526 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f0c6d-bbe7-4b3f-8023-7d9267b33113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:47.473609 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1067/2131] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:47 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:47.477014 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f0c6d-bbe7-4b3f-8023-7d9267b33113 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:47.479575 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f6aa5-d4fa-435a-9df6-d183fdb36575 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:47.492392 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1065/2132] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:47 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:15:47.497140 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f0c6d-bbe7-4b3f-8023-7d9267b33113 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:47.498334 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f6aa5-d4fa-435a-9df6-d183fdb36575 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:47.503088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902079f-702f-4a82-9089-5146deff83a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:47.504062 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902079f-702f-4a82-9089-5146deff83a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:47.507158 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902079f-702f-4a82-9089-5146deff83a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:47.507158 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902079f-702f-4a82-9089-5146deff83a9 admin admin] PATH_INFO: `/v3/projects/23ddc3ae6cf440ba935aafad0b919b39/users/a83bd9ea295748269984f94a40d2e6a5/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:47.509338 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f0c6d-bbe7-4b3f-8023-7d9267b33113 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:47.514623 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a631155-101a-447a-a71b-c2578942992e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:47.515434 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a631155-101a-447a-a71b-c2578942992e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:47.515739 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a631155-101a-447a-a71b-c2578942992e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:47.515988 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a631155-101a-447a-a71b-c2578942992e admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:47.516719 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a631155-101a-447a-a71b-c2578942992e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:47.518314 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a631155-101a-447a-a71b-c2578942992e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:47.532838 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1066/2133] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:47 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:15:47.533660 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902079f-702f-4a82-9089-5146deff83a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ddc3ae6cf440ba935aafad0b919b39, user_id=a83bd9ea295748269984f94a40d2e6a5, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:47.534027 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a631155-101a-447a-a71b-c2578942992e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:47.538080 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902079f-702f-4a82-9089-5146deff83a9 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:47.546358 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a631155-101a-447a-a71b-c2578942992e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:47.551997 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1bd29-436c-420c-b7b3-25eb01b1b408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:47.554449 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1bd29-436c-420c-b7b3-25eb01b1b408 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:47.554798 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1bd29-436c-420c-b7b3-25eb01b1b408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:47.555655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1bd29-436c-420c-b7b3-25eb01b1b408 admin admin] PATH_INFO: `/v3/projects/d5ed34581a5e4a4b8f22a96ca010c337/users/b9afaf378d784aaa90752b936005a687/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:47.577875 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1bd29-436c-420c-b7b3-25eb01b1b408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ed34581a5e4a4b8f22a96ca010c337, user_id=b9afaf378d784aaa90752b936005a687, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:47.580399 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1bd29-436c-420c-b7b3-25eb01b1b408 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:47.643576 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1068/2134] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:47 2021] PUT /identity/v3/projects/23ddc3ae6cf440ba935aafad0b919b39/users/a83bd9ea295748269984f94a40d2e6a5/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:15:47.656855 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c192c88-056d-45ab-b245-8ef525fb6352 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:47.657078 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c192c88-056d-45ab-b245-8ef525fb6352 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:47.657373 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c192c88-056d-45ab-b245-8ef525fb6352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:47.691766 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-6c192c88-056d-45ab-b245-8ef525fb6352 None None] MFA Rules not processed for user `a83bd9ea295748269984f94a40d2e6a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:47.693139 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-6c192c88-056d-45ab-b245-8ef525fb6352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:47.740965 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1067/2135] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:47 2021] PUT /identity/v3/projects/d5ed34581a5e4a4b8f22a96ca010c337/users/b9afaf378d784aaa90752b936005a687/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:15:47.752844 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9053f11-a5fc-450d-9ee5-413584d6959e None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:47.753138 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9053f11-a5fc-450d-9ee5-413584d6959e None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:47.753447 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9053f11-a5fc-450d-9ee5-413584d6959e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:47.779909 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1069/2136] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:47 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:15:47.780990 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c192c88-056d-45ab-b245-8ef525fb6352 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:47.787636 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-f9053f11-a5fc-450d-9ee5-413584d6959e None None] MFA Rules not processed for user `b9afaf378d784aaa90752b936005a687`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:47.789349 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-f9053f11-a5fc-450d-9ee5-413584d6959e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:47.851227 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c192c88-056d-45ab-b245-8ef525fb6352 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:47.869202 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1068/2137] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:47 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:15:47.875880 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9053f11-a5fc-450d-9ee5-413584d6959e None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:47.877372 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-f9053f11-a5fc-450d-9ee5-413584d6959e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:47.912496 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0c2ef-d834-447f-8903-86a7f6a6ae14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:47.913055 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0c2ef-d834-447f-8903-86a7f6a6ae14 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:47.913367 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0c2ef-d834-447f-8903-86a7f6a6ae14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:47.913646 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0c2ef-d834-447f-8903-86a7f6a6ae14 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:47.914382 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0c2ef-d834-447f-8903-86a7f6a6ae14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:47.916764 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0c2ef-d834-447f-8903-86a7f6a6ae14 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:47.933245 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9053f11-a5fc-450d-9ee5-413584d6959e None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:47.936966 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d24c1-88a4-4cac-91e9-15a4c599ddc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:47.937590 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d24c1-88a4-4cac-91e9-15a4c599ddc5 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:47.937864 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d24c1-88a4-4cac-91e9-15a4c599ddc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:47.938196 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d24c1-88a4-4cac-91e9-15a4c599ddc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:47.947057 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d24c1-88a4-4cac-91e9-15a4c599ddc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:47.949111 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d24c1-88a4-4cac-91e9-15a4c599ddc5 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:47.958033 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1069/2138] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:47 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:15:48.055817 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1070/2139] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:15:47 2021] POST /identity/v3/projects => generated 377 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:48.060395 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d24c1-88a4-4cac-91e9-15a4c599ddc5 service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:48.071058 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d24c1-88a4-4cac-91e9-15a4c599ddc5 service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:48.126920 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d9560-45d8-48d6-9ee3-0f4d2ba73e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:48.127611 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d9560-45d8-48d6-9ee3-0f4d2ba73e9d admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:48.127896 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d9560-45d8-48d6-9ee3-0f4d2ba73e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:48.128172 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d9560-45d8-48d6-9ee3-0f4d2ba73e9d admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:48.128866 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d9560-45d8-48d6-9ee3-0f4d2ba73e9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:48.130735 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d9560-45d8-48d6-9ee3-0f4d2ba73e9d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:48.239053 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1070/2140] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:15:48 2021] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:15:48.243121 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0c2ef-d834-447f-8903-86a7f6a6ae14 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:48.254620 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0c2ef-d834-447f-8903-86a7f6a6ae14 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:48.269355 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff09f3a-3ea9-486a-b3f4-c9149cd52427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:48.270018 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff09f3a-3ea9-486a-b3f4-c9149cd52427 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:48.270301 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff09f3a-3ea9-486a-b3f4-c9149cd52427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:48.270629 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff09f3a-3ea9-486a-b3f4-c9149cd52427 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:48.271392 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff09f3a-3ea9-486a-b3f4-c9149cd52427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:48.272930 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff09f3a-3ea9-486a-b3f4-c9149cd52427 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:48.286533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1071/2141] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:48 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:15:48.290655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d9560-45d8-48d6-9ee3-0f4d2ba73e9d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:48.302253 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d9560-45d8-48d6-9ee3-0f4d2ba73e9d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:48.308397 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6ff61-80f3-4a2d-a3e4-154e605142df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:48.309350 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6ff61-80f3-4a2d-a3e4-154e605142df admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:48.309699 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6ff61-80f3-4a2d-a3e4-154e605142df admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:48.310023 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6ff61-80f3-4a2d-a3e4-154e605142df admin admin] PATH_INFO: `/v3/projects/9a3f1b64d01744a3be60b5dc489b5137/users/1cd582c99aa540658661e724c70469e6/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:48.330257 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6ff61-80f3-4a2d-a3e4-154e605142df admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a3f1b64d01744a3be60b5dc489b5137, user_id=1cd582c99aa540658661e724c70469e6, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:48.333016 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6ff61-80f3-4a2d-a3e4-154e605142df admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:48.409378 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1071/2142] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:48 2021] PUT /identity/v3/projects/9a3f1b64d01744a3be60b5dc489b5137/users/1cd582c99aa540658661e724c70469e6/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:48.413446 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff09f3a-3ea9-486a-b3f4-c9149cd52427 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:48.423888 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff09f3a-3ea9-486a-b3f4-c9149cd52427 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:48.481147 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591cdc0-4aa7-46c8-9444-b66a23471195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:48.481802 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591cdc0-4aa7-46c8-9444-b66a23471195 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:48.482083 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591cdc0-4aa7-46c8-9444-b66a23471195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:48.482354 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591cdc0-4aa7-46c8-9444-b66a23471195 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:48.483085 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591cdc0-4aa7-46c8-9444-b66a23471195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:48.484669 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591cdc0-4aa7-46c8-9444-b66a23471195 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:48.498694 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1072/2143] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:48 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:15:48.499940 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6ff61-80f3-4a2d-a3e4-154e605142df admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:48.510465 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6ff61-80f3-4a2d-a3e4-154e605142df admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:48.515323 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96811d-adc7-4ea0-9881-9eaa4a5b4929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:48.519986 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96811d-adc7-4ea0-9881-9eaa4a5b4929 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:48.519986 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96811d-adc7-4ea0-9881-9eaa4a5b4929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:48.519986 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96811d-adc7-4ea0-9881-9eaa4a5b4929 admin admin] PATH_INFO: `/v3/projects/9a3f1b64d01744a3be60b5dc489b5137/users/1cd582c99aa540658661e724c70469e6/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:48.519986 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96811d-adc7-4ea0-9881-9eaa4a5b4929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a3f1b64d01744a3be60b5dc489b5137, user_id=1cd582c99aa540658661e724c70469e6, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:48.521327 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96811d-adc7-4ea0-9881-9eaa4a5b4929 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:48.533017 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1072/2144] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:48 2021] PUT /identity/v3/projects/9a3f1b64d01744a3be60b5dc489b5137/users/1cd582c99aa540658661e724c70469e6/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:48.544525 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5162fe-413d-4ac7-8a85-5d3383dc24c8 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:48.544812 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5162fe-413d-4ac7-8a85-5d3383dc24c8 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:48.545091 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5162fe-413d-4ac7-8a85-5d3383dc24c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:48.574971 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-2c5162fe-413d-4ac7-8a85-5d3383dc24c8 None None] MFA Rules not processed for user `1cd582c99aa540658661e724c70469e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:48.576273 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-2c5162fe-413d-4ac7-8a85-5d3383dc24c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:48.654293 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1073/2145] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:48 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:15:48.675134 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96811d-adc7-4ea0-9881-9eaa4a5b4929 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:48.733800 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96811d-adc7-4ea0-9881-9eaa4a5b4929 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:48.737514 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739bdc1-e76c-4828-a23b-ec8578d427e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:48.738137 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739bdc1-e76c-4828-a23b-ec8578d427e7 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:48.738468 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739bdc1-e76c-4828-a23b-ec8578d427e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:48.738744 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739bdc1-e76c-4828-a23b-ec8578d427e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:48.794565 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739bdc1-e76c-4828-a23b-ec8578d427e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:48.795950 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739bdc1-e76c-4828-a23b-ec8578d427e7 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:48.807261 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1073/2146] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:48 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:48.966281 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5162fe-413d-4ac7-8a85-5d3383dc24c8 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:48.967734 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-2c5162fe-413d-4ac7-8a85-5d3383dc24c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:49.035469 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5162fe-413d-4ac7-8a85-5d3383dc24c8 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:49.040328 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703e7fe-2e3a-42e9-a75b-253b4afb5461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:49.041199 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703e7fe-2e3a-42e9-a75b-253b4afb5461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:49.042713 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703e7fe-2e3a-42e9-a75b-253b4afb5461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:49.043020 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703e7fe-2e3a-42e9-a75b-253b4afb5461 admin admin] PATH_INFO: `/v3/users/8f6c2ad8844e4db98a741ecc694ba934` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:49.044290 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703e7fe-2e3a-42e9-a75b-253b4afb5461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f6c2ad8844e4db98a741ecc694ba934)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:49.048561 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703e7fe-2e3a-42e9-a75b-253b4afb5461 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:49.330257 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-a703e7fe-2e3a-42e9-a75b-253b4afb5461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f6c2ad8844e4db98a741ecc694ba934'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:49.410425 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-a703e7fe-2e3a-42e9-a75b-253b4afb5461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f6c2ad8844e4db98a741ecc694ba934'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:49.418097 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-a703e7fe-2e3a-42e9-a75b-253b4afb5461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f6c2ad8844e4db98a741ecc694ba934'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:49.418756 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-a703e7fe-2e3a-42e9-a75b-253b4afb5461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f6c2ad8844e4db98a741ecc694ba934'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:49.430111 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-a703e7fe-2e3a-42e9-a75b-253b4afb5461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f6c2ad8844e4db98a741ecc694ba934'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:49.435903 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1074/2147] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:48 2021] DELETE /identity/v3/users/8f6c2ad8844e4db98a741ecc694ba934 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:49.440570 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04724da-8db8-47ef-8892-0362a2b871b0 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:49.441374 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04724da-8db8-47ef-8892-0362a2b871b0 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:49.441374 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04724da-8db8-47ef-8892-0362a2b871b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:49.458640 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-f04724da-8db8-47ef-8892-0362a2b871b0 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:49.459860 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-f04724da-8db8-47ef-8892-0362a2b871b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:49.518132 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1074/2148] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:15:49.529654 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703e7fe-2e3a-42e9-a75b-253b4afb5461 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:49.531187 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-a703e7fe-2e3a-42e9-a75b-253b4afb5461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:49.599346 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703e7fe-2e3a-42e9-a75b-253b4afb5461 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:49.603551 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624c210-53dc-48f4-aa03-55c165587ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:49.604191 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624c210-53dc-48f4-aa03-55c165587ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:49.604514 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624c210-53dc-48f4-aa03-55c165587ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:49.604838 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624c210-53dc-48f4-aa03-55c165587ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:49.613997 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624c210-53dc-48f4-aa03-55c165587ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:49.615425 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624c210-53dc-48f4-aa03-55c165587ed6 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:49.625689 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1075/2149] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:50.129617 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04724da-8db8-47ef-8892-0362a2b871b0 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:50.131485 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-f04724da-8db8-47ef-8892-0362a2b871b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:50.143756 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04724da-8db8-47ef-8892-0362a2b871b0 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:50.148715 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5a962-4545-47c5-96bb-ca287ec1eb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:50.149582 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5a962-4545-47c5-96bb-ca287ec1eb21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:50.149869 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5a962-4545-47c5-96bb-ca287ec1eb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:50.150149 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5a962-4545-47c5-96bb-ca287ec1eb21 admin admin] PATH_INFO: `/v3/projects/3013e5c1cded4f4abe40529634315ed6` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:50.151444 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5a962-4545-47c5-96bb-ca287ec1eb21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3013e5c1cded4f4abe40529634315ed6)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:50.153355 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5a962-4545-47c5-96bb-ca287ec1eb21 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:50.302331 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-dbf5a962-4545-47c5-96bb-ca287ec1eb21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3013e5c1cded4f4abe40529634315ed6', 'request_id': 'req-dbf5a962-4545-47c5-96bb-ca287ec1eb21'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:50.308913 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-dbf5a962-4545-47c5-96bb-ca287ec1eb21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3013e5c1cded4f4abe40529634315ed6', 'request_id': 'req-dbf5a962-4545-47c5-96bb-ca287ec1eb21'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:50.314140 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-dbf5a962-4545-47c5-96bb-ca287ec1eb21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3013e5c1cded4f4abe40529634315ed6', 'request_id': 'req-dbf5a962-4545-47c5-96bb-ca287ec1eb21'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:50.408261 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-dbf5a962-4545-47c5-96bb-ca287ec1eb21 admin admin] The token cache is being invalidate because project 3013e5c1cded4f4abe40529634315ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:50.408447 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-dbf5a962-4545-47c5-96bb-ca287ec1eb21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:50.409081 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-dbf5a962-4545-47c5-96bb-ca287ec1eb21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:50.410616 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1075/2150] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:50 2021] DELETE /identity/v3/projects/3013e5c1cded4f4abe40529634315ed6 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:50.414663 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624c210-53dc-48f4-aa03-55c165587ed6 service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:50.425101 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624c210-53dc-48f4-aa03-55c165587ed6 service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:50.478730 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aff425-a26a-4645-8d19-f1acadb5fa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:50.480367 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aff425-a26a-4645-8d19-f1acadb5fa37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:50.480647 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aff425-a26a-4645-8d19-f1acadb5fa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:50.480944 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aff425-a26a-4645-8d19-f1acadb5fa37 admin admin] PATH_INFO: `/v3/users/b72c728a64564c368b99743a74fa69fa` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:50.482131 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aff425-a26a-4645-8d19-f1acadb5fa37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b72c728a64564c368b99743a74fa69fa)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:50.484039 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aff425-a26a-4645-8d19-f1acadb5fa37 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:50.722009 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-53aff425-a26a-4645-8d19-f1acadb5fa37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b72c728a64564c368b99743a74fa69fa'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:50.796415 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-53aff425-a26a-4645-8d19-f1acadb5fa37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b72c728a64564c368b99743a74fa69fa'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:50.803494 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-53aff425-a26a-4645-8d19-f1acadb5fa37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b72c728a64564c368b99743a74fa69fa'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:50.804112 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-53aff425-a26a-4645-8d19-f1acadb5fa37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b72c728a64564c368b99743a74fa69fa'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:50.815663 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-53aff425-a26a-4645-8d19-f1acadb5fa37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b72c728a64564c368b99743a74fa69fa'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:50.823176 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1076/2151] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:50 2021] DELETE /identity/v3/users/b72c728a64564c368b99743a74fa69fa => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:51.058239 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc14ad5-239a-46e6-9222-f73593b13994 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:51.058529 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc14ad5-239a-46e6-9222-f73593b13994 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:51.058805 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc14ad5-239a-46e6-9222-f73593b13994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:51.077174 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156ccc7-46fb-4216-84c2-f2c63245614b None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:51.077701 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156ccc7-46fb-4216-84c2-f2c63245614b None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:51.078133 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156ccc7-46fb-4216-84c2-f2c63245614b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:51.090030 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-1cc14ad5-239a-46e6-9222-f73593b13994 None None] MFA Rules not processed for user `b9afaf378d784aaa90752b936005a687`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:51.091508 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-1cc14ad5-239a-46e6-9222-f73593b13994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:51.100508 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-7156ccc7-46fb-4216-84c2-f2c63245614b None None] MFA Rules not processed for user `882a63823deb40dcb93ddc76f81ab9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:51.100508 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-7156ccc7-46fb-4216-84c2-f2c63245614b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:51.166035 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1076/2152] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:51 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:51.173281 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1077/2153] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:51 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:15:51.351364 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc14ad5-239a-46e6-9222-f73593b13994 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:51.351364 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-1cc14ad5-239a-46e6-9222-f73593b13994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:51.418385 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc14ad5-239a-46e6-9222-f73593b13994 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:51.423370 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53a4fd-96a0-4d91-88e6-98ed80902601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:51.424232 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53a4fd-96a0-4d91-88e6-98ed80902601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:51.424712 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53a4fd-96a0-4d91-88e6-98ed80902601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:51.424992 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53a4fd-96a0-4d91-88e6-98ed80902601 admin admin] PATH_INFO: `/v3/projects/525ea43fe1f74636a2d4637ab6bef409` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:51.426200 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53a4fd-96a0-4d91-88e6-98ed80902601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=525ea43fe1f74636a2d4637ab6bef409)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:51.428183 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53a4fd-96a0-4d91-88e6-98ed80902601 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:51.616507 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-6e53a4fd-96a0-4d91-88e6-98ed80902601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '525ea43fe1f74636a2d4637ab6bef409', 'request_id': 'req-6e53a4fd-96a0-4d91-88e6-98ed80902601'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:51.623531 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-6e53a4fd-96a0-4d91-88e6-98ed80902601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '525ea43fe1f74636a2d4637ab6bef409', 'request_id': 'req-6e53a4fd-96a0-4d91-88e6-98ed80902601'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:51.628764 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-6e53a4fd-96a0-4d91-88e6-98ed80902601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '525ea43fe1f74636a2d4637ab6bef409', 'request_id': 'req-6e53a4fd-96a0-4d91-88e6-98ed80902601'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:51.736161 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-6e53a4fd-96a0-4d91-88e6-98ed80902601 admin admin] The token cache is being invalidate because project 525ea43fe1f74636a2d4637ab6bef409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:51.736542 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-6e53a4fd-96a0-4d91-88e6-98ed80902601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:51.737463 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-6e53a4fd-96a0-4d91-88e6-98ed80902601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:51.738856 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1077/2154] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:51 2021] DELETE /identity/v3/projects/525ea43fe1f74636a2d4637ab6bef409 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:51.742837 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156ccc7-46fb-4216-84c2-f2c63245614b None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:51.753285 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156ccc7-46fb-4216-84c2-f2c63245614b None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:51.814144 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5e271-9d5b-412c-901d-8f0b6624622c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:51.815043 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5e271-9d5b-412c-901d-8f0b6624622c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:51.815361 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5e271-9d5b-412c-901d-8f0b6624622c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:51.815661 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5e271-9d5b-412c-901d-8f0b6624622c admin admin] PATH_INFO: `/v3/users/e57c18ce3a9c4eb9ac004aa8d50ea791` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:51.816876 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5e271-9d5b-412c-901d-8f0b6624622c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e57c18ce3a9c4eb9ac004aa8d50ea791)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:51.818935 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5e271-9d5b-412c-901d-8f0b6624622c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:52.075568 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-eab5e271-9d5b-412c-901d-8f0b6624622c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e57c18ce3a9c4eb9ac004aa8d50ea791'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:52.165230 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-eab5e271-9d5b-412c-901d-8f0b6624622c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e57c18ce3a9c4eb9ac004aa8d50ea791'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:52.173352 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-eab5e271-9d5b-412c-901d-8f0b6624622c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e57c18ce3a9c4eb9ac004aa8d50ea791'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:52.174024 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-eab5e271-9d5b-412c-901d-8f0b6624622c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e57c18ce3a9c4eb9ac004aa8d50ea791'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:52.185631 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-eab5e271-9d5b-412c-901d-8f0b6624622c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e57c18ce3a9c4eb9ac004aa8d50ea791'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:52.191782 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1078/2155] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:15:51 2021] DELETE /identity/v3/users/e57c18ce3a9c4eb9ac004aa8d50ea791 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:52.642886 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53a4fd-96a0-4d91-88e6-98ed80902601 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:52.644460 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-6e53a4fd-96a0-4d91-88e6-98ed80902601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:52.657712 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53a4fd-96a0-4d91-88e6-98ed80902601 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:52.735483 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0832a-9b5d-4842-9b89-fad78fa4194d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:52.735483 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0832a-9b5d-4842-9b89-fad78fa4194d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:52.735483 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0832a-9b5d-4842-9b89-fad78fa4194d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:52.735483 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0832a-9b5d-4842-9b89-fad78fa4194d admin admin] PATH_INFO: `/v3/projects/b470e86383554e74a093944c32239b2a` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:52.736809 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0832a-9b5d-4842-9b89-fad78fa4194d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b470e86383554e74a093944c32239b2a)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:52.739359 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0832a-9b5d-4842-9b89-fad78fa4194d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:52.893077 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-dbe0832a-9b5d-4842-9b89-fad78fa4194d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b470e86383554e74a093944c32239b2a', 'request_id': 'req-dbe0832a-9b5d-4842-9b89-fad78fa4194d'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:52.899224 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-dbe0832a-9b5d-4842-9b89-fad78fa4194d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b470e86383554e74a093944c32239b2a', 'request_id': 'req-dbe0832a-9b5d-4842-9b89-fad78fa4194d'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:52.904738 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-dbe0832a-9b5d-4842-9b89-fad78fa4194d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b470e86383554e74a093944c32239b2a', 'request_id': 'req-dbe0832a-9b5d-4842-9b89-fad78fa4194d'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:53.038808 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-dbe0832a-9b5d-4842-9b89-fad78fa4194d admin admin] The token cache is being invalidate because project b470e86383554e74a093944c32239b2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:15:53.039024 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-dbe0832a-9b5d-4842-9b89-fad78fa4194d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:53.039929 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-dbe0832a-9b5d-4842-9b89-fad78fa4194d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:15:53.042030 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1078/2156] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:15:52 2021] DELETE /identity/v3/projects/b470e86383554e74a093944c32239b2a => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:15:53.052051 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0367cc6-6aab-40bf-9042-821d878df403 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:53.052490 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0367cc6-6aab-40bf-9042-821d878df403 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:53.052754 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0367cc6-6aab-40bf-9042-821d878df403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:53.070717 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-e0367cc6-6aab-40bf-9042-821d878df403 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:53.071952 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-e0367cc6-6aab-40bf-9042-821d878df403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:53.129928 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1079/2157] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:53.138122 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb7b93-68f4-494e-a7e5-994277f37a5c None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:53.138410 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb7b93-68f4-494e-a7e5-994277f37a5c None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:53.138696 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb7b93-68f4-494e-a7e5-994277f37a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:53.156844 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-fafb7b93-68f4-494e-a7e5-994277f37a5c None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:53.158053 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-fafb7b93-68f4-494e-a7e5-994277f37a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:53.167275 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1079/2158] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:15:53.171493 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0367cc6-6aab-40bf-9042-821d878df403 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:53.186394 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0367cc6-6aab-40bf-9042-821d878df403 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:53.188221 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2e829-e521-4d6a-9ee0-7bce780e4f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:53.188882 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2e829-e521-4d6a-9ee0-7bce780e4f36 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:53.189193 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2e829-e521-4d6a-9ee0-7bce780e4f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:53.189471 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2e829-e521-4d6a-9ee0-7bce780e4f36 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:53.190217 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2e829-e521-4d6a-9ee0-7bce780e4f36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:15:53.190525 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2e829-e521-4d6a-9ee0-7bce780e4f36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:53.192295 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2e829-e521-4d6a-9ee0-7bce780e4f36 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:53.204719 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1080/2159] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:15:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:15:53.212360 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb7b93-68f4-494e-a7e5-994277f37a5c None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:53.221809 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb7b93-68f4-494e-a7e5-994277f37a5c None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:53.226469 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a08ef-a177-4545-a7fe-436be1c2d471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:53.227112 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a08ef-a177-4545-a7fe-436be1c2d471 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:53.227437 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a08ef-a177-4545-a7fe-436be1c2d471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:53.227713 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a08ef-a177-4545-a7fe-436be1c2d471 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:53.228429 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a08ef-a177-4545-a7fe-436be1c2d471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:53.231008 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a08ef-a177-4545-a7fe-436be1c2d471 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:53.332611 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1080/2160] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:15:53 2021] POST /identity/v3/projects => generated 397 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:15:53.336421 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2e829-e521-4d6a-9ee0-7bce780e4f36 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:53.347016 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2e829-e521-4d6a-9ee0-7bce780e4f36 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:53.403029 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadea53-6023-491d-856f-9381a1fa36a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:53.403710 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadea53-6023-491d-856f-9381a1fa36a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:53.403993 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadea53-6023-491d-856f-9381a1fa36a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:53.404271 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadea53-6023-491d-856f-9381a1fa36a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:53.404972 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadea53-6023-491d-856f-9381a1fa36a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:53.406883 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadea53-6023-491d-856f-9381a1fa36a8 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:53.493748 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1081/2161] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:15:53 2021] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:15:53.498655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a08ef-a177-4545-a7fe-436be1c2d471 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:53.508806 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a08ef-a177-4545-a7fe-436be1c2d471 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:53.514016 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea38a9d-12d2-4fde-b8c7-09220847ebbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:53.514664 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea38a9d-12d2-4fde-b8c7-09220847ebbc admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:53.515015 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea38a9d-12d2-4fde-b8c7-09220847ebbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:53.515233 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea38a9d-12d2-4fde-b8c7-09220847ebbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:53.515969 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea38a9d-12d2-4fde-b8c7-09220847ebbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:53.517544 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea38a9d-12d2-4fde-b8c7-09220847ebbc admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:53.528070 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1081/2162] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:53 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:53.532156 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadea53-6023-491d-856f-9381a1fa36a8 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:53.542385 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadea53-6023-491d-856f-9381a1fa36a8 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:53.547012 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b30de-279e-4d86-90d7-f98572331d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:53.547695 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b30de-279e-4d86-90d7-f98572331d3a admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:53.548015 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b30de-279e-4d86-90d7-f98572331d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:53.548242 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b30de-279e-4d86-90d7-f98572331d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:53.549003 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b30de-279e-4d86-90d7-f98572331d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:53.550551 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b30de-279e-4d86-90d7-f98572331d3a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:53.564138 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1082/2163] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:15:53 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:15:53.565274 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea38a9d-12d2-4fde-b8c7-09220847ebbc admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:53.575930 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea38a9d-12d2-4fde-b8c7-09220847ebbc admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:53.580803 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3caba-5398-4d41-ab8e-c9da3cdfd544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:53.582004 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3caba-5398-4d41-ab8e-c9da3cdfd544 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:53.582288 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3caba-5398-4d41-ab8e-c9da3cdfd544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:53.582558 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3caba-5398-4d41-ab8e-c9da3cdfd544 admin admin] PATH_INFO: `/v3/projects/8fe6e7fe42a74daca6079e71381b9880/users/5478986b7c87432d9d5ca7831aff2bb9/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:53.598664 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3caba-5398-4d41-ab8e-c9da3cdfd544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe6e7fe42a74daca6079e71381b9880, user_id=5478986b7c87432d9d5ca7831aff2bb9, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:53.600524 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3caba-5398-4d41-ab8e-c9da3cdfd544 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:53.688972 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1082/2164] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:15:53 2021] PUT /identity/v3/projects/8fe6e7fe42a74daca6079e71381b9880/users/5478986b7c87432d9d5ca7831aff2bb9/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:15:53.706479 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d24454-7131-45cb-a03f-35ead1cf69f9 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:53.707016 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d24454-7131-45cb-a03f-35ead1cf69f9 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:53.707339 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d24454-7131-45cb-a03f-35ead1cf69f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:53.740217 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-56d24454-7131-45cb-a03f-35ead1cf69f9 None None] MFA Rules not processed for user `5478986b7c87432d9d5ca7831aff2bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:15:53.741460 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-56d24454-7131-45cb-a03f-35ead1cf69f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:53.808705 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1083/2165] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:15:53 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:15:53.819172 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3caba-5398-4d41-ab8e-c9da3cdfd544 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:53.820940 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-8ef3caba-5398-4d41-ab8e-c9da3cdfd544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:53.898955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3caba-5398-4d41-ab8e-c9da3cdfd544 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:53.904277 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000ce3d-14d5-47db-984b-09930addad71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:53.905132 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000ce3d-14d5-47db-984b-09930addad71 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:53.905523 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000ce3d-14d5-47db-984b-09930addad71 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:53.905819 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000ce3d-14d5-47db-984b-09930addad71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:53.917500 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000ce3d-14d5-47db-984b-09930addad71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:53.918951 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000ce3d-14d5-47db-984b-09930addad71 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:53.927918 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1083/2166] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:53 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:15:58.406623 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d24454-7131-45cb-a03f-35ead1cf69f9 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:15:58.408047 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-56d24454-7131-45cb-a03f-35ead1cf69f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:58.422616 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d24454-7131-45cb-a03f-35ead1cf69f9 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:15:58.427718 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603fb00-c7b6-4abe-949f-670a4bded309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:15:58.428528 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603fb00-c7b6-4abe-949f-670a4bded309 service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:15:58.428866 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603fb00-c7b6-4abe-949f-670a4bded309 service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:15:58.432351 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603fb00-c7b6-4abe-949f-670a4bded309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:15:58.432351 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-5603fb00-c7b6-4abe-949f-670a4bded309 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:15:58.512909 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603fb00-c7b6-4abe-949f-670a4bded309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:15:58.515167 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603fb00-c7b6-4abe-949f-670a4bded309 service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:15:58.541860 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1084/2167] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:15:58 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:16:00.076338 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000ce3d-14d5-47db-984b-09930addad71 service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:00.078016 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-d000ce3d-14d5-47db-984b-09930addad71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:00.154532 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000ce3d-14d5-47db-984b-09930addad71 service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:00.161148 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aed0d5-5a80-4b65-a634-795ed9b3ba0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:00.162080 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aed0d5-5a80-4b65-a634-795ed9b3ba0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:00.162369 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aed0d5-5a80-4b65-a634-795ed9b3ba0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:00.162648 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aed0d5-5a80-4b65-a634-795ed9b3ba0e admin admin] PATH_INFO: `/v3/users/1a15a0ee0d0c4dcbb7888ca913df0f6b` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:00.163937 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aed0d5-5a80-4b65-a634-795ed9b3ba0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a15a0ee0d0c4dcbb7888ca913df0f6b)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:00.167257 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aed0d5-5a80-4b65-a634-795ed9b3ba0e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:00.455108 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-e8aed0d5-5a80-4b65-a634-795ed9b3ba0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a15a0ee0d0c4dcbb7888ca913df0f6b'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:00.585471 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-e8aed0d5-5a80-4b65-a634-795ed9b3ba0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a15a0ee0d0c4dcbb7888ca913df0f6b'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:00.593927 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-e8aed0d5-5a80-4b65-a634-795ed9b3ba0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a15a0ee0d0c4dcbb7888ca913df0f6b'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:00.594636 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-e8aed0d5-5a80-4b65-a634-795ed9b3ba0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a15a0ee0d0c4dcbb7888ca913df0f6b'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:00.606634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-e8aed0d5-5a80-4b65-a634-795ed9b3ba0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a15a0ee0d0c4dcbb7888ca913df0f6b'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:00.613060 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1084/2168] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:16:00 2021] DELETE /identity/v3/users/1a15a0ee0d0c4dcbb7888ca913df0f6b => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:00.617627 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af4402-c9a8-481e-b981-ffae504ae6dd None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:00.618089 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af4402-c9a8-481e-b981-ffae504ae6dd None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:00.618399 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af4402-c9a8-481e-b981-ffae504ae6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:00.637549 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-01af4402-c9a8-481e-b981-ffae504ae6dd None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:00.638898 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-01af4402-c9a8-481e-b981-ffae504ae6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:00.701906 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1085/2169] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:00.712242 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aed0d5-5a80-4b65-a634-795ed9b3ba0e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:00.714455 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e8aed0d5-5a80-4b65-a634-795ed9b3ba0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:00.778063 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aed0d5-5a80-4b65-a634-795ed9b3ba0e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:00.782416 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c57128-8639-4089-8127-20b102e2d39c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:00.782740 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c57128-8639-4089-8127-20b102e2d39c service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:00.783342 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c57128-8639-4089-8127-20b102e2d39c service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:00.783455 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c57128-8639-4089-8127-20b102e2d39c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:00.793905 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c57128-8639-4089-8127-20b102e2d39c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:00.795341 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c57128-8639-4089-8127-20b102e2d39c service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:00.805764 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1085/2170] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:16:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:16:01.269494 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af4402-c9a8-481e-b981-ffae504ae6dd None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:01.270989 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-01af4402-c9a8-481e-b981-ffae504ae6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:01.284763 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af4402-c9a8-481e-b981-ffae504ae6dd None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:01.295305 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248467d1-76ad-409a-9d00-00a9a71136c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:01.296176 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248467d1-76ad-409a-9d00-00a9a71136c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:01.296881 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248467d1-76ad-409a-9d00-00a9a71136c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:01.297108 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248467d1-76ad-409a-9d00-00a9a71136c9 admin admin] PATH_INFO: `/v3/projects/feb880e4bb504caba2fd40061e8ea63e` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:01.298433 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248467d1-76ad-409a-9d00-00a9a71136c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feb880e4bb504caba2fd40061e8ea63e)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:01.300379 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248467d1-76ad-409a-9d00-00a9a71136c9 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:01.471604 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-248467d1-76ad-409a-9d00-00a9a71136c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feb880e4bb504caba2fd40061e8ea63e', 'request_id': 'req-248467d1-76ad-409a-9d00-00a9a71136c9'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:01.477757 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-248467d1-76ad-409a-9d00-00a9a71136c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feb880e4bb504caba2fd40061e8ea63e', 'request_id': 'req-248467d1-76ad-409a-9d00-00a9a71136c9'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:01.483792 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-248467d1-76ad-409a-9d00-00a9a71136c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feb880e4bb504caba2fd40061e8ea63e', 'request_id': 'req-248467d1-76ad-409a-9d00-00a9a71136c9'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:01.735883 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-248467d1-76ad-409a-9d00-00a9a71136c9 admin admin] The token cache is being invalidate because project feb880e4bb504caba2fd40061e8ea63e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:16:01.736850 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-248467d1-76ad-409a-9d00-00a9a71136c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:01.736850 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-248467d1-76ad-409a-9d00-00a9a71136c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:01.738421 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1086/2171] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:16:01 2021] DELETE /identity/v3/projects/feb880e4bb504caba2fd40061e8ea63e => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:01.744563 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c03732-c175-4c0d-8ac3-2e9c28fe6562 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:01.745171 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c03732-c175-4c0d-8ac3-2e9c28fe6562 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:01.745171 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c03732-c175-4c0d-8ac3-2e9c28fe6562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:01.762362 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-64c03732-c175-4c0d-8ac3-2e9c28fe6562 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:01.763726 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-64c03732-c175-4c0d-8ac3-2e9c28fe6562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:01.822330 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1086/2172] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:01.829607 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c1b27-7a6c-4534-aeda-75109d77b779 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:01.829901 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c1b27-7a6c-4534-aeda-75109d77b779 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:01.830181 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c1b27-7a6c-4534-aeda-75109d77b779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:01.850858 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-9d4c1b27-7a6c-4534-aeda-75109d77b779 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:01.852088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-9d4c1b27-7a6c-4534-aeda-75109d77b779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:01.860464 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1087/2173] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:01.864573 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c03732-c175-4c0d-8ac3-2e9c28fe6562 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:01.874992 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c03732-c175-4c0d-8ac3-2e9c28fe6562 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:01.880091 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884579a2-aaba-4614-8519-e01214dafe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:01.880745 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884579a2-aaba-4614-8519-e01214dafe16 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:01.881320 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884579a2-aaba-4614-8519-e01214dafe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:01.881320 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884579a2-aaba-4614-8519-e01214dafe16 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:01.882029 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884579a2-aaba-4614-8519-e01214dafe16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:16:01.882414 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884579a2-aaba-4614-8519-e01214dafe16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:01.884110 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884579a2-aaba-4614-8519-e01214dafe16 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:01.896116 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1087/2174] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:16:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:16:01.901171 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c1b27-7a6c-4534-aeda-75109d77b779 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:01.910137 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c1b27-7a6c-4534-aeda-75109d77b779 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:01.915099 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3da267-c0d1-4b51-b75e-46a07829bdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:01.915767 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3da267-c0d1-4b51-b75e-46a07829bdf8 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:01.916636 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3da267-c0d1-4b51-b75e-46a07829bdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:01.916913 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3da267-c0d1-4b51-b75e-46a07829bdf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:01.917618 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3da267-c0d1-4b51-b75e-46a07829bdf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:01.919512 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3da267-c0d1-4b51-b75e-46a07829bdf8 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:02.012461 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1088/2175] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:16:01 2021] POST /identity/v3/projects => generated 361 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:16:02.016540 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884579a2-aaba-4614-8519-e01214dafe16 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:02.027150 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884579a2-aaba-4614-8519-e01214dafe16 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:02.081558 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746036c-9ab3-40d4-8082-ea35e473480f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:02.082144 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746036c-9ab3-40d4-8082-ea35e473480f admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:02.082421 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746036c-9ab3-40d4-8082-ea35e473480f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:02.082793 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746036c-9ab3-40d4-8082-ea35e473480f admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:02.083523 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746036c-9ab3-40d4-8082-ea35e473480f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:02.085763 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746036c-9ab3-40d4-8082-ea35e473480f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:02.217399 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1088/2176] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:16:02 2021] POST /identity/v3/users => generated 281 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:16:02.221454 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3da267-c0d1-4b51-b75e-46a07829bdf8 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:02.231677 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3da267-c0d1-4b51-b75e-46a07829bdf8 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:02.236512 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a277d65-8f7b-40b8-a28d-fe64d91cabc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:02.237169 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a277d65-8f7b-40b8-a28d-fe64d91cabc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:02.237460 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a277d65-8f7b-40b8-a28d-fe64d91cabc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:02.237762 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a277d65-8f7b-40b8-a28d-fe64d91cabc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:02.238509 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a277d65-8f7b-40b8-a28d-fe64d91cabc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:02.240157 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a277d65-8f7b-40b8-a28d-fe64d91cabc5 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:02.252332 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1089/2177] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:16:02 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:16:02.256342 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746036c-9ab3-40d4-8082-ea35e473480f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:02.266893 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746036c-9ab3-40d4-8082-ea35e473480f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:02.271723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d67b9e-41b1-4e4b-8632-957993f78ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:02.272397 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d67b9e-41b1-4e4b-8632-957993f78ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:02.272702 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d67b9e-41b1-4e4b-8632-957993f78ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:02.272979 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d67b9e-41b1-4e4b-8632-957993f78ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:02.273737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d67b9e-41b1-4e4b-8632-957993f78ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:02.276417 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d67b9e-41b1-4e4b-8632-957993f78ab9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:02.286655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1089/2178] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:16:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:16:02.290661 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a277d65-8f7b-40b8-a28d-fe64d91cabc5 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:02.300975 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a277d65-8f7b-40b8-a28d-fe64d91cabc5 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:02.305623 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316ef47-7b89-4ae4-9480-93d4fbf2d095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:02.306529 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316ef47-7b89-4ae4-9480-93d4fbf2d095 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:02.307460 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316ef47-7b89-4ae4-9480-93d4fbf2d095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:02.307776 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316ef47-7b89-4ae4-9480-93d4fbf2d095 admin admin] PATH_INFO: `/v3/projects/8efd83206fec4dcc9c544e22f7fbf79b/users/91c247e31dc64db79ea555d4b283bff0/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:02.322800 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316ef47-7b89-4ae4-9480-93d4fbf2d095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8efd83206fec4dcc9c544e22f7fbf79b, user_id=91c247e31dc64db79ea555d4b283bff0, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:02.325577 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316ef47-7b89-4ae4-9480-93d4fbf2d095 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:02.449356 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1090/2179] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:16:02 2021] PUT /identity/v3/projects/8efd83206fec4dcc9c544e22f7fbf79b/users/91c247e31dc64db79ea555d4b283bff0/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:16:02.459407 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b1b67-4df0-4055-9969-b3ed1e04763a None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:02.459700 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b1b67-4df0-4055-9969-b3ed1e04763a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:02.459983 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b1b67-4df0-4055-9969-b3ed1e04763a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:02.487538 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-508b1b67-4df0-4055-9969-b3ed1e04763a None None] MFA Rules not processed for user `91c247e31dc64db79ea555d4b283bff0`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:02.488746 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-508b1b67-4df0-4055-9969-b3ed1e04763a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:02.556358 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1090/2180] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:02 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:02.586368 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316ef47-7b89-4ae4-9480-93d4fbf2d095 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:02.588748 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-0316ef47-7b89-4ae4-9480-93d4fbf2d095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:02.645168 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316ef47-7b89-4ae4-9480-93d4fbf2d095 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:02.648709 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73937c0c-e656-4c94-95a5-14c523a4af37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:02.649348 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73937c0c-e656-4c94-95a5-14c523a4af37 service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:02.649660 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73937c0c-e656-4c94-95a5-14c523a4af37 service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:02.649942 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73937c0c-e656-4c94-95a5-14c523a4af37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:02.659250 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73937c0c-e656-4c94-95a5-14c523a4af37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:02.660671 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73937c0c-e656-4c94-95a5-14c523a4af37 service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:02.671023 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1091/2181] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:16:02 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:16:02.684925 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b1b67-4df0-4055-9969-b3ed1e04763a None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:02.746960 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b1b67-4df0-4055-9969-b3ed1e04763a None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:02.751594 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a754b-8d15-44d7-8b30-b7f9e7afb1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:02.752453 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a754b-8d15-44d7-8b30-b7f9e7afb1d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:02.752735 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a754b-8d15-44d7-8b30-b7f9e7afb1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:02.753011 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a754b-8d15-44d7-8b30-b7f9e7afb1d9 admin admin] PATH_INFO: `/v3/users/91c247e31dc64db79ea555d4b283bff0` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:02.754226 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a754b-8d15-44d7-8b30-b7f9e7afb1d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c247e31dc64db79ea555d4b283bff0)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:02.756144 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a754b-8d15-44d7-8b30-b7f9e7afb1d9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:03.050273 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-551a754b-8d15-44d7-8b30-b7f9e7afb1d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c247e31dc64db79ea555d4b283bff0'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:03.124407 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-551a754b-8d15-44d7-8b30-b7f9e7afb1d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c247e31dc64db79ea555d4b283bff0'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:03.131347 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-551a754b-8d15-44d7-8b30-b7f9e7afb1d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c247e31dc64db79ea555d4b283bff0'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:03.131978 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-551a754b-8d15-44d7-8b30-b7f9e7afb1d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c247e31dc64db79ea555d4b283bff0'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:03.143631 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-551a754b-8d15-44d7-8b30-b7f9e7afb1d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c247e31dc64db79ea555d4b283bff0'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:03.149308 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1091/2182] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:16:02 2021] DELETE /identity/v3/users/91c247e31dc64db79ea555d4b283bff0 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:03.154472 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bb3e9-07b3-4fee-9fe8-80d8c212d21e None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:03.155028 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bb3e9-07b3-4fee-9fe8-80d8c212d21e None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:03.155116 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bb3e9-07b3-4fee-9fe8-80d8c212d21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:03.173677 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-985bb3e9-07b3-4fee-9fe8-80d8c212d21e None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:03.175025 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-985bb3e9-07b3-4fee-9fe8-80d8c212d21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:03.237154 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1092/2183] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:03.260544 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a754b-8d15-44d7-8b30-b7f9e7afb1d9 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:03.260544 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-551a754b-8d15-44d7-8b30-b7f9e7afb1d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:03.327842 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a754b-8d15-44d7-8b30-b7f9e7afb1d9 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:03.331561 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc338a-5cc7-4201-9ba7-7e5aa4dfe73a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:03.332199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc338a-5cc7-4201-9ba7-7e5aa4dfe73a service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:03.332536 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc338a-5cc7-4201-9ba7-7e5aa4dfe73a service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:03.332824 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc338a-5cc7-4201-9ba7-7e5aa4dfe73a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:03.343129 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc338a-5cc7-4201-9ba7-7e5aa4dfe73a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:03.344669 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc338a-5cc7-4201-9ba7-7e5aa4dfe73a service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:03.354880 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1092/2184] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:16:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:16:04.456493 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bb3e9-07b3-4fee-9fe8-80d8c212d21e None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:04.457920 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-985bb3e9-07b3-4fee-9fe8-80d8c212d21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:04.469847 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bb3e9-07b3-4fee-9fe8-80d8c212d21e None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:04.474842 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458908b-a401-4fd4-8858-ac19f3953de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:04.475762 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458908b-a401-4fd4-8858-ac19f3953de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:04.476049 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458908b-a401-4fd4-8858-ac19f3953de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:04.476329 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458908b-a401-4fd4-8858-ac19f3953de7 admin admin] PATH_INFO: `/v3/projects/8efd83206fec4dcc9c544e22f7fbf79b` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:04.477649 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458908b-a401-4fd4-8858-ac19f3953de7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8efd83206fec4dcc9c544e22f7fbf79b)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:04.480565 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458908b-a401-4fd4-8858-ac19f3953de7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:04.639226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2458908b-a401-4fd4-8858-ac19f3953de7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8efd83206fec4dcc9c544e22f7fbf79b', 'request_id': 'req-2458908b-a401-4fd4-8858-ac19f3953de7'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:04.646129 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2458908b-a401-4fd4-8858-ac19f3953de7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8efd83206fec4dcc9c544e22f7fbf79b', 'request_id': 'req-2458908b-a401-4fd4-8858-ac19f3953de7'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:04.651757 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2458908b-a401-4fd4-8858-ac19f3953de7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8efd83206fec4dcc9c544e22f7fbf79b', 'request_id': 'req-2458908b-a401-4fd4-8858-ac19f3953de7'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:04.739104 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2458908b-a401-4fd4-8858-ac19f3953de7 admin admin] The token cache is being invalidate because project 8efd83206fec4dcc9c544e22f7fbf79b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:16:04.739423 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2458908b-a401-4fd4-8858-ac19f3953de7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:04.740032 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2458908b-a401-4fd4-8858-ac19f3953de7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:04.741546 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1093/2185] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:16:04 2021] DELETE /identity/v3/projects/8efd83206fec4dcc9c544e22f7fbf79b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:04.747672 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7f763-3a99-4785-9789-1dfc0a9a425b None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:04.748175 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7f763-3a99-4785-9789-1dfc0a9a425b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:04.748271 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7f763-3a99-4785-9789-1dfc0a9a425b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:04.767179 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-a6d7f763-3a99-4785-9789-1dfc0a9a425b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:04.768383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-a6d7f763-3a99-4785-9789-1dfc0a9a425b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:04.827164 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1093/2186] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:04.835811 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db0e02-24ac-4dbc-9a3f-8557f85c0674 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:04.836125 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db0e02-24ac-4dbc-9a3f-8557f85c0674 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:04.836409 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db0e02-24ac-4dbc-9a3f-8557f85c0674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:04.854141 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-52db0e02-24ac-4dbc-9a3f-8557f85c0674 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:04.855402 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-52db0e02-24ac-4dbc-9a3f-8557f85c0674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:04.863068 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1094/2187] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:04.867172 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7f763-3a99-4785-9789-1dfc0a9a425b None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:04.877136 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7f763-3a99-4785-9789-1dfc0a9a425b None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:04.881581 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cba82-f859-4917-b229-515a421b147b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:04.882220 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cba82-f859-4917-b229-515a421b147b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:04.882503 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cba82-f859-4917-b229-515a421b147b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:04.882778 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cba82-f859-4917-b229-515a421b147b admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:04.883560 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4cba82-f859-4917-b229-515a421b147b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:16:04.883864 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4cba82-f859-4917-b229-515a421b147b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:04.885720 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4cba82-f859-4917-b229-515a421b147b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:04.896856 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1094/2188] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:16:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 04:16:04.901753 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db0e02-24ac-4dbc-9a3f-8557f85c0674 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:04.910814 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db0e02-24ac-4dbc-9a3f-8557f85c0674 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:04.915734 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb65b3-d695-4f6c-8fa7-346882bc72e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:04.916992 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb65b3-d695-4f6c-8fa7-346882bc72e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:04.917277 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb65b3-d695-4f6c-8fa7-346882bc72e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:04.917556 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb65b3-d695-4f6c-8fa7-346882bc72e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:04.918351 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb65b3-d695-4f6c-8fa7-346882bc72e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:04.920187 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb65b3-d695-4f6c-8fa7-346882bc72e5 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:05.030349 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1095/2189] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:16:04 2021] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:16:05.031637 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cba82-f859-4917-b229-515a421b147b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:05.043884 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cba82-f859-4917-b229-515a421b147b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:05.103665 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17c285-ca1e-41ae-8f6f-3b7c19231311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:05.104328 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17c285-ca1e-41ae-8f6f-3b7c19231311 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:05.104603 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17c285-ca1e-41ae-8f6f-3b7c19231311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:05.104874 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17c285-ca1e-41ae-8f6f-3b7c19231311 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:05.105566 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17c285-ca1e-41ae-8f6f-3b7c19231311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:05.107544 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17c285-ca1e-41ae-8f6f-3b7c19231311 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:05.248059 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1095/2190] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:16:05 2021] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:16:05.249290 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb65b3-d695-4f6c-8fa7-346882bc72e5 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:05.259446 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb65b3-d695-4f6c-8fa7-346882bc72e5 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:05.264695 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989c282-9874-4c15-974d-199804127c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:05.265340 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989c282-9874-4c15-974d-199804127c70 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:05.265622 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989c282-9874-4c15-974d-199804127c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:05.265896 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989c282-9874-4c15-974d-199804127c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:05.266636 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989c282-9874-4c15-974d-199804127c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:05.268236 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989c282-9874-4c15-974d-199804127c70 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:05.279223 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1096/2191] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:16:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:16:05.283501 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17c285-ca1e-41ae-8f6f-3b7c19231311 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:05.293919 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17c285-ca1e-41ae-8f6f-3b7c19231311 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:05.304646 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2bdd8-8d0c-4d66-885c-84e2bb57f29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:05.304646 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2bdd8-8d0c-4d66-885c-84e2bb57f29e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:05.304646 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2bdd8-8d0c-4d66-885c-84e2bb57f29e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:05.304646 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2bdd8-8d0c-4d66-885c-84e2bb57f29e admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:05.304953 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2bdd8-8d0c-4d66-885c-84e2bb57f29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:05.304953 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2bdd8-8d0c-4d66-885c-84e2bb57f29e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:05.315421 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1096/2192] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:16:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:16:05.316511 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989c282-9874-4c15-974d-199804127c70 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:05.327148 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989c282-9874-4c15-974d-199804127c70 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:05.331702 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43207d86-5d97-4086-9a38-8d962df89664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:05.332572 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43207d86-5d97-4086-9a38-8d962df89664 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:05.332854 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43207d86-5d97-4086-9a38-8d962df89664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:05.333126 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43207d86-5d97-4086-9a38-8d962df89664 admin admin] PATH_INFO: `/v3/projects/9af8de1393564b03bc2960472aaf9afa/users/31f717ffd5b5454088b765a34e8b9358/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:05.348494 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43207d86-5d97-4086-9a38-8d962df89664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af8de1393564b03bc2960472aaf9afa, user_id=31f717ffd5b5454088b765a34e8b9358, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:05.351098 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43207d86-5d97-4086-9a38-8d962df89664 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:05.512013 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1097/2193] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:16:05 2021] PUT /identity/v3/projects/9af8de1393564b03bc2960472aaf9afa/users/31f717ffd5b5454088b765a34e8b9358/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:05.522346 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89506f7a-ca72-49ad-93eb-be1b1c09f6b6 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:05.522640 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89506f7a-ca72-49ad-93eb-be1b1c09f6b6 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:05.522919 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89506f7a-ca72-49ad-93eb-be1b1c09f6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:05.548913 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-89506f7a-ca72-49ad-93eb-be1b1c09f6b6 None None] MFA Rules not processed for user `31f717ffd5b5454088b765a34e8b9358`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:05.550100 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-89506f7a-ca72-49ad-93eb-be1b1c09f6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:05.610066 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1097/2194] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:05 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:05.614581 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43207d86-5d97-4086-9a38-8d962df89664 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:05.674440 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43207d86-5d97-4086-9a38-8d962df89664 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:05.679052 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd4540-c72e-4baa-bea9-8e94a2fe8f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:05.679734 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd4540-c72e-4baa-bea9-8e94a2fe8f60 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:05.680018 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd4540-c72e-4baa-bea9-8e94a2fe8f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:05.680295 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd4540-c72e-4baa-bea9-8e94a2fe8f60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:05.680999 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd4540-c72e-4baa-bea9-8e94a2fe8f60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:05.683547 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd4540-c72e-4baa-bea9-8e94a2fe8f60 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:05.768947 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1098/2195] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:16:05 2021] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:16:05.772988 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89506f7a-ca72-49ad-93eb-be1b1c09f6b6 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:05.785012 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89506f7a-ca72-49ad-93eb-be1b1c09f6b6 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:05.839831 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542d060-414b-417a-a231-f903541ca57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:05.840484 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542d060-414b-417a-a231-f903541ca57c admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:05.840765 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542d060-414b-417a-a231-f903541ca57c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:05.841048 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542d060-414b-417a-a231-f903541ca57c admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:05.841735 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542d060-414b-417a-a231-f903541ca57c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:05.843643 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542d060-414b-417a-a231-f903541ca57c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:05.936116 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1098/2196] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:16:05 2021] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:16:05.940236 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd4540-c72e-4baa-bea9-8e94a2fe8f60 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:05.950851 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd4540-c72e-4baa-bea9-8e94a2fe8f60 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:05.955665 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4418fe-7517-48fd-a400-96f5dea86ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:05.956312 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4418fe-7517-48fd-a400-96f5dea86ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:05.956593 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4418fe-7517-48fd-a400-96f5dea86ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:05.956867 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4418fe-7517-48fd-a400-96f5dea86ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:05.957601 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4418fe-7517-48fd-a400-96f5dea86ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:05.959393 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4418fe-7517-48fd-a400-96f5dea86ac3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:05.971855 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1099/2197] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:16:05 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:16:05.976038 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542d060-414b-417a-a231-f903541ca57c admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:05.987698 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542d060-414b-417a-a231-f903541ca57c admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:05.992286 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd686fb-11c4-4c87-a1a1-486f0096b9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:05.993088 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd686fb-11c4-4c87-a1a1-486f0096b9e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:05.993371 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd686fb-11c4-4c87-a1a1-486f0096b9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:05.993643 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd686fb-11c4-4c87-a1a1-486f0096b9e7 admin admin] PATH_INFO: `/v3/projects/7ef2a03fc8e64dc5827d37c370f0ae3a/users/380885e9e67d493ab367e1c32a4948d1/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:06.010454 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd686fb-11c4-4c87-a1a1-486f0096b9e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef2a03fc8e64dc5827d37c370f0ae3a, user_id=380885e9e67d493ab367e1c32a4948d1, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:06.013077 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd686fb-11c4-4c87-a1a1-486f0096b9e7 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:06.108739 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1099/2198] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:16:05 2021] PUT /identity/v3/projects/7ef2a03fc8e64dc5827d37c370f0ae3a/users/380885e9e67d493ab367e1c32a4948d1/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:06.112738 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4418fe-7517-48fd-a400-96f5dea86ac3 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:06.122804 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4418fe-7517-48fd-a400-96f5dea86ac3 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:06.178594 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6951ed-bd76-46fc-8bae-9bad3d286283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:06.179284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6951ed-bd76-46fc-8bae-9bad3d286283 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:06.179677 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6951ed-bd76-46fc-8bae-9bad3d286283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:06.179959 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6951ed-bd76-46fc-8bae-9bad3d286283 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:06.180725 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6951ed-bd76-46fc-8bae-9bad3d286283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:06.182538 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6951ed-bd76-46fc-8bae-9bad3d286283 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:06.192477 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1100/2199] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:16:06 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:16:06.196831 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd686fb-11c4-4c87-a1a1-486f0096b9e7 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:06.208293 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd686fb-11c4-4c87-a1a1-486f0096b9e7 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:06.213602 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f37c2f-c7e0-47b3-bb4f-4605def10ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:06.214485 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f37c2f-c7e0-47b3-bb4f-4605def10ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:06.214765 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f37c2f-c7e0-47b3-bb4f-4605def10ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:06.215037 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f37c2f-c7e0-47b3-bb4f-4605def10ab0 admin admin] PATH_INFO: `/v3/projects/7ef2a03fc8e64dc5827d37c370f0ae3a/users/380885e9e67d493ab367e1c32a4948d1/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:06.217024 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f37c2f-c7e0-47b3-bb4f-4605def10ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef2a03fc8e64dc5827d37c370f0ae3a, user_id=380885e9e67d493ab367e1c32a4948d1, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:06.219675 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f37c2f-c7e0-47b3-bb4f-4605def10ab0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:06.231316 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1100/2200] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:16:06 2021] PUT /identity/v3/projects/7ef2a03fc8e64dc5827d37c370f0ae3a/users/380885e9e67d493ab367e1c32a4948d1/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:06.241488 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b42143-a2b4-4349-a8f4-c933b9616db9 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:06.241774 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b42143-a2b4-4349-a8f4-c933b9616db9 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:06.242056 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b42143-a2b4-4349-a8f4-c933b9616db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:06.268334 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-e9b42143-a2b4-4349-a8f4-c933b9616db9 None None] MFA Rules not processed for user `380885e9e67d493ab367e1c32a4948d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:06.269563 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-e9b42143-a2b4-4349-a8f4-c933b9616db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:06.338814 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1101/2201] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:06 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:06.348955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f37c2f-c7e0-47b3-bb4f-4605def10ab0 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:06.350628 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-c1f37c2f-c7e0-47b3-bb4f-4605def10ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:06.407060 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f37c2f-c7e0-47b3-bb4f-4605def10ab0 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:06.410801 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a8d18-9f9f-41c3-86ed-6c6cf3ad7b1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:06.411486 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a8d18-9f9f-41c3-86ed-6c6cf3ad7b1c service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:06.411802 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a8d18-9f9f-41c3-86ed-6c6cf3ad7b1c service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:06.412085 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a8d18-9f9f-41c3-86ed-6c6cf3ad7b1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:06.471670 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a8d18-9f9f-41c3-86ed-6c6cf3ad7b1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:06.478946 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a8d18-9f9f-41c3-86ed-6c6cf3ad7b1c service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:06.483758 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1101/2202] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:16:06 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:16:16.921603 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b42143-a2b4-4349-a8f4-c933b9616db9 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:16.985132 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b42143-a2b4-4349-a8f4-c933b9616db9 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:16.991272 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24caf1c4-2eb9-4074-ad62-1fa0c5d5786f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:16.992279 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24caf1c4-2eb9-4074-ad62-1fa0c5d5786f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:16.992564 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24caf1c4-2eb9-4074-ad62-1fa0c5d5786f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:16.992848 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24caf1c4-2eb9-4074-ad62-1fa0c5d5786f admin admin] PATH_INFO: `/v3/users/31f717ffd5b5454088b765a34e8b9358` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:16.995088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24caf1c4-2eb9-4074-ad62-1fa0c5d5786f admin admin] RBAC: Authorizing `identity:delete_user(user_id=31f717ffd5b5454088b765a34e8b9358)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:16.997632 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24caf1c4-2eb9-4074-ad62-1fa0c5d5786f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:17.205434 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-24caf1c4-2eb9-4074-ad62-1fa0c5d5786f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31f717ffd5b5454088b765a34e8b9358'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:17.288035 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-24caf1c4-2eb9-4074-ad62-1fa0c5d5786f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31f717ffd5b5454088b765a34e8b9358'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:17.297204 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-24caf1c4-2eb9-4074-ad62-1fa0c5d5786f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31f717ffd5b5454088b765a34e8b9358'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:17.297957 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-24caf1c4-2eb9-4074-ad62-1fa0c5d5786f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31f717ffd5b5454088b765a34e8b9358'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:17.300779 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a8d18-9f9f-41c3-86ed-6c6cf3ad7b1c service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:17.305016 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-0a9a8d18-9f9f-41c3-86ed-6c6cf3ad7b1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:17.319772 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a8d18-9f9f-41c3-86ed-6c6cf3ad7b1c service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:17.326023 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4e63d-2c54-4701-af40-f102c4b47f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:17.336209 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4e63d-2c54-4701-af40-f102c4b47f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:17.336209 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4e63d-2c54-4701-af40-f102c4b47f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:17.336209 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4e63d-2c54-4701-af40-f102c4b47f8d admin admin] PATH_INFO: `/v3/users/5478986b7c87432d9d5ca7831aff2bb9` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:17.336438 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-24caf1c4-2eb9-4074-ad62-1fa0c5d5786f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31f717ffd5b5454088b765a34e8b9358'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:17.336438 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1102/2203] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:16:16 2021] DELETE /identity/v3/users/31f717ffd5b5454088b765a34e8b9358 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:17.336591 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4e63d-2c54-4701-af40-f102c4b47f8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5478986b7c87432d9d5ca7831aff2bb9)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:17.340423 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4e63d-2c54-4701-af40-f102c4b47f8d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:17.340657 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee6b95-2506-42da-9d23-30de04414886 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:17.341401 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee6b95-2506-42da-9d23-30de04414886 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:17.341401 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee6b95-2506-42da-9d23-30de04414886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:17.363675 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-41ee6b95-2506-42da-9d23-30de04414886 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:17.364985 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-41ee6b95-2506-42da-9d23-30de04414886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:17.426635 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1103/2204] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:16:17.438313 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee6b95-2506-42da-9d23-30de04414886 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:17.439844 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-41ee6b95-2506-42da-9d23-30de04414886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:17.513455 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee6b95-2506-42da-9d23-30de04414886 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:17.527109 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533809c-3ef5-4628-8935-7b1f8b715eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:17.527800 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533809c-3ef5-4628-8935-7b1f8b715eba service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:17.528082 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533809c-3ef5-4628-8935-7b1f8b715eba service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:17.528358 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533809c-3ef5-4628-8935-7b1f8b715eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:17.540320 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533809c-3ef5-4628-8935-7b1f8b715eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:17.542292 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533809c-3ef5-4628-8935-7b1f8b715eba service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:17.560842 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1104/2205] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:16:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:16:17.590720 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-e6c4e63d-2c54-4701-af40-f102c4b47f8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5478986b7c87432d9d5ca7831aff2bb9'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:17.690690 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-e6c4e63d-2c54-4701-af40-f102c4b47f8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5478986b7c87432d9d5ca7831aff2bb9'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:17.699847 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-e6c4e63d-2c54-4701-af40-f102c4b47f8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5478986b7c87432d9d5ca7831aff2bb9'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:17.703818 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-e6c4e63d-2c54-4701-af40-f102c4b47f8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5478986b7c87432d9d5ca7831aff2bb9'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:17.712175 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-e6c4e63d-2c54-4701-af40-f102c4b47f8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5478986b7c87432d9d5ca7831aff2bb9'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:17.717992 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1102/2206] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:16:17 2021] DELETE /identity/v3/users/5478986b7c87432d9d5ca7831aff2bb9 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:16:17.722626 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1720d5-40af-4c28-bb10-54f4ab390f80 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:17.722991 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1720d5-40af-4c28-bb10-54f4ab390f80 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:17.723361 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1720d5-40af-4c28-bb10-54f4ab390f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:17.757740 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-8d1720d5-40af-4c28-bb10-54f4ab390f80 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:17.758896 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-8d1720d5-40af-4c28-bb10-54f4ab390f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:17.848101 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1105/2207] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:17.859715 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4e63d-2c54-4701-af40-f102c4b47f8d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:17.861179 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e6c4e63d-2c54-4701-af40-f102c4b47f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:17.917915 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4e63d-2c54-4701-af40-f102c4b47f8d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:17.921488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb8b3d-88a1-47f3-a526-3433d40770bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:17.922126 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb8b3d-88a1-47f3-a526-3433d40770bc service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:17.922421 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb8b3d-88a1-47f3-a526-3433d40770bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:17.922690 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb8b3d-88a1-47f3-a526-3433d40770bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:17.932145 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb8b3d-88a1-47f3-a526-3433d40770bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:17.933584 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb8b3d-88a1-47f3-a526-3433d40770bc service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:17.942832 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1103/2208] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:16:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:16:18.004479 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1720d5-40af-4c28-bb10-54f4ab390f80 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:18.006230 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-8d1720d5-40af-4c28-bb10-54f4ab390f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:18.032264 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1720d5-40af-4c28-bb10-54f4ab390f80 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:18.045447 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7639e9-422d-4e8a-bf0d-f6e7b26854a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:18.046519 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7639e9-422d-4e8a-bf0d-f6e7b26854a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:18.046798 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7639e9-422d-4e8a-bf0d-f6e7b26854a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:18.047071 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7639e9-422d-4e8a-bf0d-f6e7b26854a1 admin admin] PATH_INFO: `/v3/projects/9af8de1393564b03bc2960472aaf9afa` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:18.048349 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7639e9-422d-4e8a-bf0d-f6e7b26854a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9af8de1393564b03bc2960472aaf9afa)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:18.050299 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7639e9-422d-4e8a-bf0d-f6e7b26854a1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:18.201595 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-fa7639e9-422d-4e8a-bf0d-f6e7b26854a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9af8de1393564b03bc2960472aaf9afa', 'request_id': 'req-fa7639e9-422d-4e8a-bf0d-f6e7b26854a1'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:18.207754 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-fa7639e9-422d-4e8a-bf0d-f6e7b26854a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9af8de1393564b03bc2960472aaf9afa', 'request_id': 'req-fa7639e9-422d-4e8a-bf0d-f6e7b26854a1'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:18.213715 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-fa7639e9-422d-4e8a-bf0d-f6e7b26854a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9af8de1393564b03bc2960472aaf9afa', 'request_id': 'req-fa7639e9-422d-4e8a-bf0d-f6e7b26854a1'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:18.290400 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-fa7639e9-422d-4e8a-bf0d-f6e7b26854a1 admin admin] The token cache is being invalidate because project 9af8de1393564b03bc2960472aaf9afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:16:18.293969 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-fa7639e9-422d-4e8a-bf0d-f6e7b26854a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:18.293969 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-fa7639e9-422d-4e8a-bf0d-f6e7b26854a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:18.293969 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1106/2209] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:16:18 2021] DELETE /identity/v3/projects/9af8de1393564b03bc2960472aaf9afa => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:18.297183 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb8b3d-88a1-47f3-a526-3433d40770bc service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:18.308481 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb8b3d-88a1-47f3-a526-3433d40770bc service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:18.364774 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be9ec8-36e1-4979-8398-03e4fdc11033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:18.365716 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be9ec8-36e1-4979-8398-03e4fdc11033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:18.366007 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be9ec8-36e1-4979-8398-03e4fdc11033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:18.366366 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be9ec8-36e1-4979-8398-03e4fdc11033 admin admin] PATH_INFO: `/v3/users/380885e9e67d493ab367e1c32a4948d1` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:18.367552 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be9ec8-36e1-4979-8398-03e4fdc11033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=380885e9e67d493ab367e1c32a4948d1)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:18.370026 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be9ec8-36e1-4979-8398-03e4fdc11033 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:18.409763 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7639e9-422d-4e8a-bf0d-f6e7b26854a1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:18.419169 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-fa7639e9-422d-4e8a-bf0d-f6e7b26854a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:18.434049 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7639e9-422d-4e8a-bf0d-f6e7b26854a1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:18.439430 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce619a30-c914-4dda-b809-de49709f292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:18.440290 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce619a30-c914-4dda-b809-de49709f292d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:18.440572 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce619a30-c914-4dda-b809-de49709f292d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:18.440846 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce619a30-c914-4dda-b809-de49709f292d admin admin] PATH_INFO: `/v3/projects/8fe6e7fe42a74daca6079e71381b9880` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:18.442112 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce619a30-c914-4dda-b809-de49709f292d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fe6e7fe42a74daca6079e71381b9880)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:18.444031 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce619a30-c914-4dda-b809-de49709f292d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:18.676586 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-13be9ec8-36e1-4979-8398-03e4fdc11033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '380885e9e67d493ab367e1c32a4948d1'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:18.678858 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-ce619a30-c914-4dda-b809-de49709f292d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fe6e7fe42a74daca6079e71381b9880', 'request_id': 'req-ce619a30-c914-4dda-b809-de49709f292d'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:18.685737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-ce619a30-c914-4dda-b809-de49709f292d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fe6e7fe42a74daca6079e71381b9880', 'request_id': 'req-ce619a30-c914-4dda-b809-de49709f292d'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:18.691012 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-ce619a30-c914-4dda-b809-de49709f292d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fe6e7fe42a74daca6079e71381b9880', 'request_id': 'req-ce619a30-c914-4dda-b809-de49709f292d'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:18.798207 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-13be9ec8-36e1-4979-8398-03e4fdc11033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '380885e9e67d493ab367e1c32a4948d1'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:18.801409 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-13be9ec8-36e1-4979-8398-03e4fdc11033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '380885e9e67d493ab367e1c32a4948d1'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:18.802171 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-13be9ec8-36e1-4979-8398-03e4fdc11033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '380885e9e67d493ab367e1c32a4948d1'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:18.814525 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-13be9ec8-36e1-4979-8398-03e4fdc11033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '380885e9e67d493ab367e1c32a4948d1'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:18.820757 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1104/2210] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:16:18 2021] DELETE /identity/v3/users/380885e9e67d493ab367e1c32a4948d1 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:18.924075 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-ce619a30-c914-4dda-b809-de49709f292d admin admin] The token cache is being invalidate because project 8fe6e7fe42a74daca6079e71381b9880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:16:18.924373 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-ce619a30-c914-4dda-b809-de49709f292d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:18.924991 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-ce619a30-c914-4dda-b809-de49709f292d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:18.926830 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1107/2211] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:16:18 2021] DELETE /identity/v3/projects/8fe6e7fe42a74daca6079e71381b9880 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:19.238044 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be9ec8-36e1-4979-8398-03e4fdc11033 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:19.240690 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-13be9ec8-36e1-4979-8398-03e4fdc11033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:19.304398 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be9ec8-36e1-4979-8398-03e4fdc11033 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:19.308995 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86c7e0-406f-44c8-a4a8-d04f334d7122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:19.309840 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86c7e0-406f-44c8-a4a8-d04f334d7122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:19.310143 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86c7e0-406f-44c8-a4a8-d04f334d7122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:19.310419 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86c7e0-406f-44c8-a4a8-d04f334d7122 admin admin] PATH_INFO: `/v3/projects/7ef2a03fc8e64dc5827d37c370f0ae3a` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:19.311642 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86c7e0-406f-44c8-a4a8-d04f334d7122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ef2a03fc8e64dc5827d37c370f0ae3a)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:19.313574 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86c7e0-406f-44c8-a4a8-d04f334d7122 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:19.462520 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-0e86c7e0-406f-44c8-a4a8-d04f334d7122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ef2a03fc8e64dc5827d37c370f0ae3a', 'request_id': 'req-0e86c7e0-406f-44c8-a4a8-d04f334d7122'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:19.468999 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-0e86c7e0-406f-44c8-a4a8-d04f334d7122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ef2a03fc8e64dc5827d37c370f0ae3a', 'request_id': 'req-0e86c7e0-406f-44c8-a4a8-d04f334d7122'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:19.474369 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-0e86c7e0-406f-44c8-a4a8-d04f334d7122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ef2a03fc8e64dc5827d37c370f0ae3a', 'request_id': 'req-0e86c7e0-406f-44c8-a4a8-d04f334d7122'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:19.579930 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-0e86c7e0-406f-44c8-a4a8-d04f334d7122 admin admin] The token cache is being invalidate because project 7ef2a03fc8e64dc5827d37c370f0ae3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:16:19.580398 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-0e86c7e0-406f-44c8-a4a8-d04f334d7122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:19.581197 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-0e86c7e0-406f-44c8-a4a8-d04f334d7122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:19.583204 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1105/2212] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:16:19 2021] DELETE /identity/v3/projects/7ef2a03fc8e64dc5827d37c370f0ae3a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:19.590888 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63910cc0-79da-4281-a7dc-06c4a6960de7 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:19.598358 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63910cc0-79da-4281-a7dc-06c4a6960de7 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:19.598358 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63910cc0-79da-4281-a7dc-06c4a6960de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:19.612383 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-63910cc0-79da-4281-a7dc-06c4a6960de7 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:19.613710 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-63910cc0-79da-4281-a7dc-06c4a6960de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:19.673737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1108/2213] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:19.682057 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99099d89-edf5-43f2-8e6e-975112883eb8 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:19.682576 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99099d89-edf5-43f2-8e6e-975112883eb8 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:19.682896 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99099d89-edf5-43f2-8e6e-975112883eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:19.702476 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-99099d89-edf5-43f2-8e6e-975112883eb8 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:19.703705 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-99099d89-edf5-43f2-8e6e-975112883eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:19.713600 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1106/2214] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:19.717639 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63910cc0-79da-4281-a7dc-06c4a6960de7 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:19.730763 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63910cc0-79da-4281-a7dc-06c4a6960de7 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:19.735822 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73436f83-cd80-4fa5-8270-53e3ef8ab1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:19.736482 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73436f83-cd80-4fa5-8270-53e3ef8ab1ab admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:19.736765 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73436f83-cd80-4fa5-8270-53e3ef8ab1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:19.737101 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73436f83-cd80-4fa5-8270-53e3ef8ab1ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:19.737763 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73436f83-cd80-4fa5-8270-53e3ef8ab1ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:16:19.738064 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73436f83-cd80-4fa5-8270-53e3ef8ab1ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:19.739681 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73436f83-cd80-4fa5-8270-53e3ef8ab1ab admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:19.752916 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1109/2215] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:16:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:16:19.757369 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99099d89-edf5-43f2-8e6e-975112883eb8 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:19.767037 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99099d89-edf5-43f2-8e6e-975112883eb8 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:19.771814 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313a822-5b78-4bb1-9a20-3ccc95220840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:19.773875 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313a822-5b78-4bb1-9a20-3ccc95220840 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:19.773875 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313a822-5b78-4bb1-9a20-3ccc95220840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:19.773875 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313a822-5b78-4bb1-9a20-3ccc95220840 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:19.773875 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313a822-5b78-4bb1-9a20-3ccc95220840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:19.775730 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313a822-5b78-4bb1-9a20-3ccc95220840 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:19.860998 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1107/2216] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:16:19 2021] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:16:19.865377 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73436f83-cd80-4fa5-8270-53e3ef8ab1ab admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:19.875845 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73436f83-cd80-4fa5-8270-53e3ef8ab1ab admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:19.930215 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d0457-4e88-4887-a54e-2a4a55797025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:19.931014 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d0457-4e88-4887-a54e-2a4a55797025 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:19.931906 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d0457-4e88-4887-a54e-2a4a55797025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:19.932184 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d0457-4e88-4887-a54e-2a4a55797025 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:19.932886 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d0457-4e88-4887-a54e-2a4a55797025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:19.934774 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d0457-4e88-4887-a54e-2a4a55797025 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:20.036298 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1110/2217] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:16:19 2021] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:16:20.041088 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313a822-5b78-4bb1-9a20-3ccc95220840 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:20.051072 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313a822-5b78-4bb1-9a20-3ccc95220840 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:20.055667 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32819b5-c886-4bc6-a853-9af41fb206b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:20.057071 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32819b5-c886-4bc6-a853-9af41fb206b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:20.057539 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32819b5-c886-4bc6-a853-9af41fb206b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:20.057823 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32819b5-c886-4bc6-a853-9af41fb206b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:20.058561 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32819b5-c886-4bc6-a853-9af41fb206b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:20.060159 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32819b5-c886-4bc6-a853-9af41fb206b8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:20.070282 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1108/2218] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:16:20 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:16:20.075855 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d0457-4e88-4887-a54e-2a4a55797025 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:20.087063 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d0457-4e88-4887-a54e-2a4a55797025 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:20.091235 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f53c94-c3df-47ab-909f-4080382993c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:20.091978 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f53c94-c3df-47ab-909f-4080382993c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:20.092400 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f53c94-c3df-47ab-909f-4080382993c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:20.092691 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f53c94-c3df-47ab-909f-4080382993c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:20.093441 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f53c94-c3df-47ab-909f-4080382993c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:20.095018 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f53c94-c3df-47ab-909f-4080382993c3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:20.106452 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1111/2219] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:16:20 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:16:20.110705 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32819b5-c886-4bc6-a853-9af41fb206b8 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:20.121891 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32819b5-c886-4bc6-a853-9af41fb206b8 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:20.126529 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a38df-dad8-4fcf-b7b6-ad2d5d4af4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:20.127435 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a38df-dad8-4fcf-b7b6-ad2d5d4af4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:20.127723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a38df-dad8-4fcf-b7b6-ad2d5d4af4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:20.128001 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a38df-dad8-4fcf-b7b6-ad2d5d4af4e4 admin admin] PATH_INFO: `/v3/projects/0451d916bed04c8fa7d78bb2efa5ff7f/users/4f61122ad92041b0a88f848776a2ab7e/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:20.143370 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a38df-dad8-4fcf-b7b6-ad2d5d4af4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0451d916bed04c8fa7d78bb2efa5ff7f, user_id=4f61122ad92041b0a88f848776a2ab7e, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:20.146199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a38df-dad8-4fcf-b7b6-ad2d5d4af4e4 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:20.242391 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1109/2220] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:16:20 2021] PUT /identity/v3/projects/0451d916bed04c8fa7d78bb2efa5ff7f/users/4f61122ad92041b0a88f848776a2ab7e/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:16:20.253348 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e18e45-a3a8-4ac3-99b3-9be4ecafa876 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:20.253639 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e18e45-a3a8-4ac3-99b3-9be4ecafa876 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:20.253913 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e18e45-a3a8-4ac3-99b3-9be4ecafa876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:20.279857 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-e9e18e45-a3a8-4ac3-99b3-9be4ecafa876 None None] MFA Rules not processed for user `4f61122ad92041b0a88f848776a2ab7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:20.281080 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-e9e18e45-a3a8-4ac3-99b3-9be4ecafa876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:20.343837 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1112/2221] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:20 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:20.354672 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a38df-dad8-4fcf-b7b6-ad2d5d4af4e4 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:20.356437 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-7d1a38df-dad8-4fcf-b7b6-ad2d5d4af4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:20.409129 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a38df-dad8-4fcf-b7b6-ad2d5d4af4e4 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:20.412681 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6948a2-2b37-4571-8262-07c948e1025e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:20.413306 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6948a2-2b37-4571-8262-07c948e1025e service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:20.413586 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6948a2-2b37-4571-8262-07c948e1025e service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:20.413857 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6948a2-2b37-4571-8262-07c948e1025e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:20.422700 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6948a2-2b37-4571-8262-07c948e1025e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:20.424143 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6948a2-2b37-4571-8262-07c948e1025e service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:20.432954 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1110/2222] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:16:20 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:16:34.909959 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e18e45-a3a8-4ac3-99b3-9be4ecafa876 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:34.911549 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-e9e18e45-a3a8-4ac3-99b3-9be4ecafa876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:35.047358 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e18e45-a3a8-4ac3-99b3-9be4ecafa876 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:35.052366 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339637a6-1933-44f9-b126-370d6ff2606f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:35.053231 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339637a6-1933-44f9-b126-370d6ff2606f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:35.053511 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339637a6-1933-44f9-b126-370d6ff2606f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:35.053781 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339637a6-1933-44f9-b126-370d6ff2606f admin admin] PATH_INFO: `/v3/users/0cdbe890eef3446b912a7cdb2eb87745` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:35.054986 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339637a6-1933-44f9-b126-370d6ff2606f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cdbe890eef3446b912a7cdb2eb87745)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:35.056959 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339637a6-1933-44f9-b126-370d6ff2606f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:35.357032 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-339637a6-1933-44f9-b126-370d6ff2606f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cdbe890eef3446b912a7cdb2eb87745'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:35.451303 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-339637a6-1933-44f9-b126-370d6ff2606f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cdbe890eef3446b912a7cdb2eb87745'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:35.464236 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-339637a6-1933-44f9-b126-370d6ff2606f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cdbe890eef3446b912a7cdb2eb87745'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:35.464817 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-339637a6-1933-44f9-b126-370d6ff2606f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cdbe890eef3446b912a7cdb2eb87745'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:35.476968 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-339637a6-1933-44f9-b126-370d6ff2606f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cdbe890eef3446b912a7cdb2eb87745'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:35.482955 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1113/2223] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:16:34 2021] DELETE /identity/v3/users/0cdbe890eef3446b912a7cdb2eb87745 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:35.487488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0daff0-1f79-4faf-87dd-30982d18b478 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:35.488105 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0daff0-1f79-4faf-87dd-30982d18b478 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:35.488105 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0daff0-1f79-4faf-87dd-30982d18b478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:35.528019 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-2f0daff0-1f79-4faf-87dd-30982d18b478 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:35.529287 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-2f0daff0-1f79-4faf-87dd-30982d18b478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:35.598189 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1111/2224] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:35.608841 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339637a6-1933-44f9-b126-370d6ff2606f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:35.617676 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-339637a6-1933-44f9-b126-370d6ff2606f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:35.715536 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339637a6-1933-44f9-b126-370d6ff2606f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:35.719512 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae4ff2-991c-4d91-b18f-be37b911e9e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:35.720121 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae4ff2-991c-4d91-b18f-be37b911e9e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:35.720465 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae4ff2-991c-4d91-b18f-be37b911e9e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:35.720744 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae4ff2-991c-4d91-b18f-be37b911e9e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:35.730980 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae4ff2-991c-4d91-b18f-be37b911e9e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:35.732503 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae4ff2-991c-4d91-b18f-be37b911e9e2 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:35.741958 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1114/2225] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:16:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:16:36.320650 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0daff0-1f79-4faf-87dd-30982d18b478 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:36.324605 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-2f0daff0-1f79-4faf-87dd-30982d18b478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:36.338093 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0daff0-1f79-4faf-87dd-30982d18b478 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:36.342824 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02194199-d109-4420-9530-b0be476c43bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:36.343934 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02194199-d109-4420-9530-b0be476c43bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:36.344244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02194199-d109-4420-9530-b0be476c43bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:36.344544 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02194199-d109-4420-9530-b0be476c43bd admin admin] PATH_INFO: `/v3/projects/b2e387ca7bd04e5a871817dd68700ac6` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:36.345885 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02194199-d109-4420-9530-b0be476c43bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2e387ca7bd04e5a871817dd68700ac6)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:36.347898 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02194199-d109-4420-9530-b0be476c43bd admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:36.485102 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-02194199-d109-4420-9530-b0be476c43bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2e387ca7bd04e5a871817dd68700ac6', 'request_id': 'req-02194199-d109-4420-9530-b0be476c43bd'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:36.491168 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-02194199-d109-4420-9530-b0be476c43bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2e387ca7bd04e5a871817dd68700ac6', 'request_id': 'req-02194199-d109-4420-9530-b0be476c43bd'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:36.498098 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-02194199-d109-4420-9530-b0be476c43bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2e387ca7bd04e5a871817dd68700ac6', 'request_id': 'req-02194199-d109-4420-9530-b0be476c43bd'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:36.595958 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-02194199-d109-4420-9530-b0be476c43bd admin admin] The token cache is being invalidate because project b2e387ca7bd04e5a871817dd68700ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:16:36.596251 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-02194199-d109-4420-9530-b0be476c43bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:36.598469 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-02194199-d109-4420-9530-b0be476c43bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:36.598655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1112/2226] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:16:36 2021] DELETE /identity/v3/projects/b2e387ca7bd04e5a871817dd68700ac6 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:36.613773 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53378abe-27d7-4ace-98b3-d3b8fe0916a3 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:36.614263 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53378abe-27d7-4ace-98b3-d3b8fe0916a3 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:36.614906 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53378abe-27d7-4ace-98b3-d3b8fe0916a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:36.659620 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-53378abe-27d7-4ace-98b3-d3b8fe0916a3 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:36.660867 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-53378abe-27d7-4ace-98b3-d3b8fe0916a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:36.724083 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1115/2227] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:36.732746 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d30ecb-8276-4292-bd1d-294f3db904cf None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:36.733117 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d30ecb-8276-4292-bd1d-294f3db904cf None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:36.733403 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d30ecb-8276-4292-bd1d-294f3db904cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:36.752913 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-e2d30ecb-8276-4292-bd1d-294f3db904cf None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:36.754109 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e2d30ecb-8276-4292-bd1d-294f3db904cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:36.762509 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1113/2228] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:36.766769 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53378abe-27d7-4ace-98b3-d3b8fe0916a3 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:36.777907 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53378abe-27d7-4ace-98b3-d3b8fe0916a3 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:36.782743 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc44b4-80ec-4b96-ac15-5b1cafcfec08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:36.793175 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc44b4-80ec-4b96-ac15-5b1cafcfec08 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:36.793175 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc44b4-80ec-4b96-ac15-5b1cafcfec08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:36.793175 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc44b4-80ec-4b96-ac15-5b1cafcfec08 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:36.793175 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc44b4-80ec-4b96-ac15-5b1cafcfec08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:16:36.793175 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc44b4-80ec-4b96-ac15-5b1cafcfec08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:36.793175 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc44b4-80ec-4b96-ac15-5b1cafcfec08 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:36.800396 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1116/2229] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:16:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:16:36.804835 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d30ecb-8276-4292-bd1d-294f3db904cf None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:36.814957 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d30ecb-8276-4292-bd1d-294f3db904cf None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:36.820158 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56270ea0-4c69-4a4a-86d8-e30b26b0e13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:36.821969 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56270ea0-4c69-4a4a-86d8-e30b26b0e13f admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:36.821969 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56270ea0-4c69-4a4a-86d8-e30b26b0e13f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:36.821969 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56270ea0-4c69-4a4a-86d8-e30b26b0e13f admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:36.822668 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56270ea0-4c69-4a4a-86d8-e30b26b0e13f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:36.824537 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56270ea0-4c69-4a4a-86d8-e30b26b0e13f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:36.907493 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1114/2230] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:16:36 2021] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:16:36.911594 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc44b4-80ec-4b96-ac15-5b1cafcfec08 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:36.922021 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc44b4-80ec-4b96-ac15-5b1cafcfec08 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:36.981180 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec7e0b-9ced-4da1-80c3-8ebb3ba785e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:36.981848 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec7e0b-9ced-4da1-80c3-8ebb3ba785e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:36.982154 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec7e0b-9ced-4da1-80c3-8ebb3ba785e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:36.982493 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec7e0b-9ced-4da1-80c3-8ebb3ba785e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:36.983351 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec7e0b-9ced-4da1-80c3-8ebb3ba785e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:36.985116 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec7e0b-9ced-4da1-80c3-8ebb3ba785e3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:37.123274 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1117/2231] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:16:36 2021] POST /identity/v3/users => generated 283 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:16:37.137874 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56270ea0-4c69-4a4a-86d8-e30b26b0e13f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:37.148110 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56270ea0-4c69-4a4a-86d8-e30b26b0e13f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:37.152939 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfcd71-1280-4291-b4e6-116dafd69bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:37.153603 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfcd71-1280-4291-b4e6-116dafd69bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:37.153982 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfcd71-1280-4291-b4e6-116dafd69bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:37.154245 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfcd71-1280-4291-b4e6-116dafd69bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:37.155051 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfcd71-1280-4291-b4e6-116dafd69bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:37.156676 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfcd71-1280-4291-b4e6-116dafd69bb9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:37.168104 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1115/2232] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:16:37 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:16:37.172538 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec7e0b-9ced-4da1-80c3-8ebb3ba785e3 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:37.184680 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec7e0b-9ced-4da1-80c3-8ebb3ba785e3 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:37.190425 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a71a9d-fc27-43d6-a184-89620dbde073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:37.191217 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a71a9d-fc27-43d6-a184-89620dbde073 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:37.191643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a71a9d-fc27-43d6-a184-89620dbde073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:37.192023 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a71a9d-fc27-43d6-a184-89620dbde073 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:37.192879 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a71a9d-fc27-43d6-a184-89620dbde073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:37.194596 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a71a9d-fc27-43d6-a184-89620dbde073 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:37.216328 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1118/2233] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:16:37 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:16:37.217917 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfcd71-1280-4291-b4e6-116dafd69bb9 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:37.230396 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfcd71-1280-4291-b4e6-116dafd69bb9 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:37.236072 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb922cca-89bc-4421-9361-904f19a2708a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:37.237937 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb922cca-89bc-4421-9361-904f19a2708a admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:37.238321 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb922cca-89bc-4421-9361-904f19a2708a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:37.238692 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb922cca-89bc-4421-9361-904f19a2708a admin admin] PATH_INFO: `/v3/projects/1d4133ed319e467793a71af59c9cb798/users/9ade954e4f9c4904aeecc182d76f997d/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:37.258289 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb922cca-89bc-4421-9361-904f19a2708a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d4133ed319e467793a71af59c9cb798, user_id=9ade954e4f9c4904aeecc182d76f997d, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:37.262655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb922cca-89bc-4421-9361-904f19a2708a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:37.412280 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1116/2234] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:16:37 2021] PUT /identity/v3/projects/1d4133ed319e467793a71af59c9cb798/users/9ade954e4f9c4904aeecc182d76f997d/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:16:37.423449 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1c839-4851-41e4-be6b-18166a8bec62 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:37.423742 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1c839-4851-41e4-be6b-18166a8bec62 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:37.424019 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1c839-4851-41e4-be6b-18166a8bec62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:37.450202 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-21e1c839-4851-41e4-be6b-18166a8bec62 None None] MFA Rules not processed for user `9ade954e4f9c4904aeecc182d76f997d`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:37.451434 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-21e1c839-4851-41e4-be6b-18166a8bec62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:37.526329 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1119/2235] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:37 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:37.782114 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb922cca-89bc-4421-9361-904f19a2708a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:37.783934 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-eb922cca-89bc-4421-9361-904f19a2708a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:37.839537 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb922cca-89bc-4421-9361-904f19a2708a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:37.843518 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c706d6d-0a96-457d-8f32-0c510b471d35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:37.844152 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c706d6d-0a96-457d-8f32-0c510b471d35 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:37.844477 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c706d6d-0a96-457d-8f32-0c510b471d35 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:37.844751 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c706d6d-0a96-457d-8f32-0c510b471d35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:37.853500 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c706d6d-0a96-457d-8f32-0c510b471d35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:37.855160 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c706d6d-0a96-457d-8f32-0c510b471d35 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:37.863804 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1117/2236] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:16:37 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:16:39.369087 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1c839-4851-41e4-be6b-18166a8bec62 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:39.370812 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-21e1c839-4851-41e4-be6b-18166a8bec62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:39.505590 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1c839-4851-41e4-be6b-18166a8bec62 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:39.511787 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68caa7-fe89-499a-8c7d-2b5fb957e0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:39.512706 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68caa7-fe89-499a-8c7d-2b5fb957e0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:39.512934 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68caa7-fe89-499a-8c7d-2b5fb957e0df admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:39.513209 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68caa7-fe89-499a-8c7d-2b5fb957e0df admin admin] PATH_INFO: `/v3/users/a83bd9ea295748269984f94a40d2e6a5` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:39.514502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68caa7-fe89-499a-8c7d-2b5fb957e0df admin admin] RBAC: Authorizing `identity:delete_user(user_id=a83bd9ea295748269984f94a40d2e6a5)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:39.516480 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68caa7-fe89-499a-8c7d-2b5fb957e0df admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:39.754254 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-dc68caa7-fe89-499a-8c7d-2b5fb957e0df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a83bd9ea295748269984f94a40d2e6a5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:39.844930 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-dc68caa7-fe89-499a-8c7d-2b5fb957e0df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a83bd9ea295748269984f94a40d2e6a5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:39.869045 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-dc68caa7-fe89-499a-8c7d-2b5fb957e0df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a83bd9ea295748269984f94a40d2e6a5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:39.869045 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-dc68caa7-fe89-499a-8c7d-2b5fb957e0df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a83bd9ea295748269984f94a40d2e6a5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:39.877767 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-dc68caa7-fe89-499a-8c7d-2b5fb957e0df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a83bd9ea295748269984f94a40d2e6a5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:39.886769 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1120/2237] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:16:39 2021] DELETE /identity/v3/users/a83bd9ea295748269984f94a40d2e6a5 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:39.897863 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2377d64-45e0-453f-b840-92a97507714a None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:39.897863 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2377d64-45e0-453f-b840-92a97507714a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:39.897863 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2377d64-45e0-453f-b840-92a97507714a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:39.910750 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-e2377d64-45e0-453f-b840-92a97507714a None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:39.912004 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e2377d64-45e0-453f-b840-92a97507714a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:39.983921 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1118/2238] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:16:39.999557 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68caa7-fe89-499a-8c7d-2b5fb957e0df admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:40.001253 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-dc68caa7-fe89-499a-8c7d-2b5fb957e0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:40.065482 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68caa7-fe89-499a-8c7d-2b5fb957e0df admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:40.069148 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a481ae2-84bb-4f3f-9279-e298028b8a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:40.070088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a481ae2-84bb-4f3f-9279-e298028b8a6f service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:40.070355 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a481ae2-84bb-4f3f-9279-e298028b8a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:40.070695 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a481ae2-84bb-4f3f-9279-e298028b8a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:40.087724 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a481ae2-84bb-4f3f-9279-e298028b8a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:40.089175 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a481ae2-84bb-4f3f-9279-e298028b8a6f service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:40.102366 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1121/2239] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:16:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:16:40.646086 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2377d64-45e0-453f-b840-92a97507714a None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:40.647709 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e2377d64-45e0-453f-b840-92a97507714a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:40.660984 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2377d64-45e0-453f-b840-92a97507714a None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:40.676187 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4c7b5-cbe0-4a61-ae40-4b3241101654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:40.677040 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4c7b5-cbe0-4a61-ae40-4b3241101654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:40.677326 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4c7b5-cbe0-4a61-ae40-4b3241101654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:40.677600 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4c7b5-cbe0-4a61-ae40-4b3241101654 admin admin] PATH_INFO: `/v3/projects/23ddc3ae6cf440ba935aafad0b919b39` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:40.679235 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4c7b5-cbe0-4a61-ae40-4b3241101654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23ddc3ae6cf440ba935aafad0b919b39)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:40.681523 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4c7b5-cbe0-4a61-ae40-4b3241101654 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:40.817128 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-38c4c7b5-cbe0-4a61-ae40-4b3241101654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23ddc3ae6cf440ba935aafad0b919b39', 'request_id': 'req-38c4c7b5-cbe0-4a61-ae40-4b3241101654'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:40.823534 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-38c4c7b5-cbe0-4a61-ae40-4b3241101654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23ddc3ae6cf440ba935aafad0b919b39', 'request_id': 'req-38c4c7b5-cbe0-4a61-ae40-4b3241101654'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:40.828758 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-38c4c7b5-cbe0-4a61-ae40-4b3241101654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23ddc3ae6cf440ba935aafad0b919b39', 'request_id': 'req-38c4c7b5-cbe0-4a61-ae40-4b3241101654'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:40.907998 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-38c4c7b5-cbe0-4a61-ae40-4b3241101654 admin admin] The token cache is being invalidate because project 23ddc3ae6cf440ba935aafad0b919b39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:16:40.908479 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-38c4c7b5-cbe0-4a61-ae40-4b3241101654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:40.909002 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-38c4c7b5-cbe0-4a61-ae40-4b3241101654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:40.910987 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1119/2240] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:16:40 2021] DELETE /identity/v3/projects/23ddc3ae6cf440ba935aafad0b919b39 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:40.915259 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a481ae2-84bb-4f3f-9279-e298028b8a6f service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:40.925455 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a481ae2-84bb-4f3f-9279-e298028b8a6f service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:41.025844 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9741f8b-99ff-497a-a1d0-7acd6d7b317e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:41.026915 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9741f8b-99ff-497a-a1d0-7acd6d7b317e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:41.027325 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9741f8b-99ff-497a-a1d0-7acd6d7b317e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:41.027608 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9741f8b-99ff-497a-a1d0-7acd6d7b317e admin admin] PATH_INFO: `/v3/users/1cd582c99aa540658661e724c70469e6` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:41.028868 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9741f8b-99ff-497a-a1d0-7acd6d7b317e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd582c99aa540658661e724c70469e6)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:41.031170 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9741f8b-99ff-497a-a1d0-7acd6d7b317e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:41.282961 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c9741f8b-99ff-497a-a1d0-7acd6d7b317e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd582c99aa540658661e724c70469e6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:41.350548 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c9741f8b-99ff-497a-a1d0-7acd6d7b317e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd582c99aa540658661e724c70469e6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:41.358540 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c9741f8b-99ff-497a-a1d0-7acd6d7b317e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd582c99aa540658661e724c70469e6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:41.359230 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c9741f8b-99ff-497a-a1d0-7acd6d7b317e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd582c99aa540658661e724c70469e6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:41.371719 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c9741f8b-99ff-497a-a1d0-7acd6d7b317e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd582c99aa540658661e724c70469e6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:41.378266 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1122/2241] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:16:40 2021] DELETE /identity/v3/users/1cd582c99aa540658661e724c70469e6 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:41.803390 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4c7b5-cbe0-4a61-ae40-4b3241101654 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:41.804910 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-38c4c7b5-cbe0-4a61-ae40-4b3241101654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:41.818688 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4c7b5-cbe0-4a61-ae40-4b3241101654 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:41.894391 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12f0ee-ded4-4c9a-9bce-e833a9d6dfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:41.895280 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12f0ee-ded4-4c9a-9bce-e833a9d6dfd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:41.895567 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12f0ee-ded4-4c9a-9bce-e833a9d6dfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:41.895842 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12f0ee-ded4-4c9a-9bce-e833a9d6dfd7 admin admin] PATH_INFO: `/v3/projects/9a3f1b64d01744a3be60b5dc489b5137` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:41.897071 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12f0ee-ded4-4c9a-9bce-e833a9d6dfd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a3f1b64d01744a3be60b5dc489b5137)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:41.899132 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12f0ee-ded4-4c9a-9bce-e833a9d6dfd7 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:42.059570 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2e12f0ee-ded4-4c9a-9bce-e833a9d6dfd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a3f1b64d01744a3be60b5dc489b5137', 'request_id': 'req-2e12f0ee-ded4-4c9a-9bce-e833a9d6dfd7'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:42.066202 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2e12f0ee-ded4-4c9a-9bce-e833a9d6dfd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a3f1b64d01744a3be60b5dc489b5137', 'request_id': 'req-2e12f0ee-ded4-4c9a-9bce-e833a9d6dfd7'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:42.073533 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2e12f0ee-ded4-4c9a-9bce-e833a9d6dfd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a3f1b64d01744a3be60b5dc489b5137', 'request_id': 'req-2e12f0ee-ded4-4c9a-9bce-e833a9d6dfd7'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:42.144401 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2e12f0ee-ded4-4c9a-9bce-e833a9d6dfd7 admin admin] The token cache is being invalidate because project 9a3f1b64d01744a3be60b5dc489b5137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:16:42.144780 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2e12f0ee-ded4-4c9a-9bce-e833a9d6dfd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:42.145406 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2e12f0ee-ded4-4c9a-9bce-e833a9d6dfd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:42.146952 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1120/2242] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:16:41 2021] DELETE /identity/v3/projects/9a3f1b64d01744a3be60b5dc489b5137 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:16:42.152752 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cf140-5629-4543-a866-0d559178437f None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:42.153325 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cf140-5629-4543-a866-0d559178437f None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:42.153325 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cf140-5629-4543-a866-0d559178437f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:42.171690 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-c14cf140-5629-4543-a866-0d559178437f None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:42.172879 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c14cf140-5629-4543-a866-0d559178437f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:42.249480 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1123/2243] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:42.252045 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786c8c8-1b8e-4ab1-8915-79f371e8ba21 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:42.252397 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786c8c8-1b8e-4ab1-8915-79f371e8ba21 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:42.252784 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786c8c8-1b8e-4ab1-8915-79f371e8ba21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:42.272943 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-5786c8c8-1b8e-4ab1-8915-79f371e8ba21 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:42.274301 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-5786c8c8-1b8e-4ab1-8915-79f371e8ba21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:42.284778 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1121/2244] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:42.289080 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cf140-5629-4543-a866-0d559178437f None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:42.302749 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cf140-5629-4543-a866-0d559178437f None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:42.308446 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9ccc4-82b0-4501-abd2-03a70e4c9f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:42.309152 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9ccc4-82b0-4501-abd2-03a70e4c9f93 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:42.309438 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9ccc4-82b0-4501-abd2-03a70e4c9f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:42.309713 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9ccc4-82b0-4501-abd2-03a70e4c9f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:42.310456 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9ccc4-82b0-4501-abd2-03a70e4c9f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:16:42.310760 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9ccc4-82b0-4501-abd2-03a70e4c9f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:42.312377 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9ccc4-82b0-4501-abd2-03a70e4c9f93 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:42.329363 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1124/2245] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:16:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:16:42.333545 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786c8c8-1b8e-4ab1-8915-79f371e8ba21 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:42.345873 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786c8c8-1b8e-4ab1-8915-79f371e8ba21 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:42.350713 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dea9f-bf6b-4aa3-9361-7f43a0d07bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:42.351409 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dea9f-bf6b-4aa3-9361-7f43a0d07bda admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:42.351696 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dea9f-bf6b-4aa3-9361-7f43a0d07bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:42.351972 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dea9f-bf6b-4aa3-9361-7f43a0d07bda admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:42.352101 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae521c9-8eca-44c9-a1b5-17c48d60b2e8 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:42.353263 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae521c9-8eca-44c9-a1b5-17c48d60b2e8 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:42.353792 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0dea9f-bf6b-4aa3-9361-7f43a0d07bda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:42.354127 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae521c9-8eca-44c9-a1b5-17c48d60b2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:42.355625 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0dea9f-bf6b-4aa3-9361-7f43a0d07bda admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:42.378511 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-bae521c9-8eca-44c9-a1b5-17c48d60b2e8 None None] MFA Rules not processed for user `b68d0745d9cb49a5bd9331148967764a`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:42.379747 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-bae521c9-8eca-44c9-a1b5-17c48d60b2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:42.440481 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1125/2246] 10.222.0.54 () {58 vars in 1009 bytes} [Tue Nov 23 04:16:42 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:42.456528 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1122/2247] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:16:42 2021] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:16:42.460670 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae521c9-8eca-44c9-a1b5-17c48d60b2e8 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:42.473948 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae521c9-8eca-44c9-a1b5-17c48d60b2e8 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:42.507026 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dea9f-bf6b-4aa3-9361-7f43a0d07bda admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:42.510815 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-1f0dea9f-bf6b-4aa3-9361-7f43a0d07bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:42.546087 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a6d50-acb6-47b6-8a73-8f0f541b9744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:42.547128 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a6d50-acb6-47b6-8a73-8f0f541b9744 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:42.547610 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a6d50-acb6-47b6-8a73-8f0f541b9744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:42.548028 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a6d50-acb6-47b6-8a73-8f0f541b9744 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:42.548887 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a6d50-acb6-47b6-8a73-8f0f541b9744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:42.551096 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a6d50-acb6-47b6-8a73-8f0f541b9744 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:42.592094 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dea9f-bf6b-4aa3-9361-7f43a0d07bda admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:42.597406 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c76573-58d9-4532-ad01-44ed6a4882be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd439c1f0764f4cac7eb641a485937a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:42.598089 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c76573-58d9-4532-ad01-44ed6a4882be service swift] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:42.598379 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c76573-58d9-4532-ad01-44ed6a4882be service swift] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:42.598661 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c76573-58d9-4532-ad01-44ed6a4882be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:42.656518 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c76573-58d9-4532-ad01-44ed6a4882be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:42.658272 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c76573-58d9-4532-ad01-44ed6a4882be service swift] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:42.669194 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1123/2248] 10.222.0.54 () {60 vars in 1384 bytes} [Tue Nov 23 04:16:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 23 04:16:42.680307 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1126/2249] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:16:42 2021] POST /identity/v3/users => generated 291 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:16:42.684957 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c76573-58d9-4532-ad01-44ed6a4882be service swift] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:42.700352 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c76573-58d9-4532-ad01-44ed6a4882be service swift] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:42.707644 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31391e-e464-42e8-bc74-8995f0edf775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:42.708708 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31391e-e464-42e8-bc74-8995f0edf775 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:42.709057 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31391e-e464-42e8-bc74-8995f0edf775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:42.709411 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31391e-e464-42e8-bc74-8995f0edf775 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:42.710264 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31391e-e464-42e8-bc74-8995f0edf775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:42.711974 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31391e-e464-42e8-bc74-8995f0edf775 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:42.724053 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1124/2250] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:16:42 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:16:42.734117 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a6d50-acb6-47b6-8a73-8f0f541b9744 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:42.744370 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a6d50-acb6-47b6-8a73-8f0f541b9744 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:42.749296 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe55022-66cc-4493-8fbc-68a7f107f0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:42.750022 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe55022-66cc-4493-8fbc-68a7f107f0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:42.750310 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe55022-66cc-4493-8fbc-68a7f107f0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:42.750708 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe55022-66cc-4493-8fbc-68a7f107f0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:42.751486 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe55022-66cc-4493-8fbc-68a7f107f0f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:42.753061 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe55022-66cc-4493-8fbc-68a7f107f0f1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:42.764016 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1127/2251] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:16:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:16:42.768207 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31391e-e464-42e8-bc74-8995f0edf775 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:42.778304 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31391e-e464-42e8-bc74-8995f0edf775 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:42.782992 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d497d7-853c-456b-8952-d251fc472f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:42.783898 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d497d7-853c-456b-8952-d251fc472f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:42.784176 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d497d7-853c-456b-8952-d251fc472f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:42.784445 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d497d7-853c-456b-8952-d251fc472f31 admin admin] PATH_INFO: `/v3/projects/78a8389c60554bf89e6775e1fb602cfc/users/d9547752f7654d9e858349698f35e652/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:42.799848 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d497d7-853c-456b-8952-d251fc472f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a8389c60554bf89e6775e1fb602cfc, user_id=d9547752f7654d9e858349698f35e652, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:42.802520 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d497d7-853c-456b-8952-d251fc472f31 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:42.917830 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1125/2252] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:16:42 2021] PUT /identity/v3/projects/78a8389c60554bf89e6775e1fb602cfc/users/d9547752f7654d9e858349698f35e652/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:42.928131 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512d6c4-eb07-4b02-8cd8-da9bc0021415 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:42.928422 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512d6c4-eb07-4b02-8cd8-da9bc0021415 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:42.928702 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512d6c4-eb07-4b02-8cd8-da9bc0021415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:42.955532 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-3512d6c4-eb07-4b02-8cd8-da9bc0021415 None None] MFA Rules not processed for user `d9547752f7654d9e858349698f35e652`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:42.956815 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-3512d6c4-eb07-4b02-8cd8-da9bc0021415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:43.052500 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1128/2253] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:42 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:43.057076 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d497d7-853c-456b-8952-d251fc472f31 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:43.122598 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d497d7-853c-456b-8952-d251fc472f31 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:43.127775 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537b4e9-b1cc-48de-8dc0-9259902bc313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:43.128489 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537b4e9-b1cc-48de-8dc0-9259902bc313 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:43.128774 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537b4e9-b1cc-48de-8dc0-9259902bc313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:43.129047 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537b4e9-b1cc-48de-8dc0-9259902bc313 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:43.129792 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537b4e9-b1cc-48de-8dc0-9259902bc313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:43.131732 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537b4e9-b1cc-48de-8dc0-9259902bc313 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:43.269285 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1126/2254] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:16:43 2021] POST /identity/v3/projects => generated 379 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:16:43.273796 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512d6c4-eb07-4b02-8cd8-da9bc0021415 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:43.286675 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512d6c4-eb07-4b02-8cd8-da9bc0021415 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:43.356226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fa9ad-68b8-4814-a562-d191c8b84f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:43.356990 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fa9ad-68b8-4814-a562-d191c8b84f24 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:43.357343 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fa9ad-68b8-4814-a562-d191c8b84f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:43.357684 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fa9ad-68b8-4814-a562-d191c8b84f24 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:43.358462 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fa9ad-68b8-4814-a562-d191c8b84f24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:43.360452 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fa9ad-68b8-4814-a562-d191c8b84f24 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:43.466541 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1129/2255] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:16:43 2021] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:16:43.468322 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537b4e9-b1cc-48de-8dc0-9259902bc313 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:43.479766 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537b4e9-b1cc-48de-8dc0-9259902bc313 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:43.485198 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce42a9-8b98-41df-8098-00fcb9026a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:43.485902 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce42a9-8b98-41df-8098-00fcb9026a3f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:43.486187 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce42a9-8b98-41df-8098-00fcb9026a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:43.486460 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce42a9-8b98-41df-8098-00fcb9026a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:43.487226 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce42a9-8b98-41df-8098-00fcb9026a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:43.488957 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce42a9-8b98-41df-8098-00fcb9026a3f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:43.500154 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1127/2256] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:16:43 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:16:43.504774 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fa9ad-68b8-4814-a562-d191c8b84f24 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:43.517589 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fa9ad-68b8-4814-a562-d191c8b84f24 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:43.522120 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599ce89-a1f4-400e-b057-2d8da97f0a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:43.531989 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599ce89-a1f4-400e-b057-2d8da97f0a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:43.531989 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599ce89-a1f4-400e-b057-2d8da97f0a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:43.531989 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599ce89-a1f4-400e-b057-2d8da97f0a19 admin admin] PATH_INFO: `/v3/projects/efc66076fbe043cc89ced25ce0d43bc3/users/608cf9a5f91c45398e000e29247ecc0a/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:43.541400 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599ce89-a1f4-400e-b057-2d8da97f0a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc66076fbe043cc89ced25ce0d43bc3, user_id=608cf9a5f91c45398e000e29247ecc0a, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:43.544165 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599ce89-a1f4-400e-b057-2d8da97f0a19 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:43.640399 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1130/2257] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:16:43 2021] PUT /identity/v3/projects/efc66076fbe043cc89ced25ce0d43bc3/users/608cf9a5f91c45398e000e29247ecc0a/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:43.645154 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf218aa-5f3f-438b-941a-65ff72a15c3b None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:43.645494 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf218aa-5f3f-438b-941a-65ff72a15c3b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:43.645770 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf218aa-5f3f-438b-941a-65ff72a15c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:43.648560 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599ce89-a1f4-400e-b057-2d8da97f0a19 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:43.665199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-2cf218aa-5f3f-438b-941a-65ff72a15c3b None None] MFA Rules not processed for user `b68d0745d9cb49a5bd9331148967764a`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:43.666756 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-2cf218aa-5f3f-438b-941a-65ff72a15c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:43.713197 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599ce89-a1f4-400e-b057-2d8da97f0a19 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:43.718146 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2bb70-41da-473b-a608-91eb86847dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:43.718799 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2bb70-41da-473b-a608-91eb86847dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:43.719079 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2bb70-41da-473b-a608-91eb86847dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:43.719383 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2bb70-41da-473b-a608-91eb86847dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:43.720124 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2bb70-41da-473b-a608-91eb86847dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:43.721693 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2bb70-41da-473b-a608-91eb86847dc1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:43.726556 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1128/2258] 10.222.0.54 () {58 vars in 967 bytes} [Tue Nov 23 04:16:43 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:16:43.732222 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1131/2259] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:16:43 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:16:43.737167 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf218aa-5f3f-438b-941a-65ff72a15c3b None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:43.744993 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2bb70-41da-473b-a608-91eb86847dc1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:43.749971 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf218aa-5f3f-438b-941a-65ff72a15c3b None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:43.756150 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0db04-2bb3-4a5c-9465-023a81eaa2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:43.757685 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0db04-2bb3-4a5c-9465-023a81eaa2a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:43.757979 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0db04-2bb3-4a5c-9465-023a81eaa2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:43.758261 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0db04-2bb3-4a5c-9465-023a81eaa2a8 admin admin] PATH_INFO: `/v3/projects/efc66076fbe043cc89ced25ce0d43bc3/users/608cf9a5f91c45398e000e29247ecc0a/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:43.760870 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0db04-2bb3-4a5c-9465-023a81eaa2a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc66076fbe043cc89ced25ce0d43bc3, user_id=608cf9a5f91c45398e000e29247ecc0a, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:43.763753 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0db04-2bb3-4a5c-9465-023a81eaa2a8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:43.775045 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1129/2260] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:16:43 2021] PUT /identity/v3/projects/efc66076fbe043cc89ced25ce0d43bc3/users/608cf9a5f91c45398e000e29247ecc0a/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:16:43.785157 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca261f-65f7-4b67-b6b2-38bdb55e722a None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:43.785451 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca261f-65f7-4b67-b6b2-38bdb55e722a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:43.785734 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca261f-65f7-4b67-b6b2-38bdb55e722a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:43.812416 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-f8ca261f-65f7-4b67-b6b2-38bdb55e722a None None] MFA Rules not processed for user `608cf9a5f91c45398e000e29247ecc0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:43.813675 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-f8ca261f-65f7-4b67-b6b2-38bdb55e722a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:43.816991 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2bb70-41da-473b-a608-91eb86847dc1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:43.876918 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4815a-7728-4037-9f11-cce6b91997e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd439c1f0764f4cac7eb641a485937a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:43.877564 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4815a-7728-4037-9f11-cce6b91997e4 service swift] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:43.877852 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4815a-7728-4037-9f11-cce6b91997e4 service swift] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:43.878225 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4815a-7728-4037-9f11-cce6b91997e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:43.887346 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1130/2261] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:43 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:16:43.899400 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca261f-65f7-4b67-b6b2-38bdb55e722a None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:43.900986 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-f8ca261f-65f7-4b67-b6b2-38bdb55e722a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:43.936858 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4815a-7728-4037-9f11-cce6b91997e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:43.938427 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4815a-7728-4037-9f11-cce6b91997e4 service swift] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:43.948628 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1132/2262] 10.222.0.54 () {60 vars in 1384 bytes} [Tue Nov 23 04:16:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 04:16:43.956965 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca261f-65f7-4b67-b6b2-38bdb55e722a None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:43.960808 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab009c0-0240-4b57-8d29-898ec2f39228 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:43.961447 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab009c0-0240-4b57-8d29-898ec2f39228 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:43.961869 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab009c0-0240-4b57-8d29-898ec2f39228 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:43.962193 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab009c0-0240-4b57-8d29-898ec2f39228 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:43.971581 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab009c0-0240-4b57-8d29-898ec2f39228 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:43.973174 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab009c0-0240-4b57-8d29-898ec2f39228 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:43.984769 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1131/2263] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:16:43 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:16:44.707590 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4815a-7728-4037-9f11-cce6b91997e4 service swift] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:44.800389 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4815a-7728-4037-9f11-cce6b91997e4 service swift] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:44.800389 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987fcad-a433-4beb-b04b-05bc19011256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:44.800389 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987fcad-a433-4beb-b04b-05bc19011256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:44.800389 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987fcad-a433-4beb-b04b-05bc19011256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:44.801043 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987fcad-a433-4beb-b04b-05bc19011256 admin admin] PATH_INFO: `/v3/users/d9547752f7654d9e858349698f35e652` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:44.801043 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987fcad-a433-4beb-b04b-05bc19011256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9547752f7654d9e858349698f35e652)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:44.801043 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987fcad-a433-4beb-b04b-05bc19011256 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:45.034267 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3bc51-0607-4e12-a10a-09d3486f0053 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:45.034799 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3bc51-0607-4e12-a10a-09d3486f0053 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:45.034887 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3bc51-0607-4e12-a10a-09d3486f0053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:45.052447 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-0df3bc51-0607-4e12-a10a-09d3486f0053 None None] MFA Rules not processed for user `b68d0745d9cb49a5bd9331148967764a`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:45.053642 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-0df3bc51-0607-4e12-a10a-09d3486f0053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:45.061250 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1132/2264] 10.222.0.54 () {58 vars in 1009 bytes} [Tue Nov 23 04:16:45 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:16:45.076605 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3bc51-0607-4e12-a10a-09d3486f0053 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:45.090447 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3bc51-0607-4e12-a10a-09d3486f0053 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:45.095793 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffc56f-766f-4495-8fba-ac18190f02af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd439c1f0764f4cac7eb641a485937a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:45.096440 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffc56f-766f-4495-8fba-ac18190f02af service swift] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:45.096722 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffc56f-766f-4495-8fba-ac18190f02af service swift] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:45.097069 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffc56f-766f-4495-8fba-ac18190f02af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:45.106714 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffc56f-766f-4495-8fba-ac18190f02af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:45.108299 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffc56f-766f-4495-8fba-ac18190f02af service swift] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:45.116263 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1133/2265] 10.222.0.54 () {60 vars in 1384 bytes} [Tue Nov 23 04:16:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 04:16:45.136114 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-4987fcad-a433-4beb-b04b-05bc19011256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9547752f7654d9e858349698f35e652'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:45.247876 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-4987fcad-a433-4beb-b04b-05bc19011256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9547752f7654d9e858349698f35e652'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:45.255432 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-4987fcad-a433-4beb-b04b-05bc19011256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9547752f7654d9e858349698f35e652'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:45.256121 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-4987fcad-a433-4beb-b04b-05bc19011256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9547752f7654d9e858349698f35e652'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:45.268885 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-4987fcad-a433-4beb-b04b-05bc19011256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9547752f7654d9e858349698f35e652'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:45.284801 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1133/2266] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:16:44 2021] DELETE /identity/v3/users/d9547752f7654d9e858349698f35e652 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:45.289665 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3addbd9-18a8-4265-a6ba-c1945f71775e None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:45.290048 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3addbd9-18a8-4265-a6ba-c1945f71775e None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:45.290340 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3addbd9-18a8-4265-a6ba-c1945f71775e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:45.310003 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-a3addbd9-18a8-4265-a6ba-c1945f71775e None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:45.311237 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-a3addbd9-18a8-4265-a6ba-c1945f71775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:45.378818 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1134/2267] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:45.389703 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987fcad-a433-4beb-b04b-05bc19011256 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:45.391478 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-4987fcad-a433-4beb-b04b-05bc19011256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:45.503519 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987fcad-a433-4beb-b04b-05bc19011256 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:45.507318 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a3b17-a121-4049-babb-dd489ed17ec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:45.508023 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a3b17-a121-4049-babb-dd489ed17ec6 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:45.508313 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a3b17-a121-4049-babb-dd489ed17ec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:45.508644 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a3b17-a121-4049-babb-dd489ed17ec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:45.518292 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a3b17-a121-4049-babb-dd489ed17ec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:45.519782 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a3b17-a121-4049-babb-dd489ed17ec6 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:45.546811 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1134/2268] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:16:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:16:45.916483 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79512cf9-ec55-40b4-8449-24c9254c461d None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:45.916967 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79512cf9-ec55-40b4-8449-24c9254c461d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:45.917309 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79512cf9-ec55-40b4-8449-24c9254c461d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:45.937345 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-79512cf9-ec55-40b4-8449-24c9254c461d None None] MFA Rules not processed for user `b68d0745d9cb49a5bd9331148967764a`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:45.938658 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-79512cf9-ec55-40b4-8449-24c9254c461d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:46.014071 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1135/2269] 10.222.0.54 () {58 vars in 967 bytes} [Tue Nov 23 04:16:45 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:46.030744 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a3b17-a121-4049-babb-dd489ed17ec6 service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:46.032362 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-b05a3b17-a121-4049-babb-dd489ed17ec6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:46.110153 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a3b17-a121-4049-babb-dd489ed17ec6 service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:46.123025 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8c204-947b-499f-9594-028d0405449c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd439c1f0764f4cac7eb641a485937a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:46.123025 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8c204-947b-499f-9594-028d0405449c service swift] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:46.123025 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8c204-947b-499f-9594-028d0405449c service swift] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:46.123025 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8c204-947b-499f-9594-028d0405449c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:46.128923 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8c204-947b-499f-9594-028d0405449c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:46.131798 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8c204-947b-499f-9594-028d0405449c service swift] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:46.146402 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1135/2270] 10.222.0.54 () {60 vars in 1384 bytes} [Tue Nov 23 04:16:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 04:16:46.273075 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79512cf9-ec55-40b4-8449-24c9254c461d None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:46.274893 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-79512cf9-ec55-40b4-8449-24c9254c461d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:46.303893 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79512cf9-ec55-40b4-8449-24c9254c461d None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:46.319727 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce5c57-b882-4d39-932f-12388118ea73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:46.320626 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce5c57-b882-4d39-932f-12388118ea73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:46.329222 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce5c57-b882-4d39-932f-12388118ea73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:46.329222 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce5c57-b882-4d39-932f-12388118ea73 admin admin] PATH_INFO: `/v3/projects/78a8389c60554bf89e6775e1fb602cfc` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:46.329222 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce5c57-b882-4d39-932f-12388118ea73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78a8389c60554bf89e6775e1fb602cfc)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:46.329222 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce5c57-b882-4d39-932f-12388118ea73 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:46.479117 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-3dce5c57-b882-4d39-932f-12388118ea73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78a8389c60554bf89e6775e1fb602cfc', 'request_id': 'req-3dce5c57-b882-4d39-932f-12388118ea73'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:46.486645 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-3dce5c57-b882-4d39-932f-12388118ea73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78a8389c60554bf89e6775e1fb602cfc', 'request_id': 'req-3dce5c57-b882-4d39-932f-12388118ea73'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:46.492572 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-3dce5c57-b882-4d39-932f-12388118ea73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78a8389c60554bf89e6775e1fb602cfc', 'request_id': 'req-3dce5c57-b882-4d39-932f-12388118ea73'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:46.743298 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-3dce5c57-b882-4d39-932f-12388118ea73 admin admin] The token cache is being invalidate because project 78a8389c60554bf89e6775e1fb602cfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:16:46.769507 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-3dce5c57-b882-4d39-932f-12388118ea73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:46.769507 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-3dce5c57-b882-4d39-932f-12388118ea73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:46.769507 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1136/2271] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:16:46 2021] DELETE /identity/v3/projects/78a8389c60554bf89e6775e1fb602cfc => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:46.770086 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8c204-947b-499f-9594-028d0405449c service swift] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:46.770086 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8c204-947b-499f-9594-028d0405449c service swift] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:46.821728 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821dc26-a0c4-4923-b8ef-8a596ace3182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:46.822716 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821dc26-a0c4-4923-b8ef-8a596ace3182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:46.822999 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821dc26-a0c4-4923-b8ef-8a596ace3182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:46.823307 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821dc26-a0c4-4923-b8ef-8a596ace3182 admin admin] PATH_INFO: `/v3/users/608cf9a5f91c45398e000e29247ecc0a` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:46.824683 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821dc26-a0c4-4923-b8ef-8a596ace3182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=608cf9a5f91c45398e000e29247ecc0a)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:46.826994 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821dc26-a0c4-4923-b8ef-8a596ace3182 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:47.097170 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-e821dc26-a0c4-4923-b8ef-8a596ace3182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '608cf9a5f91c45398e000e29247ecc0a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:47.221359 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-e821dc26-a0c4-4923-b8ef-8a596ace3182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '608cf9a5f91c45398e000e29247ecc0a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:47.232042 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-e821dc26-a0c4-4923-b8ef-8a596ace3182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '608cf9a5f91c45398e000e29247ecc0a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:47.232886 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-e821dc26-a0c4-4923-b8ef-8a596ace3182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '608cf9a5f91c45398e000e29247ecc0a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:47.250118 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-e821dc26-a0c4-4923-b8ef-8a596ace3182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '608cf9a5f91c45398e000e29247ecc0a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:47.257606 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1136/2272] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:16:46 2021] DELETE /identity/v3/users/608cf9a5f91c45398e000e29247ecc0a => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:16:47.797942 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce5c57-b882-4d39-932f-12388118ea73 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:47.800438 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-3dce5c57-b882-4d39-932f-12388118ea73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:47.819678 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce5c57-b882-4d39-932f-12388118ea73 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:47.881586 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b611f90-eae3-476e-ae54-86a7e99c1fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:47.882637 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b611f90-eae3-476e-ae54-86a7e99c1fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:47.882755 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b611f90-eae3-476e-ae54-86a7e99c1fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:47.883044 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b611f90-eae3-476e-ae54-86a7e99c1fe6 admin admin] PATH_INFO: `/v3/projects/efc66076fbe043cc89ced25ce0d43bc3` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:47.884441 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b611f90-eae3-476e-ae54-86a7e99c1fe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efc66076fbe043cc89ced25ce0d43bc3)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:47.886323 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b611f90-eae3-476e-ae54-86a7e99c1fe6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:48.028817 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-8b611f90-eae3-476e-ae54-86a7e99c1fe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc66076fbe043cc89ced25ce0d43bc3', 'request_id': 'req-8b611f90-eae3-476e-ae54-86a7e99c1fe6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:48.035430 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-8b611f90-eae3-476e-ae54-86a7e99c1fe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc66076fbe043cc89ced25ce0d43bc3', 'request_id': 'req-8b611f90-eae3-476e-ae54-86a7e99c1fe6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:48.046322 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-8b611f90-eae3-476e-ae54-86a7e99c1fe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc66076fbe043cc89ced25ce0d43bc3', 'request_id': 'req-8b611f90-eae3-476e-ae54-86a7e99c1fe6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:48.120589 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-8b611f90-eae3-476e-ae54-86a7e99c1fe6 admin admin] The token cache is being invalidate because project efc66076fbe043cc89ced25ce0d43bc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:16:48.121140 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-8b611f90-eae3-476e-ae54-86a7e99c1fe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:48.121968 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-8b611f90-eae3-476e-ae54-86a7e99c1fe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:48.131613 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1137/2273] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:16:47 2021] DELETE /identity/v3/projects/efc66076fbe043cc89ced25ce0d43bc3 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:48.131832 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283b97b-97b7-4e72-89a8-aecbbf301474 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:48.131832 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283b97b-97b7-4e72-89a8-aecbbf301474 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:48.131832 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283b97b-97b7-4e72-89a8-aecbbf301474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:48.168585 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-e283b97b-97b7-4e72-89a8-aecbbf301474 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:48.170979 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-e283b97b-97b7-4e72-89a8-aecbbf301474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:48.262918 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1137/2274] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:16:48.275900 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd423cd-b7d0-4112-85df-5df648867533 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:48.276224 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd423cd-b7d0-4112-85df-5df648867533 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:48.277044 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd423cd-b7d0-4112-85df-5df648867533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:48.297703 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-efd423cd-b7d0-4112-85df-5df648867533 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:48.299198 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-efd423cd-b7d0-4112-85df-5df648867533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:48.314792 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1138/2275] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:48.319545 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283b97b-97b7-4e72-89a8-aecbbf301474 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:48.343125 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283b97b-97b7-4e72-89a8-aecbbf301474 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:48.343125 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90258f-2baa-4927-bd7a-a3366b0eb5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:48.343125 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90258f-2baa-4927-bd7a-a3366b0eb5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:48.343125 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90258f-2baa-4927-bd7a-a3366b0eb5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:48.343962 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90258f-2baa-4927-bd7a-a3366b0eb5c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:48.344564 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90258f-2baa-4927-bd7a-a3366b0eb5c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:16:48.345095 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90258f-2baa-4927-bd7a-a3366b0eb5c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:48.346737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90258f-2baa-4927-bd7a-a3366b0eb5c7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:48.360434 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1138/2276] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:16:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 04:16:48.364690 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd423cd-b7d0-4112-85df-5df648867533 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:48.375164 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd423cd-b7d0-4112-85df-5df648867533 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:48.380235 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94b5e1-9885-42bc-9dff-b448c23328d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:48.380886 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94b5e1-9885-42bc-9dff-b448c23328d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:48.381341 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94b5e1-9885-42bc-9dff-b448c23328d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:48.381612 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94b5e1-9885-42bc-9dff-b448c23328d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:48.382475 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94b5e1-9885-42bc-9dff-b448c23328d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:48.384857 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94b5e1-9885-42bc-9dff-b448c23328d0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:48.518634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1139/2277] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:16:48 2021] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:16:48.519906 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90258f-2baa-4927-bd7a-a3366b0eb5c7 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:48.530238 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90258f-2baa-4927-bd7a-a3366b0eb5c7 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:48.592607 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890c7d5-674a-4122-b37d-f8b87f8bc14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:48.593416 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890c7d5-674a-4122-b37d-f8b87f8bc14b admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:48.593787 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890c7d5-674a-4122-b37d-f8b87f8bc14b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:48.594209 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890c7d5-674a-4122-b37d-f8b87f8bc14b admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:48.595050 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890c7d5-674a-4122-b37d-f8b87f8bc14b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:48.597618 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890c7d5-674a-4122-b37d-f8b87f8bc14b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:48.694111 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1139/2278] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:16:48 2021] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:16:48.699444 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94b5e1-9885-42bc-9dff-b448c23328d0 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:48.709734 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94b5e1-9885-42bc-9dff-b448c23328d0 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:48.715262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dca8e0-d503-4283-8936-e31a3ad08043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:48.715915 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dca8e0-d503-4283-8936-e31a3ad08043 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:48.716191 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dca8e0-d503-4283-8936-e31a3ad08043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:48.716463 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dca8e0-d503-4283-8936-e31a3ad08043 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:48.717195 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dca8e0-d503-4283-8936-e31a3ad08043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:48.718749 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dca8e0-d503-4283-8936-e31a3ad08043 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:48.734155 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1140/2279] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:16:48 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:16:48.743260 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890c7d5-674a-4122-b37d-f8b87f8bc14b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:48.751101 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890c7d5-674a-4122-b37d-f8b87f8bc14b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:48.756952 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a02a4-4158-4fd6-980d-47f97ac57670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:48.757909 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a02a4-4158-4fd6-980d-47f97ac57670 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:48.758974 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a02a4-4158-4fd6-980d-47f97ac57670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:48.759140 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a02a4-4158-4fd6-980d-47f97ac57670 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:48.759987 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a02a4-4158-4fd6-980d-47f97ac57670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:48.761628 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a02a4-4158-4fd6-980d-47f97ac57670 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:48.775790 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1140/2280] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:16:48 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:16:48.777044 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dca8e0-d503-4283-8936-e31a3ad08043 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:48.793263 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dca8e0-d503-4283-8936-e31a3ad08043 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:48.798112 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee97f9-4ad1-48e1-b51d-40e0c7304748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:48.802971 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee97f9-4ad1-48e1-b51d-40e0c7304748 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:48.803472 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee97f9-4ad1-48e1-b51d-40e0c7304748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:48.803753 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee97f9-4ad1-48e1-b51d-40e0c7304748 admin admin] PATH_INFO: `/v3/projects/2b7a785e17ce44968886dc4b8a65284c/users/e878f3a0ce0e41918a85612575714f79/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:48.824342 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee97f9-4ad1-48e1-b51d-40e0c7304748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b7a785e17ce44968886dc4b8a65284c, user_id=e878f3a0ce0e41918a85612575714f79, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:48.824342 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee97f9-4ad1-48e1-b51d-40e0c7304748 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:49.003584 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1141/2281] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:16:48 2021] PUT /identity/v3/projects/2b7a785e17ce44968886dc4b8a65284c/users/e878f3a0ce0e41918a85612575714f79/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:49.006531 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b94e4-de24-4e3b-a980-4f1d66c54072 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:49.006848 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b94e4-de24-4e3b-a980-4f1d66c54072 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:49.007131 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b94e4-de24-4e3b-a980-4f1d66c54072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:49.035992 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-178b94e4-de24-4e3b-a980-4f1d66c54072 None None] MFA Rules not processed for user `e878f3a0ce0e41918a85612575714f79`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:49.037204 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-178b94e4-de24-4e3b-a980-4f1d66c54072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:49.105463 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1141/2282] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:49 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:49.110162 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee97f9-4ad1-48e1-b51d-40e0c7304748 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:49.172477 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee97f9-4ad1-48e1-b51d-40e0c7304748 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:49.177200 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826e5be-17b8-45d7-b06b-403798aab786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:49.177845 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826e5be-17b8-45d7-b06b-403798aab786 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:49.178126 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826e5be-17b8-45d7-b06b-403798aab786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:49.178397 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826e5be-17b8-45d7-b06b-403798aab786 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:49.179103 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826e5be-17b8-45d7-b06b-403798aab786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:49.181178 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826e5be-17b8-45d7-b06b-403798aab786 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:49.319271 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1142/2283] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:16:49 2021] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:16:49.324242 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b94e4-de24-4e3b-a980-4f1d66c54072 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:49.334950 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b94e4-de24-4e3b-a980-4f1d66c54072 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:49.395777 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921eb88-a1c7-47c0-a8f5-155aefbaaf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:49.396452 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921eb88-a1c7-47c0-a8f5-155aefbaaf76 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:49.396734 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921eb88-a1c7-47c0-a8f5-155aefbaaf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:49.397008 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921eb88-a1c7-47c0-a8f5-155aefbaaf76 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:49.397747 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921eb88-a1c7-47c0-a8f5-155aefbaaf76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:49.400426 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921eb88-a1c7-47c0-a8f5-155aefbaaf76 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:49.640034 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1142/2284] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:16:49 2021] POST /identity/v3/users => generated 293 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:16:49.641317 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826e5be-17b8-45d7-b06b-403798aab786 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:49.651523 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826e5be-17b8-45d7-b06b-403798aab786 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:49.657339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de862c2-3e99-4780-b936-b4f8fe3b95fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:49.657339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de862c2-3e99-4780-b936-b4f8fe3b95fc admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:49.657339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de862c2-3e99-4780-b936-b4f8fe3b95fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:49.657772 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de862c2-3e99-4780-b936-b4f8fe3b95fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:49.658212 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de862c2-3e99-4780-b936-b4f8fe3b95fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:49.659810 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de862c2-3e99-4780-b936-b4f8fe3b95fc admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:49.673972 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1143/2285] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:16:49 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:16:49.675672 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921eb88-a1c7-47c0-a8f5-155aefbaaf76 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:49.687731 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921eb88-a1c7-47c0-a8f5-155aefbaaf76 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:49.692341 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b614137-7905-41b9-8326-32dc4419d26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:49.692996 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b614137-7905-41b9-8326-32dc4419d26f admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:49.693335 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b614137-7905-41b9-8326-32dc4419d26f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:49.693643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b614137-7905-41b9-8326-32dc4419d26f admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:49.694394 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b614137-7905-41b9-8326-32dc4419d26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:49.696851 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b614137-7905-41b9-8326-32dc4419d26f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:49.707080 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1143/2286] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:16:49 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:16:49.711513 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de862c2-3e99-4780-b936-b4f8fe3b95fc admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:49.722641 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de862c2-3e99-4780-b936-b4f8fe3b95fc admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:49.727510 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade97e3e-9d22-46c0-ac45-1f82218594a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:49.728397 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade97e3e-9d22-46c0-ac45-1f82218594a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:49.728681 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade97e3e-9d22-46c0-ac45-1f82218594a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:49.728954 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade97e3e-9d22-46c0-ac45-1f82218594a8 admin admin] PATH_INFO: `/v3/projects/c16e0c7aa839489aa66da868f4dc7eb8/users/9b50eece514e483b94ae11113c78ef89/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:49.743929 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade97e3e-9d22-46c0-ac45-1f82218594a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c16e0c7aa839489aa66da868f4dc7eb8, user_id=9b50eece514e483b94ae11113c78ef89, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:49.746526 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade97e3e-9d22-46c0-ac45-1f82218594a8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:49.910691 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1144/2287] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:16:49 2021] PUT /identity/v3/projects/c16e0c7aa839489aa66da868f4dc7eb8/users/9b50eece514e483b94ae11113c78ef89/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:49.921858 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189166fc-06df-4c7f-8bcc-9740d8701746 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:49.922150 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189166fc-06df-4c7f-8bcc-9740d8701746 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:49.922427 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189166fc-06df-4c7f-8bcc-9740d8701746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:49.950006 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-189166fc-06df-4c7f-8bcc-9740d8701746 None None] MFA Rules not processed for user `9b50eece514e483b94ae11113c78ef89`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:49.951239 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-189166fc-06df-4c7f-8bcc-9740d8701746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:50.017017 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1144/2288] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:49 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:16:50.021277 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade97e3e-9d22-46c0-ac45-1f82218594a8 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:50.091245 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade97e3e-9d22-46c0-ac45-1f82218594a8 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:50.096007 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2941f-9f3f-4000-95ab-47ca982871e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:50.096664 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2941f-9f3f-4000-95ab-47ca982871e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:50.096950 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2941f-9f3f-4000-95ab-47ca982871e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:50.097226 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2941f-9f3f-4000-95ab-47ca982871e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:50.097944 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2941f-9f3f-4000-95ab-47ca982871e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:50.099870 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2941f-9f3f-4000-95ab-47ca982871e2 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:50.263156 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1145/2289] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:16:50 2021] POST /identity/v3/projects => generated 385 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:16:50.268551 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189166fc-06df-4c7f-8bcc-9740d8701746 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:50.282560 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b1a51-8882-4c3d-a002-883e99005a6c None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:50.282853 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b1a51-8882-4c3d-a002-883e99005a6c None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:50.283167 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b1a51-8882-4c3d-a002-883e99005a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:50.284935 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189166fc-06df-4c7f-8bcc-9740d8701746 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:50.303942 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-b70b1a51-8882-4c3d-a002-883e99005a6c None None] MFA Rules not processed for user `882a63823deb40dcb93ddc76f81ab9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:50.309133 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-b70b1a51-8882-4c3d-a002-883e99005a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:50.365270 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b7675-34db-47d0-ad21-8d6794804252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:50.365928 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b7675-34db-47d0-ad21-8d6794804252 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:50.366335 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b7675-34db-47d0-ad21-8d6794804252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:50.366621 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b7675-34db-47d0-ad21-8d6794804252 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:50.367399 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b7675-34db-47d0-ad21-8d6794804252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:50.369553 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b7675-34db-47d0-ad21-8d6794804252 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:50.376477 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1146/2290] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:50 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:16:50.459715 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1145/2291] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:16:50 2021] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:16:50.464459 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b1a51-8882-4c3d-a002-883e99005a6c None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:50.475367 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b1a51-8882-4c3d-a002-883e99005a6c None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:50.480909 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2079155-2601-4cd7-8221-4ec1847181e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:50.481649 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2079155-2601-4cd7-8221-4ec1847181e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:50.481999 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2079155-2601-4cd7-8221-4ec1847181e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:50.482360 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2079155-2601-4cd7-8221-4ec1847181e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:50.483188 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2079155-2601-4cd7-8221-4ec1847181e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:50.484893 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2079155-2601-4cd7-8221-4ec1847181e2 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:50.496045 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1147/2292] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:16:50 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:16:50.500357 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b7675-34db-47d0-ad21-8d6794804252 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:50.510673 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b7675-34db-47d0-ad21-8d6794804252 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:50.516604 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9cf3a-63ed-4c7c-9183-9ba07f3460d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:50.517516 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9cf3a-63ed-4c7c-9183-9ba07f3460d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:50.517798 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9cf3a-63ed-4c7c-9183-9ba07f3460d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:50.518080 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9cf3a-63ed-4c7c-9183-9ba07f3460d3 admin admin] PATH_INFO: `/v3/projects/8a696ca2628c4933b36adebcc5681084/users/770958fda5d74849a1a1d510484493f6/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:50.534444 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9cf3a-63ed-4c7c-9183-9ba07f3460d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a696ca2628c4933b36adebcc5681084, user_id=770958fda5d74849a1a1d510484493f6, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:50.537272 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9cf3a-63ed-4c7c-9183-9ba07f3460d3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:50.630805 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1146/2293] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:16:50 2021] PUT /identity/v3/projects/8a696ca2628c4933b36adebcc5681084/users/770958fda5d74849a1a1d510484493f6/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:16:50.635962 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2079155-2601-4cd7-8221-4ec1847181e2 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:50.646619 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2079155-2601-4cd7-8221-4ec1847181e2 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:50.720966 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8756c3d-25fe-4e12-ba33-890cf0224743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:50.720966 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8756c3d-25fe-4e12-ba33-890cf0224743 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:50.720966 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8756c3d-25fe-4e12-ba33-890cf0224743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:50.720966 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8756c3d-25fe-4e12-ba33-890cf0224743 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:50.722391 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8756c3d-25fe-4e12-ba33-890cf0224743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:50.722391 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8756c3d-25fe-4e12-ba33-890cf0224743 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:50.729290 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1148/2294] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:16:50 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:16:50.733431 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9cf3a-63ed-4c7c-9183-9ba07f3460d3 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:50.744161 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9cf3a-63ed-4c7c-9183-9ba07f3460d3 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:50.749663 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2875aea-78d8-4918-aace-06eadbc88a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:50.750789 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2875aea-78d8-4918-aace-06eadbc88a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:50.751075 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2875aea-78d8-4918-aace-06eadbc88a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:50.751388 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2875aea-78d8-4918-aace-06eadbc88a56 admin admin] PATH_INFO: `/v3/projects/8a696ca2628c4933b36adebcc5681084/users/770958fda5d74849a1a1d510484493f6/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:50.753771 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2875aea-78d8-4918-aace-06eadbc88a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a696ca2628c4933b36adebcc5681084, user_id=770958fda5d74849a1a1d510484493f6, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:50.756903 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2875aea-78d8-4918-aace-06eadbc88a56 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:50.769529 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1147/2295] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:16:50 2021] PUT /identity/v3/projects/8a696ca2628c4933b36adebcc5681084/users/770958fda5d74849a1a1d510484493f6/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:16:50.783295 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9d776-0d28-44b4-9cbf-ac35f5c653d8 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:50.783807 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9d776-0d28-44b4-9cbf-ac35f5c653d8 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:50.784167 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9d776-0d28-44b4-9cbf-ac35f5c653d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:50.818186 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-d3d9d776-0d28-44b4-9cbf-ac35f5c653d8 None None] MFA Rules not processed for user `770958fda5d74849a1a1d510484493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:50.819642 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-d3d9d776-0d28-44b4-9cbf-ac35f5c653d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:50.937778 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1149/2296] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:50 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:50.949873 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2875aea-78d8-4918-aace-06eadbc88a56 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:50.952149 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c2875aea-78d8-4918-aace-06eadbc88a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:51.035426 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2875aea-78d8-4918-aace-06eadbc88a56 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:51.040424 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fb33d-8bf4-45e9-80c8-7322d920b237 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:51.040826 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fb33d-8bf4-45e9-80c8-7322d920b237 service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:51.041112 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fb33d-8bf4-45e9-80c8-7322d920b237 service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:51.041390 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fb33d-8bf4-45e9-80c8-7322d920b237 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:51.099196 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fb33d-8bf4-45e9-80c8-7322d920b237 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:51.100673 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fb33d-8bf4-45e9-80c8-7322d920b237 service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:51.110872 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1148/2297] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:16:50 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:16:51.336346 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9d776-0d28-44b4-9cbf-ac35f5c653d8 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:51.339733 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-d3d9d776-0d28-44b4-9cbf-ac35f5c653d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:51.435193 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9d776-0d28-44b4-9cbf-ac35f5c653d8 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:51.440062 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa83c1-f4a4-495c-812e-bb46daf0c045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:51.440910 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa83c1-f4a4-495c-812e-bb46daf0c045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:51.441120 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa83c1-f4a4-495c-812e-bb46daf0c045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:51.441392 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa83c1-f4a4-495c-812e-bb46daf0c045 admin admin] PATH_INFO: `/v3/users/b9afaf378d784aaa90752b936005a687` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:51.442582 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa83c1-f4a4-495c-812e-bb46daf0c045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9afaf378d784aaa90752b936005a687)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:51.446758 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa83c1-f4a4-495c-812e-bb46daf0c045 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:51.745414 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-3aaa83c1-f4a4-495c-812e-bb46daf0c045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9afaf378d784aaa90752b936005a687'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:51.833587 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-3aaa83c1-f4a4-495c-812e-bb46daf0c045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9afaf378d784aaa90752b936005a687'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:51.842241 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-3aaa83c1-f4a4-495c-812e-bb46daf0c045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9afaf378d784aaa90752b936005a687'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:51.842951 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-3aaa83c1-f4a4-495c-812e-bb46daf0c045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9afaf378d784aaa90752b936005a687'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:51.855768 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-3aaa83c1-f4a4-495c-812e-bb46daf0c045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9afaf378d784aaa90752b936005a687'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:51.862259 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1150/2298] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:16:51 2021] DELETE /identity/v3/users/b9afaf378d784aaa90752b936005a687 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:51.866683 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ec55a-965f-4a28-bd58-a0c97dbfb35b None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:51.867162 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ec55a-965f-4a28-bd58-a0c97dbfb35b None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:51.867281 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ec55a-965f-4a28-bd58-a0c97dbfb35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:51.886478 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-1b1ec55a-965f-4a28-bd58-a0c97dbfb35b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:51.887730 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-1b1ec55a-965f-4a28-bd58-a0c97dbfb35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:51.948194 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1149/2299] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:16:51.958607 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa83c1-f4a4-495c-812e-bb46daf0c045 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:51.960231 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-3aaa83c1-f4a4-495c-812e-bb46daf0c045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:52.018837 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa83c1-f4a4-495c-812e-bb46daf0c045 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:52.022832 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef695a-d858-455e-94c9-8c122afb8338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:52.023562 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef695a-d858-455e-94c9-8c122afb8338 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:52.023837 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef695a-d858-455e-94c9-8c122afb8338 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:52.024140 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef695a-d858-455e-94c9-8c122afb8338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:52.033663 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef695a-d858-455e-94c9-8c122afb8338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:52.035459 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef695a-d858-455e-94c9-8c122afb8338 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:52.047949 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1151/2300] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:16:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:16:52.448057 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ec55a-965f-4a28-bd58-a0c97dbfb35b None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:52.449548 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-1b1ec55a-965f-4a28-bd58-a0c97dbfb35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:52.463564 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ec55a-965f-4a28-bd58-a0c97dbfb35b None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:52.468375 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecdb71-a20c-4942-b75c-538f4acc3b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:52.469260 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecdb71-a20c-4942-b75c-538f4acc3b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:52.469545 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecdb71-a20c-4942-b75c-538f4acc3b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:52.469823 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecdb71-a20c-4942-b75c-538f4acc3b9f admin admin] PATH_INFO: `/v3/projects/d5ed34581a5e4a4b8f22a96ca010c337` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:52.471053 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ecdb71-a20c-4942-b75c-538f4acc3b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5ed34581a5e4a4b8f22a96ca010c337)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:52.473140 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ecdb71-a20c-4942-b75c-538f4acc3b9f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:52.628288 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-b1ecdb71-a20c-4942-b75c-538f4acc3b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5ed34581a5e4a4b8f22a96ca010c337', 'request_id': 'req-b1ecdb71-a20c-4942-b75c-538f4acc3b9f'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:52.635101 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-b1ecdb71-a20c-4942-b75c-538f4acc3b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5ed34581a5e4a4b8f22a96ca010c337', 'request_id': 'req-b1ecdb71-a20c-4942-b75c-538f4acc3b9f'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:52.640397 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-b1ecdb71-a20c-4942-b75c-538f4acc3b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5ed34581a5e4a4b8f22a96ca010c337', 'request_id': 'req-b1ecdb71-a20c-4942-b75c-538f4acc3b9f'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:52.765018 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-b1ecdb71-a20c-4942-b75c-538f4acc3b9f admin admin] The token cache is being invalidate because project d5ed34581a5e4a4b8f22a96ca010c337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:16:52.765327 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-b1ecdb71-a20c-4942-b75c-538f4acc3b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:52.765998 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-b1ecdb71-a20c-4942-b75c-538f4acc3b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:52.767583 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1150/2301] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:16:52 2021] DELETE /identity/v3/projects/d5ed34581a5e4a4b8f22a96ca010c337 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:52.774839 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716add1c-36eb-49ea-b915-a879b28a6571 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:52.775152 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716add1c-36eb-49ea-b915-a879b28a6571 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:52.775464 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716add1c-36eb-49ea-b915-a879b28a6571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:52.802884 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-716add1c-36eb-49ea-b915-a879b28a6571 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:52.804133 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-716add1c-36eb-49ea-b915-a879b28a6571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:52.865762 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1152/2302] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:16:52.874659 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5f29a-c4d3-4505-8844-a18b1b68aea1 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:52.875103 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5f29a-c4d3-4505-8844-a18b1b68aea1 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:52.875230 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5f29a-c4d3-4505-8844-a18b1b68aea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:52.896107 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-78e5f29a-c4d3-4505-8844-a18b1b68aea1 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:52.897679 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-78e5f29a-c4d3-4505-8844-a18b1b68aea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:52.907723 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1151/2303] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:52.912932 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716add1c-36eb-49ea-b915-a879b28a6571 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:52.925235 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716add1c-36eb-49ea-b915-a879b28a6571 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:52.929011 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bb3f9-efef-45f5-afd2-f5f8f96740c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:52.929656 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bb3f9-efef-45f5-afd2-f5f8f96740c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:52.929939 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bb3f9-efef-45f5-afd2-f5f8f96740c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:52.930783 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bb3f9-efef-45f5-afd2-f5f8f96740c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:52.931608 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bb3f9-efef-45f5-afd2-f5f8f96740c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:16:52.931916 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bb3f9-efef-45f5-afd2-f5f8f96740c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:52.933485 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bb3f9-efef-45f5-afd2-f5f8f96740c7 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:52.944936 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1153/2304] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:16:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:16:52.949947 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5f29a-c4d3-4505-8844-a18b1b68aea1 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:52.958975 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5f29a-c4d3-4505-8844-a18b1b68aea1 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:52.964566 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b9fb5-c5b2-4d52-97e0-b2ae3e28c67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:52.965133 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b9fb5-c5b2-4d52-97e0-b2ae3e28c67a admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:52.965413 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b9fb5-c5b2-4d52-97e0-b2ae3e28c67a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:52.965684 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b9fb5-c5b2-4d52-97e0-b2ae3e28c67a admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:52.966387 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b9fb5-c5b2-4d52-97e0-b2ae3e28c67a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:52.968346 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b9fb5-c5b2-4d52-97e0-b2ae3e28c67a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:53.085929 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1152/2305] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:16:52 2021] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:16:53.090558 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bb3f9-efef-45f5-afd2-f5f8f96740c7 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:53.100278 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bb3f9-efef-45f5-afd2-f5f8f96740c7 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:53.155153 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2643ac1-ee33-43f2-a65a-5391217496db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:53.155764 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2643ac1-ee33-43f2-a65a-5391217496db admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:53.156048 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2643ac1-ee33-43f2-a65a-5391217496db admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:53.156320 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2643ac1-ee33-43f2-a65a-5391217496db admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:53.157019 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2643ac1-ee33-43f2-a65a-5391217496db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:53.158888 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2643ac1-ee33-43f2-a65a-5391217496db admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:53.296835 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1154/2306] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:16:53 2021] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:16:53.298180 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b9fb5-c5b2-4d52-97e0-b2ae3e28c67a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:53.308424 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b9fb5-c5b2-4d52-97e0-b2ae3e28c67a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:53.313504 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67287b9-5225-43b7-8143-33c001895d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:53.314174 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67287b9-5225-43b7-8143-33c001895d24 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:53.314523 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67287b9-5225-43b7-8143-33c001895d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:53.314807 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67287b9-5225-43b7-8143-33c001895d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:53.315519 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67287b9-5225-43b7-8143-33c001895d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:53.317159 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67287b9-5225-43b7-8143-33c001895d24 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:53.328438 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1153/2307] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:16:53 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:16:53.332640 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2643ac1-ee33-43f2-a65a-5391217496db admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:53.344754 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2643ac1-ee33-43f2-a65a-5391217496db admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:53.349558 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfdffd-aa8a-4093-ac44-3d638952fb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:53.350234 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfdffd-aa8a-4093-ac44-3d638952fb9b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:53.350525 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfdffd-aa8a-4093-ac44-3d638952fb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:53.350806 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfdffd-aa8a-4093-ac44-3d638952fb9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:53.351580 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfdffd-aa8a-4093-ac44-3d638952fb9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:53.353299 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfdffd-aa8a-4093-ac44-3d638952fb9b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:53.364642 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1155/2308] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:16:53 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:16:53.369625 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67287b9-5225-43b7-8143-33c001895d24 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:53.379601 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67287b9-5225-43b7-8143-33c001895d24 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:53.386199 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ba334-ce63-4d67-ad3a-d95526c95793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:53.387077 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ba334-ce63-4d67-ad3a-d95526c95793 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:53.387404 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ba334-ce63-4d67-ad3a-d95526c95793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:53.387679 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ba334-ce63-4d67-ad3a-d95526c95793 admin admin] PATH_INFO: `/v3/projects/0dcc5d168617498bbafe5038567ca011/users/21a1d655b7be402c9339cfd5d09215f5/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:53.409755 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ba334-ce63-4d67-ad3a-d95526c95793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dcc5d168617498bbafe5038567ca011, user_id=21a1d655b7be402c9339cfd5d09215f5, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:53.412740 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ba334-ce63-4d67-ad3a-d95526c95793 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:53.559912 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1154/2309] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:16:53 2021] PUT /identity/v3/projects/0dcc5d168617498bbafe5038567ca011/users/21a1d655b7be402c9339cfd5d09215f5/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:16:53.565002 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d33516-5731-4e6b-a4f8-edafdb9742be None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:53.565296 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d33516-5731-4e6b-a4f8-edafdb9742be None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:53.565579 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d33516-5731-4e6b-a4f8-edafdb9742be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:53.584488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-53d33516-5731-4e6b-a4f8-edafdb9742be None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:53.585872 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-53d33516-5731-4e6b-a4f8-edafdb9742be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:53.646278 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1156/2310] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:53.656984 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ba334-ce63-4d67-ad3a-d95526c95793 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:53.659175 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c69ba334-ce63-4d67-ad3a-d95526c95793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:53.722888 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ba334-ce63-4d67-ad3a-d95526c95793 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:53.726819 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f9621-daa0-4626-9e35-54a6c75057cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:53.728483 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f9621-daa0-4626-9e35-54a6c75057cf service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:53.728791 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f9621-daa0-4626-9e35-54a6c75057cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:53.729101 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f9621-daa0-4626-9e35-54a6c75057cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:53.738598 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f9621-daa0-4626-9e35-54a6c75057cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:53.740125 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f9621-daa0-4626-9e35-54a6c75057cf service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:53.750984 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1155/2311] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:16:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:16:56.944904 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d33516-5731-4e6b-a4f8-edafdb9742be None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:56.947938 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-53d33516-5731-4e6b-a4f8-edafdb9742be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:57.073081 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d33516-5731-4e6b-a4f8-edafdb9742be None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:57.082160 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce426153-4359-4431-b99e-c911fee109de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:57.083113 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce426153-4359-4431-b99e-c911fee109de service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:57.083384 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce426153-4359-4431-b99e-c911fee109de service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:57.083685 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce426153-4359-4431-b99e-c911fee109de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:57.091146 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-ce426153-4359-4431-b99e-c911fee109de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:57.204649 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce426153-4359-4431-b99e-c911fee109de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:57.206393 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce426153-4359-4431-b99e-c911fee109de service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:57.244063 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1157/2312] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:16:56 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:16:57.725781 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f9621-daa0-4626-9e35-54a6c75057cf service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:57.728268 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c67f9621-daa0-4626-9e35-54a6c75057cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:57.743470 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f9621-daa0-4626-9e35-54a6c75057cf service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:57.750087 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927620e-a917-4aed-8c86-1e55ff3fb574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:57.751314 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927620e-a917-4aed-8c86-1e55ff3fb574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:57.751823 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927620e-a917-4aed-8c86-1e55ff3fb574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:57.752335 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927620e-a917-4aed-8c86-1e55ff3fb574 admin admin] PATH_INFO: `/v3/users/4f61122ad92041b0a88f848776a2ab7e` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:57.753766 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927620e-a917-4aed-8c86-1e55ff3fb574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f61122ad92041b0a88f848776a2ab7e)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:57.756200 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927620e-a917-4aed-8c86-1e55ff3fb574 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:58.115093 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-6927620e-a917-4aed-8c86-1e55ff3fb574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f61122ad92041b0a88f848776a2ab7e'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:58.216582 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-6927620e-a917-4aed-8c86-1e55ff3fb574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f61122ad92041b0a88f848776a2ab7e'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:58.228660 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-6927620e-a917-4aed-8c86-1e55ff3fb574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f61122ad92041b0a88f848776a2ab7e'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:58.230576 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-6927620e-a917-4aed-8c86-1e55ff3fb574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f61122ad92041b0a88f848776a2ab7e'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:58.257585 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-6927620e-a917-4aed-8c86-1e55ff3fb574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f61122ad92041b0a88f848776a2ab7e'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:58.275438 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1156/2313] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:16:57 2021] DELETE /identity/v3/users/4f61122ad92041b0a88f848776a2ab7e => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:16:58.283287 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de43c79-73e2-4e87-9d09-b8e2795e1661 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:58.288341 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de43c79-73e2-4e87-9d09-b8e2795e1661 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:58.288883 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de43c79-73e2-4e87-9d09-b8e2795e1661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:58.346616 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-9de43c79-73e2-4e87-9d09-b8e2795e1661 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:16:58.348076 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-9de43c79-73e2-4e87-9d09-b8e2795e1661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:58.516971 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1158/2314] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:16:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:16:58.550626 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927620e-a917-4aed-8c86-1e55ff3fb574 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:58.552903 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-6927620e-a917-4aed-8c86-1e55ff3fb574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:58.637886 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927620e-a917-4aed-8c86-1e55ff3fb574 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:58.641931 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c032a-f469-47c4-bde9-4562f36375ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:58.642813 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c032a-f469-47c4-bde9-4562f36375ca service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:58.643310 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c032a-f469-47c4-bde9-4562f36375ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:58.643774 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c032a-f469-47c4-bde9-4562f36375ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:58.656258 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c032a-f469-47c4-bde9-4562f36375ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:58.658369 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c032a-f469-47c4-bde9-4562f36375ca service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:58.671442 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1157/2315] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:16:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:16:59.575322 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de43c79-73e2-4e87-9d09-b8e2795e1661 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:59.576923 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-9de43c79-73e2-4e87-9d09-b8e2795e1661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:59.587881 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c032a-f469-47c4-bde9-4562f36375ca service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:16:59.589437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-129c032a-f469-47c4-bde9-4562f36375ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:59.615288 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c032a-f469-47c4-bde9-4562f36375ca service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:59.630771 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8d828-d88e-4126-94cf-a2ab122ffe2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:59.633496 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8d828-d88e-4126-94cf-a2ab122ffe2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:59.635077 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8d828-d88e-4126-94cf-a2ab122ffe2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:59.641432 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8d828-d88e-4126-94cf-a2ab122ffe2d admin admin] PATH_INFO: `/v3/projects/0451d916bed04c8fa7d78bb2efa5ff7f` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:59.641432 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8d828-d88e-4126-94cf-a2ab122ffe2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0451d916bed04c8fa7d78bb2efa5ff7f)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:59.641432 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8d828-d88e-4126-94cf-a2ab122ffe2d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:59.694938 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de43c79-73e2-4e87-9d09-b8e2795e1661 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:16:59.701888 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f829b6-0f65-4bc8-b907-208b3590b843 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:16:59.702810 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f829b6-0f65-4bc8-b907-208b3590b843 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:16:59.703327 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f829b6-0f65-4bc8-b907-208b3590b843 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:16:59.704321 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f829b6-0f65-4bc8-b907-208b3590b843 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:16:59.710396 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-d5f829b6-0f65-4bc8-b907-208b3590b843 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:16:59.811641 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f829b6-0f65-4bc8-b907-208b3590b843 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:16:59.813414 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f829b6-0f65-4bc8-b907-208b3590b843 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:16:59.828470 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1159/2316] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:16:59 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:16:59.927348 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-d6e8d828-d88e-4126-94cf-a2ab122ffe2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0451d916bed04c8fa7d78bb2efa5ff7f', 'request_id': 'req-d6e8d828-d88e-4126-94cf-a2ab122ffe2d'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:59.940975 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-d6e8d828-d88e-4126-94cf-a2ab122ffe2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0451d916bed04c8fa7d78bb2efa5ff7f', 'request_id': 'req-d6e8d828-d88e-4126-94cf-a2ab122ffe2d'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:16:59.954049 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-d6e8d828-d88e-4126-94cf-a2ab122ffe2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0451d916bed04c8fa7d78bb2efa5ff7f', 'request_id': 'req-d6e8d828-d88e-4126-94cf-a2ab122ffe2d'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:00.178771 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-d6e8d828-d88e-4126-94cf-a2ab122ffe2d admin admin] The token cache is being invalidate because project 0451d916bed04c8fa7d78bb2efa5ff7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:17:00.179178 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-d6e8d828-d88e-4126-94cf-a2ab122ffe2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:00.179912 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-d6e8d828-d88e-4126-94cf-a2ab122ffe2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:00.182542 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1158/2317] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:16:59 2021] DELETE /identity/v3/projects/0451d916bed04c8fa7d78bb2efa5ff7f => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:17:01.006993 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d907f3-5537-4a0c-a5c8-0f7ff80bf40d None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:01.007561 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d907f3-5537-4a0c-a5c8-0f7ff80bf40d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:01.007659 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d907f3-5537-4a0c-a5c8-0f7ff80bf40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:01.053709 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-41d907f3-5537-4a0c-a5c8-0f7ff80bf40d None None] MFA Rules not processed for user `21a1d655b7be402c9339cfd5d09215f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:17:01.055889 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-41d907f3-5537-4a0c-a5c8-0f7ff80bf40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:01.172501 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8d828-d88e-4126-94cf-a2ab122ffe2d admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:01.173033 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1160/2318] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:17:01 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:17:01.179303 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-d6e8d828-d88e-4126-94cf-a2ab122ffe2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:01.284880 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8d828-d88e-4126-94cf-a2ab122ffe2d admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:01.296525 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a72c56-5422-4b66-b275-f7c94381458a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:01.296525 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a72c56-5422-4b66-b275-f7c94381458a admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:01.296525 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a72c56-5422-4b66-b275-f7c94381458a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:01.296525 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a72c56-5422-4b66-b275-f7c94381458a admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:01.297035 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a72c56-5422-4b66-b275-f7c94381458a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:01.297683 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a72c56-5422-4b66-b275-f7c94381458a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:01.423605 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8721c-a7fb-4e86-8426-4833d5fd8780 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:01.426502 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8721c-a7fb-4e86-8426-4833d5fd8780 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:01.426502 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8721c-a7fb-4e86-8426-4833d5fd8780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:01.463255 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1159/2319] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:17:01 2021] POST /identity/v3/projects => generated 385 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:17:01.463533 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-03e8721c-a7fb-4e86-8426-4833d5fd8780 None None] MFA Rules not processed for user `b68d0745d9cb49a5bd9331148967764a`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:17:01.465175 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-03e8721c-a7fb-4e86-8426-4833d5fd8780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:01.465363 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a72c56-5422-4b66-b275-f7c94381458a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:01.547838 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1161/2320] 10.222.0.54 () {58 vars in 1009 bytes} [Tue Nov 23 04:17:01 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:17:01.552260 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a72c56-5422-4b66-b275-f7c94381458a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:01.558637 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb50f1-3789-40f7-8875-64f20d255cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:01.559789 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb50f1-3789-40f7-8875-64f20d255cde admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:01.560265 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8721c-a7fb-4e86-8426-4833d5fd8780 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:01.560693 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb50f1-3789-40f7-8875-64f20d255cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:01.561440 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb50f1-3789-40f7-8875-64f20d255cde admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:01.562605 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb50f1-3789-40f7-8875-64f20d255cde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:01.562911 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-03e8721c-a7fb-4e86-8426-4833d5fd8780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:01.564776 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb50f1-3789-40f7-8875-64f20d255cde admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:01.645414 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8721c-a7fb-4e86-8426-4833d5fd8780 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:01.650693 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a4ecf-43da-4dfc-a14d-10eb43b54a4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd439c1f0764f4cac7eb641a485937a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:01.651391 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a4ecf-43da-4dfc-a14d-10eb43b54a4d service swift] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:01.651699 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a4ecf-43da-4dfc-a14d-10eb43b54a4d service swift] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:01.652031 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a4ecf-43da-4dfc-a14d-10eb43b54a4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:01.662113 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a4ecf-43da-4dfc-a14d-10eb43b54a4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:01.663748 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a4ecf-43da-4dfc-a14d-10eb43b54a4d service swift] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:01.673173 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1162/2321] 10.222.0.54 () {60 vars in 1384 bytes} [Tue Nov 23 04:17:01 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 04:17:01.862082 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1160/2322] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:17:01 2021] POST /identity/v3/users => generated 299 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:17:01.865713 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a4ecf-43da-4dfc-a14d-10eb43b54a4d service swift] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:01.891159 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a4ecf-43da-4dfc-a14d-10eb43b54a4d service swift] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:01.896725 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77518a46-610a-4452-ada9-3433c7bf4bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:01.897698 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77518a46-610a-4452-ada9-3433c7bf4bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:01.898196 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77518a46-610a-4452-ada9-3433c7bf4bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:01.898688 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77518a46-610a-4452-ada9-3433c7bf4bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:01.899669 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77518a46-610a-4452-ada9-3433c7bf4bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:01.901695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77518a46-610a-4452-ada9-3433c7bf4bf9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:01.924488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1163/2323] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:17:01 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:17:01.928387 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb50f1-3789-40f7-8875-64f20d255cde admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:01.951169 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb50f1-3789-40f7-8875-64f20d255cde admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:01.958391 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556c63f-d9a4-4fa0-adc7-40911cdbec23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:01.959770 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556c63f-d9a4-4fa0-adc7-40911cdbec23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:01.960331 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556c63f-d9a4-4fa0-adc7-40911cdbec23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:01.960889 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556c63f-d9a4-4fa0-adc7-40911cdbec23 admin admin] PATH_INFO: `/v3/projects/8f5aeba06d224980b7a3e376b675d4ea/users/63784b24c95c4867b726f7a4f433d9dd/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:01.990665 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556c63f-d9a4-4fa0-adc7-40911cdbec23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f5aeba06d224980b7a3e376b675d4ea, user_id=63784b24c95c4867b726f7a4f433d9dd, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:01.990665 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556c63f-d9a4-4fa0-adc7-40911cdbec23 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:02.103178 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1161/2324] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:17:01 2021] PUT /identity/v3/projects/8f5aeba06d224980b7a3e376b675d4ea/users/63784b24c95c4867b726f7a4f433d9dd/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:17:02.107337 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77518a46-610a-4452-ada9-3433c7bf4bf9 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:02.122319 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77518a46-610a-4452-ada9-3433c7bf4bf9 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:02.206742 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3639f50-cbf2-4f74-8963-76873c39a0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:02.207705 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3639f50-cbf2-4f74-8963-76873c39a0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:02.208375 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3639f50-cbf2-4f74-8963-76873c39a0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:02.209014 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3639f50-cbf2-4f74-8963-76873c39a0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:02.209903 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3639f50-cbf2-4f74-8963-76873c39a0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:02.211699 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3639f50-cbf2-4f74-8963-76873c39a0c3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:02.240257 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1164/2325] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:17:02 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:17:02.249007 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556c63f-d9a4-4fa0-adc7-40911cdbec23 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:02.262532 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556c63f-d9a4-4fa0-adc7-40911cdbec23 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:02.273553 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54191739-f169-461b-a7be-52a832c46e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:02.277418 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54191739-f169-461b-a7be-52a832c46e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:02.278383 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54191739-f169-461b-a7be-52a832c46e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:02.278852 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54191739-f169-461b-a7be-52a832c46e38 admin admin] PATH_INFO: `/v3/projects/8f5aeba06d224980b7a3e376b675d4ea/users/63784b24c95c4867b726f7a4f433d9dd/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:02.282090 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54191739-f169-461b-a7be-52a832c46e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f5aeba06d224980b7a3e376b675d4ea, user_id=63784b24c95c4867b726f7a4f433d9dd, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:02.288561 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54191739-f169-461b-a7be-52a832c46e38 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:02.317696 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1162/2326] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:17:02 2021] PUT /identity/v3/projects/8f5aeba06d224980b7a3e376b675d4ea/users/63784b24c95c4867b726f7a4f433d9dd/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:17:07.077259 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3639f50-cbf2-4f74-8963-76873c39a0c3 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:07.080953 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e3639f50-cbf2-4f74-8963-76873c39a0c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:07.106710 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3639f50-cbf2-4f74-8963-76873c39a0c3 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:07.221887 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3eeb3-db0e-4a00-913e-35cac4af800d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:07.222965 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3eeb3-db0e-4a00-913e-35cac4af800d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:07.223330 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3eeb3-db0e-4a00-913e-35cac4af800d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:07.223615 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3eeb3-db0e-4a00-913e-35cac4af800d admin admin] PATH_INFO: `/v3/users/e878f3a0ce0e41918a85612575714f79` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:07.228367 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3eeb3-db0e-4a00-913e-35cac4af800d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e878f3a0ce0e41918a85612575714f79)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:07.230963 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3eeb3-db0e-4a00-913e-35cac4af800d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:07.479612 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-31a3eeb3-db0e-4a00-913e-35cac4af800d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e878f3a0ce0e41918a85612575714f79'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:07.580353 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-31a3eeb3-db0e-4a00-913e-35cac4af800d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e878f3a0ce0e41918a85612575714f79'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:07.589725 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-31a3eeb3-db0e-4a00-913e-35cac4af800d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e878f3a0ce0e41918a85612575714f79'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:07.591605 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-31a3eeb3-db0e-4a00-913e-35cac4af800d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e878f3a0ce0e41918a85612575714f79'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:07.623571 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-31a3eeb3-db0e-4a00-913e-35cac4af800d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e878f3a0ce0e41918a85612575714f79'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:07.640541 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1165/2327] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:17:07 2021] DELETE /identity/v3/users/e878f3a0ce0e41918a85612575714f79 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:17:07.646032 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650635d0-3c2b-4396-9d79-fb5c38b2987d None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:07.647779 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650635d0-3c2b-4396-9d79-fb5c38b2987d None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:07.655013 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650635d0-3c2b-4396-9d79-fb5c38b2987d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:07.682853 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-650635d0-3c2b-4396-9d79-fb5c38b2987d None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:17:07.684300 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-650635d0-3c2b-4396-9d79-fb5c38b2987d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:07.829520 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1163/2328] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:17:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:17:07.842347 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3eeb3-db0e-4a00-913e-35cac4af800d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:07.844788 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-31a3eeb3-db0e-4a00-913e-35cac4af800d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:07.942702 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3eeb3-db0e-4a00-913e-35cac4af800d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:07.952643 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9692a46-28e2-44d1-a7dc-f0e9f65cb0f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:07.954083 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9692a46-28e2-44d1-a7dc-f0e9f65cb0f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:07.954545 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9692a46-28e2-44d1-a7dc-f0e9f65cb0f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:07.955607 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9692a46-28e2-44d1-a7dc-f0e9f65cb0f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:07.968843 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9692a46-28e2-44d1-a7dc-f0e9f65cb0f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:07.984801 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9692a46-28e2-44d1-a7dc-f0e9f65cb0f4 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:08.017599 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1166/2329] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:17:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:17:08.720848 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650635d0-3c2b-4396-9d79-fb5c38b2987d None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:08.723336 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-650635d0-3c2b-4396-9d79-fb5c38b2987d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:08.743600 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650635d0-3c2b-4396-9d79-fb5c38b2987d None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:08.749179 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b363844-cd4e-48a1-86cd-a196b0affb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:08.750526 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b363844-cd4e-48a1-86cd-a196b0affb92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:08.751027 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b363844-cd4e-48a1-86cd-a196b0affb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:08.751608 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b363844-cd4e-48a1-86cd-a196b0affb92 admin admin] PATH_INFO: `/v3/projects/2b7a785e17ce44968886dc4b8a65284c` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:08.753130 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b363844-cd4e-48a1-86cd-a196b0affb92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b7a785e17ce44968886dc4b8a65284c)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:08.755985 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b363844-cd4e-48a1-86cd-a196b0affb92 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:08.934945 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-1b363844-cd4e-48a1-86cd-a196b0affb92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b7a785e17ce44968886dc4b8a65284c', 'request_id': 'req-1b363844-cd4e-48a1-86cd-a196b0affb92'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:08.942939 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-1b363844-cd4e-48a1-86cd-a196b0affb92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b7a785e17ce44968886dc4b8a65284c', 'request_id': 'req-1b363844-cd4e-48a1-86cd-a196b0affb92'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:08.953458 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-1b363844-cd4e-48a1-86cd-a196b0affb92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b7a785e17ce44968886dc4b8a65284c', 'request_id': 'req-1b363844-cd4e-48a1-86cd-a196b0affb92'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:09.051453 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-1b363844-cd4e-48a1-86cd-a196b0affb92 admin admin] The token cache is being invalidate because project 2b7a785e17ce44968886dc4b8a65284c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:17:09.052107 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-1b363844-cd4e-48a1-86cd-a196b0affb92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:09.053018 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-1b363844-cd4e-48a1-86cd-a196b0affb92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:09.055381 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1164/2330] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:17:08 2021] DELETE /identity/v3/projects/2b7a785e17ce44968886dc4b8a65284c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:17:09.059284 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9692a46-28e2-44d1-a7dc-f0e9f65cb0f4 service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:09.087199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9692a46-28e2-44d1-a7dc-f0e9f65cb0f4 service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:09.202943 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b76887-0288-4ee8-99f5-9dbea7c7b79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:09.204338 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b76887-0288-4ee8-99f5-9dbea7c7b79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:09.204792 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b76887-0288-4ee8-99f5-9dbea7c7b79a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:09.205234 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b76887-0288-4ee8-99f5-9dbea7c7b79a admin admin] PATH_INFO: `/v3/users/9b50eece514e483b94ae11113c78ef89` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:09.206657 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b76887-0288-4ee8-99f5-9dbea7c7b79a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b50eece514e483b94ae11113c78ef89)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:09.208864 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b76887-0288-4ee8-99f5-9dbea7c7b79a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:09.412975 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-38b76887-0288-4ee8-99f5-9dbea7c7b79a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b50eece514e483b94ae11113c78ef89'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:09.527965 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-38b76887-0288-4ee8-99f5-9dbea7c7b79a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b50eece514e483b94ae11113c78ef89'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:09.538388 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-38b76887-0288-4ee8-99f5-9dbea7c7b79a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b50eece514e483b94ae11113c78ef89'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:09.539847 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-38b76887-0288-4ee8-99f5-9dbea7c7b79a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b50eece514e483b94ae11113c78ef89'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:09.569262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-38b76887-0288-4ee8-99f5-9dbea7c7b79a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b50eece514e483b94ae11113c78ef89'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:09.581505 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1167/2331] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:17:09 2021] DELETE /identity/v3/users/9b50eece514e483b94ae11113c78ef89 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:17:11.166301 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b363844-cd4e-48a1-86cd-a196b0affb92 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:11.168520 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-1b363844-cd4e-48a1-86cd-a196b0affb92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:11.194685 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b363844-cd4e-48a1-86cd-a196b0affb92 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:11.281182 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41b287-7093-4e1c-b9d9-8644eedcb648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:11.282192 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41b287-7093-4e1c-b9d9-8644eedcb648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:11.282539 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41b287-7093-4e1c-b9d9-8644eedcb648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:11.282878 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41b287-7093-4e1c-b9d9-8644eedcb648 admin admin] PATH_INFO: `/v3/projects/c16e0c7aa839489aa66da868f4dc7eb8` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:11.284422 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41b287-7093-4e1c-b9d9-8644eedcb648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c16e0c7aa839489aa66da868f4dc7eb8)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:11.286671 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41b287-7093-4e1c-b9d9-8644eedcb648 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:11.460813 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-6a41b287-7093-4e1c-b9d9-8644eedcb648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c16e0c7aa839489aa66da868f4dc7eb8', 'request_id': 'req-6a41b287-7093-4e1c-b9d9-8644eedcb648'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:11.470671 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-6a41b287-7093-4e1c-b9d9-8644eedcb648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c16e0c7aa839489aa66da868f4dc7eb8', 'request_id': 'req-6a41b287-7093-4e1c-b9d9-8644eedcb648'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:11.479348 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-6a41b287-7093-4e1c-b9d9-8644eedcb648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c16e0c7aa839489aa66da868f4dc7eb8', 'request_id': 'req-6a41b287-7093-4e1c-b9d9-8644eedcb648'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:11.661843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-6a41b287-7093-4e1c-b9d9-8644eedcb648 admin admin] The token cache is being invalidate because project c16e0c7aa839489aa66da868f4dc7eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:17:11.661843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-6a41b287-7093-4e1c-b9d9-8644eedcb648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:11.661843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-6a41b287-7093-4e1c-b9d9-8644eedcb648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:11.661843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1165/2332] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:17:11 2021] DELETE /identity/v3/projects/c16e0c7aa839489aa66da868f4dc7eb8 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:17:11.663403 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b76887-0288-4ee8-99f5-9dbea7c7b79a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:11.672203 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-38b76887-0288-4ee8-99f5-9dbea7c7b79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:11.697215 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b76887-0288-4ee8-99f5-9dbea7c7b79a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:11.815406 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bdbdd-b068-403b-a688-fbab648be583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:11.816825 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bdbdd-b068-403b-a688-fbab648be583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:11.817484 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bdbdd-b068-403b-a688-fbab648be583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:11.817997 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bdbdd-b068-403b-a688-fbab648be583 admin admin] PATH_INFO: `/v3/users/770958fda5d74849a1a1d510484493f6` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:11.819820 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bdbdd-b068-403b-a688-fbab648be583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=770958fda5d74849a1a1d510484493f6)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:11.824715 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bdbdd-b068-403b-a688-fbab648be583 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:12.105941 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-888bdbdd-b068-403b-a688-fbab648be583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '770958fda5d74849a1a1d510484493f6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:12.208129 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-888bdbdd-b068-403b-a688-fbab648be583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '770958fda5d74849a1a1d510484493f6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:12.222470 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-888bdbdd-b068-403b-a688-fbab648be583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '770958fda5d74849a1a1d510484493f6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:12.223966 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-888bdbdd-b068-403b-a688-fbab648be583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '770958fda5d74849a1a1d510484493f6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:12.244813 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-888bdbdd-b068-403b-a688-fbab648be583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '770958fda5d74849a1a1d510484493f6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:12.257686 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1168/2333] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:17:11 2021] DELETE /identity/v3/users/770958fda5d74849a1a1d510484493f6 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:17:12.852352 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41b287-7093-4e1c-b9d9-8644eedcb648 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:12.853525 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-6a41b287-7093-4e1c-b9d9-8644eedcb648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:12.871648 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41b287-7093-4e1c-b9d9-8644eedcb648 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:12.973453 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847520e-9ebc-4ecf-9dba-987c7663ca6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:12.974803 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847520e-9ebc-4ecf-9dba-987c7663ca6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:12.975384 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847520e-9ebc-4ecf-9dba-987c7663ca6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:12.975892 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847520e-9ebc-4ecf-9dba-987c7663ca6a admin admin] PATH_INFO: `/v3/projects/8a696ca2628c4933b36adebcc5681084` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:12.980155 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847520e-9ebc-4ecf-9dba-987c7663ca6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a696ca2628c4933b36adebcc5681084)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:12.982506 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847520e-9ebc-4ecf-9dba-987c7663ca6a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:13.096366 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0847520e-9ebc-4ecf-9dba-987c7663ca6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a696ca2628c4933b36adebcc5681084', 'request_id': 'req-0847520e-9ebc-4ecf-9dba-987c7663ca6a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:13.110160 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0847520e-9ebc-4ecf-9dba-987c7663ca6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a696ca2628c4933b36adebcc5681084', 'request_id': 'req-0847520e-9ebc-4ecf-9dba-987c7663ca6a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:13.127653 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0847520e-9ebc-4ecf-9dba-987c7663ca6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a696ca2628c4933b36adebcc5681084', 'request_id': 'req-0847520e-9ebc-4ecf-9dba-987c7663ca6a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:13.229845 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0847520e-9ebc-4ecf-9dba-987c7663ca6a admin admin] The token cache is being invalidate because project 8a696ca2628c4933b36adebcc5681084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:17:13.230515 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0847520e-9ebc-4ecf-9dba-987c7663ca6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:13.231535 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0847520e-9ebc-4ecf-9dba-987c7663ca6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:13.233484 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1166/2334] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:17:12 2021] DELETE /identity/v3/projects/8a696ca2628c4933b36adebcc5681084 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:17:13.239362 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bf55e-1f6a-4050-a63c-fb7579c1bc23 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:13.240475 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bf55e-1f6a-4050-a63c-fb7579c1bc23 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:13.241024 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bf55e-1f6a-4050-a63c-fb7579c1bc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:13.275128 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-959bf55e-1f6a-4050-a63c-fb7579c1bc23 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:17:13.276797 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-959bf55e-1f6a-4050-a63c-fb7579c1bc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:13.424954 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1169/2335] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:17:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:17:13.434602 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5851505-80c5-4a84-82b6-f16011af2b75 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:13.434938 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5851505-80c5-4a84-82b6-f16011af2b75 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:13.435535 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5851505-80c5-4a84-82b6-f16011af2b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:13.472675 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-e5851505-80c5-4a84-82b6-f16011af2b75 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:17:13.474719 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-e5851505-80c5-4a84-82b6-f16011af2b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:13.502852 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1167/2336] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:17:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:17:13.505474 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bf55e-1f6a-4050-a63c-fb7579c1bc23 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:13.520526 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bf55e-1f6a-4050-a63c-fb7579c1bc23 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:13.550190 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c8694-15db-475b-801d-f45d7437ac19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:13.555930 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c8694-15db-475b-801d-f45d7437ac19 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:13.556226 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c8694-15db-475b-801d-f45d7437ac19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:13.556540 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c8694-15db-475b-801d-f45d7437ac19 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:13.557359 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c8694-15db-475b-801d-f45d7437ac19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:17:13.560043 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c8694-15db-475b-801d-f45d7437ac19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:13.561858 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c8694-15db-475b-801d-f45d7437ac19 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:13.601906 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1170/2337] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:17:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:17:13.606387 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5851505-80c5-4a84-82b6-f16011af2b75 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:13.622797 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5851505-80c5-4a84-82b6-f16011af2b75 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:13.643353 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175343f5-dafb-4c51-b4f2-b6ec50db3503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:13.644347 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175343f5-dafb-4c51-b4f2-b6ec50db3503 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:13.644947 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175343f5-dafb-4c51-b4f2-b6ec50db3503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:13.645430 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175343f5-dafb-4c51-b4f2-b6ec50db3503 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:13.646734 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175343f5-dafb-4c51-b4f2-b6ec50db3503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:13.650529 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175343f5-dafb-4c51-b4f2-b6ec50db3503 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:13.822458 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1168/2338] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:17:13 2021] POST /identity/v3/projects => generated 373 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:17:13.826886 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c8694-15db-475b-801d-f45d7437ac19 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:13.895504 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c8694-15db-475b-801d-f45d7437ac19 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:13.958449 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd101e4-93c5-4175-bd6d-28e0b126aa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:13.959566 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd101e4-93c5-4175-bd6d-28e0b126aa98 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:13.960064 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd101e4-93c5-4175-bd6d-28e0b126aa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:13.960525 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd101e4-93c5-4175-bd6d-28e0b126aa98 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:13.961460 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd101e4-93c5-4175-bd6d-28e0b126aa98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:13.969412 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd101e4-93c5-4175-bd6d-28e0b126aa98 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:14.067671 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1171/2339] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:17:13 2021] POST /identity/v3/users => generated 287 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:17:14.074411 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175343f5-dafb-4c51-b4f2-b6ec50db3503 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:14.091051 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175343f5-dafb-4c51-b4f2-b6ec50db3503 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:14.151533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e3720-8381-4b12-818c-223fda0d82fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:14.156537 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e3720-8381-4b12-818c-223fda0d82fd admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:14.161086 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e3720-8381-4b12-818c-223fda0d82fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:14.161086 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e3720-8381-4b12-818c-223fda0d82fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:14.161086 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e3720-8381-4b12-818c-223fda0d82fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:14.163182 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e3720-8381-4b12-818c-223fda0d82fd admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:14.197847 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1169/2340] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:17:14 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:17:14.202612 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd101e4-93c5-4175-bd6d-28e0b126aa98 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:14.224699 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd101e4-93c5-4175-bd6d-28e0b126aa98 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:14.252246 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167bc9e-3bd7-4534-ac59-2e500989cd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:14.257088 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167bc9e-3bd7-4534-ac59-2e500989cd7c admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:14.257088 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167bc9e-3bd7-4534-ac59-2e500989cd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:14.257088 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167bc9e-3bd7-4534-ac59-2e500989cd7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:14.257088 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167bc9e-3bd7-4534-ac59-2e500989cd7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:14.259037 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167bc9e-3bd7-4534-ac59-2e500989cd7c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:14.273204 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1172/2341] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:17:14 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:17:14.279890 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e3720-8381-4b12-818c-223fda0d82fd admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:14.297424 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e3720-8381-4b12-818c-223fda0d82fd admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:14.320668 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe2886-142c-447c-a068-a8321acaa721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:14.321710 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe2886-142c-447c-a068-a8321acaa721 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:14.322117 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe2886-142c-447c-a068-a8321acaa721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:14.322466 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe2886-142c-447c-a068-a8321acaa721 admin admin] PATH_INFO: `/v3/projects/78807cb7ca9445b38b7e896adc10ec2b/users/b20ce08f5765442dbdf399983b8df856/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:14.340565 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe2886-142c-447c-a068-a8321acaa721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78807cb7ca9445b38b7e896adc10ec2b, user_id=b20ce08f5765442dbdf399983b8df856, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:14.343973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe2886-142c-447c-a068-a8321acaa721 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:14.456879 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1170/2342] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:17:14 2021] PUT /identity/v3/projects/78807cb7ca9445b38b7e896adc10ec2b/users/b20ce08f5765442dbdf399983b8df856/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:17:14.461887 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94df00f-45bd-4267-855c-7a02fd5cb65c None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:14.462187 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94df00f-45bd-4267-855c-7a02fd5cb65c None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:14.462484 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94df00f-45bd-4267-855c-7a02fd5cb65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:14.496639 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-d94df00f-45bd-4267-855c-7a02fd5cb65c None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:17:14.497922 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-d94df00f-45bd-4267-855c-7a02fd5cb65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:14.642679 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1173/2343] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:17:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:17:14.643631 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe2886-142c-447c-a068-a8321acaa721 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:14.645486 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-bffe2886-142c-447c-a068-a8321acaa721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:14.777245 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe2886-142c-447c-a068-a8321acaa721 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:14.783173 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5ab4e-689b-427b-9e32-fc010ed79902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:14.784092 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5ab4e-689b-427b-9e32-fc010ed79902 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:14.784569 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5ab4e-689b-427b-9e32-fc010ed79902 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:14.785051 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5ab4e-689b-427b-9e32-fc010ed79902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:14.810474 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5ab4e-689b-427b-9e32-fc010ed79902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:14.812219 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5ab4e-689b-427b-9e32-fc010ed79902 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:14.826775 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1171/2344] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:17:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:17:15.589085 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0fea3-6aa7-4ffc-9331-e2ed059c0173 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:15.589678 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0fea3-6aa7-4ffc-9331-e2ed059c0173 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:15.589678 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0fea3-6aa7-4ffc-9331-e2ed059c0173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:15.641460 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-3ae0fea3-6aa7-4ffc-9331-e2ed059c0173 None None] MFA Rules not processed for user `63784b24c95c4867b726f7a4f433d9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:17:15.649822 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-3ae0fea3-6aa7-4ffc-9331-e2ed059c0173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:15.777128 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1174/2345] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:17:15 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:17:17.964846 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9067875-0065-4633-aad6-04520d787741 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:17.965902 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9067875-0065-4633-aad6-04520d787741 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:17.966406 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9067875-0065-4633-aad6-04520d787741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:18.023872 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-a9067875-0065-4633-aad6-04520d787741 None None] MFA Rules not processed for user `b20ce08f5765442dbdf399983b8df856`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:17:18.025481 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-a9067875-0065-4633-aad6-04520d787741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:18.139070 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1172/2346] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:17:17 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:17:18.150652 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0fea3-6aa7-4ffc-9331-e2ed059c0173 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:18.152206 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-3ae0fea3-6aa7-4ffc-9331-e2ed059c0173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:18.258734 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0fea3-6aa7-4ffc-9331-e2ed059c0173 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:18.268744 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854db83-5407-4e71-ac72-44ac3bc863fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:18.268744 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854db83-5407-4e71-ac72-44ac3bc863fd service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:18.268744 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854db83-5407-4e71-ac72-44ac3bc863fd service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:18.268744 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854db83-5407-4e71-ac72-44ac3bc863fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:18.276043 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854db83-5407-4e71-ac72-44ac3bc863fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:18.277725 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854db83-5407-4e71-ac72-44ac3bc863fd service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:18.288489 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1175/2347] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:17:18 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:17:19.218897 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9067875-0065-4633-aad6-04520d787741 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:19.221063 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-a9067875-0065-4633-aad6-04520d787741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:19.301212 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9067875-0065-4633-aad6-04520d787741 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:19.309774 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22477e19-1c63-4694-89d0-3fb58a75af02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f52add52aa4586aee0b801ceffd764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:19.309774 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22477e19-1c63-4694-89d0-3fb58a75af02 service glance] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:19.309774 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22477e19-1c63-4694-89d0-3fb58a75af02 service glance] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:19.309774 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22477e19-1c63-4694-89d0-3fb58a75af02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:19.310731 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-22477e19-1c63-4694-89d0-3fb58a75af02 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:19.396317 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22477e19-1c63-4694-89d0-3fb58a75af02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:19.397785 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22477e19-1c63-4694-89d0-3fb58a75af02 service glance] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:19.411329 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1173/2348] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:17:19 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:17:19.762772 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fa7a4-944b-4fa5-881c-cf01591c18e1 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:19.763323 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fa7a4-944b-4fa5-881c-cf01591c18e1 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:19.763421 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fa7a4-944b-4fa5-881c-cf01591c18e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:19.786071 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-253fa7a4-944b-4fa5-881c-cf01591c18e1 None None] MFA Rules not processed for user `b68d0745d9cb49a5bd9331148967764a`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:17:19.787761 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-253fa7a4-944b-4fa5-881c-cf01591c18e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:19.870444 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1176/2349] 10.222.0.54 () {58 vars in 1009 bytes} [Tue Nov 23 04:17:19 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:17:19.885969 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22477e19-1c63-4694-89d0-3fb58a75af02 service glance] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:19.887870 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-22477e19-1c63-4694-89d0-3fb58a75af02 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:19.994357 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22477e19-1c63-4694-89d0-3fb58a75af02 service glance] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:20.000852 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d26fc-f96d-48d8-8411-9202d40ce512 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd439c1f0764f4cac7eb641a485937a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:20.001510 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d26fc-f96d-48d8-8411-9202d40ce512 service swift] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:20.001992 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d26fc-f96d-48d8-8411-9202d40ce512 service swift] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:20.002430 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d26fc-f96d-48d8-8411-9202d40ce512 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:20.014326 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d26fc-f96d-48d8-8411-9202d40ce512 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:20.016025 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d26fc-f96d-48d8-8411-9202d40ce512 service swift] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:20.026139 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1174/2350] 10.222.0.54 () {60 vars in 1384 bytes} [Tue Nov 23 04:17:19 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 04:17:20.372867 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6fddf-693b-4883-b724-3553cdeec95f None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:20.373154 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6fddf-693b-4883-b724-3553cdeec95f None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:20.373614 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6fddf-693b-4883-b724-3553cdeec95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:20.404603 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-29e6fddf-693b-4883-b724-3553cdeec95f None None] MFA Rules not processed for user `b20ce08f5765442dbdf399983b8df856`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:17:20.406629 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-29e6fddf-693b-4883-b724-3553cdeec95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:20.418018 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1177/2351] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:17:20 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:17:26.350322 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67be89-6bbe-489e-a7a8-e384c75bcce1 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:26.352173 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67be89-6bbe-489e-a7a8-e384c75bcce1 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:26.352473 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67be89-6bbe-489e-a7a8-e384c75bcce1 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:26.355532 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1175/2352] 10.222.0.54 () {54 vars in 921 bytes} [Tue Nov 23 04:17:26 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:17:26.363886 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347032a2-ee55-4f8c-9ece-4fffd148a3d0 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:26.365736 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347032a2-ee55-4f8c-9ece-4fffd148a3d0 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:26.366969 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347032a2-ee55-4f8c-9ece-4fffd148a3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:26.453339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-347032a2-ee55-4f8c-9ece-4fffd148a3d0 None None] MFA Rules not processed for user `35e14131fb22470cba63cd5e8db359e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:17:26.455034 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-347032a2-ee55-4f8c-9ece-4fffd148a3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:26.716553 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1178/2353] 10.222.0.54 () {58 vars in 1018 bytes} [Tue Nov 23 04:17:26 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:17:26.744582 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67be89-6bbe-489e-a7a8-e384c75bcce1 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:26.795990 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67be89-6bbe-489e-a7a8-e384c75bcce1 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:26.799711 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c167d3-3247-4eb4-8f97-db5556ebdfde service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f52add52aa4586aee0b801ceffd764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:26.800359 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c167d3-3247-4eb4-8f97-db5556ebdfde service glance] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:26.800643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c167d3-3247-4eb4-8f97-db5556ebdfde service glance] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:26.800924 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c167d3-3247-4eb4-8f97-db5556ebdfde service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:26.812864 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c167d3-3247-4eb4-8f97-db5556ebdfde service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:26.814280 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c167d3-3247-4eb4-8f97-db5556ebdfde service glance] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:26.826653 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1176/2354] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:17:26 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:17:27.468478 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f2d7-e53e-43c8-8b16-c6e501e344c7 None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:27.475513 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f2d7-e53e-43c8-8b16-c6e501e344c7 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:27.475513 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f2d7-e53e-43c8-8b16-c6e501e344c7 None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:27.475513 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1179/2355] 10.222.0.54 () {54 vars in 921 bytes} [Tue Nov 23 04:17:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:17:27.480657 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e27c7e-5571-4e1d-be40-9af2f0034ec9 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:27.481200 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e27c7e-5571-4e1d-be40-9af2f0034ec9 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:27.481200 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e27c7e-5571-4e1d-be40-9af2f0034ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:27.504571 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-71e27c7e-5571-4e1d-be40-9af2f0034ec9 None None] MFA Rules not processed for user `5c06e29d656f48c99caeb193975b5b91`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:17:27.506383 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-71e27c7e-5571-4e1d-be40-9af2f0034ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:27.516701 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1177/2356] 10.222.0.54 () {58 vars in 1018 bytes} [Tue Nov 23 04:17:27 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:17:27.533465 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27f2d7-e53e-43c8-8b16-c6e501e344c7 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:27.555986 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27f2d7-e53e-43c8-8b16-c6e501e344c7 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:27.560603 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03875cc-cf7b-4152-bf67-b67cd94d95f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:27.561994 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03875cc-cf7b-4152-bf67-b67cd94d95f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:27.561994 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03875cc-cf7b-4152-bf67-b67cd94d95f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:27.561994 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03875cc-cf7b-4152-bf67-b67cd94d95f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:27.583278 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03875cc-cf7b-4152-bf67-b67cd94d95f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:27.585023 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03875cc-cf7b-4152-bf67-b67cd94d95f4 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:27.601757 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1180/2357] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:17:27 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:17:31.547803 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e27c7e-5571-4e1d-be40-9af2f0034ec9 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:31.549747 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-71e27c7e-5571-4e1d-be40-9af2f0034ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:31.654092 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e27c7e-5571-4e1d-be40-9af2f0034ec9 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:31.659456 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767a43c-c245-41a6-a67b-88f93caedc08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23c3a2a6cfd4492b7d8eaa62dacec94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:31.660125 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767a43c-c245-41a6-a67b-88f93caedc08 service placement] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:31.660581 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767a43c-c245-41a6-a67b-88f93caedc08 service placement] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:31.661068 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767a43c-c245-41a6-a67b-88f93caedc08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:31.662848 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-5767a43c-c245-41a6-a67b-88f93caedc08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:31.684944 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767a43c-c245-41a6-a67b-88f93caedc08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:31.686685 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767a43c-c245-41a6-a67b-88f93caedc08 service placement] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:31.717623 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1178/2358] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:17:31 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:17:33.918399 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03875cc-cf7b-4152-bf67-b67cd94d95f4 service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:33.925649 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-b03875cc-cf7b-4152-bf67-b67cd94d95f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:33.941870 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03875cc-cf7b-4152-bf67-b67cd94d95f4 service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:33.947571 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a0502-5f65-472f-97d1-f931466fd013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:33.948478 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a0502-5f65-472f-97d1-f931466fd013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:33.948766 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a0502-5f65-472f-97d1-f931466fd013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:33.949044 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a0502-5f65-472f-97d1-f931466fd013 admin admin] PATH_INFO: `/v3/users/9ade954e4f9c4904aeecc182d76f997d` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:33.950277 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a0502-5f65-472f-97d1-f931466fd013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ade954e4f9c4904aeecc182d76f997d)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:33.952238 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a0502-5f65-472f-97d1-f931466fd013 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:34.014499 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0723b47-d9d1-430e-bbfe-3a64967d58b6 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:34.015019 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0723b47-d9d1-430e-bbfe-3a64967d58b6 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:34.015349 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0723b47-d9d1-430e-bbfe-3a64967d58b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:34.033528 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-b0723b47-d9d1-430e-bbfe-3a64967d58b6 None None] MFA Rules not processed for user `21a1d655b7be402c9339cfd5d09215f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:17:34.034723 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-b0723b47-d9d1-430e-bbfe-3a64967d58b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:34.043955 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1179/2359] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:17:34 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:17:34.129827 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-7b0a0502-5f65-472f-97d1-f931466fd013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ade954e4f9c4904aeecc182d76f997d'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:34.207563 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-7b0a0502-5f65-472f-97d1-f931466fd013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ade954e4f9c4904aeecc182d76f997d'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:34.217193 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-7b0a0502-5f65-472f-97d1-f931466fd013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ade954e4f9c4904aeecc182d76f997d'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:34.221691 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-7b0a0502-5f65-472f-97d1-f931466fd013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ade954e4f9c4904aeecc182d76f997d'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:34.231626 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-7b0a0502-5f65-472f-97d1-f931466fd013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ade954e4f9c4904aeecc182d76f997d'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:34.243111 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1181/2360] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:17:33 2021] DELETE /identity/v3/users/9ade954e4f9c4904aeecc182d76f997d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:17:34.244396 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb89b64-14ba-4004-85d7-94068916c191 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:34.244689 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb89b64-14ba-4004-85d7-94068916c191 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:34.244971 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb89b64-14ba-4004-85d7-94068916c191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:34.264284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-7fb89b64-14ba-4004-85d7-94068916c191 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:17:34.267411 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-7fb89b64-14ba-4004-85d7-94068916c191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:34.276571 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b0e3e-29cf-434b-9efe-90dfe8e6d4d6 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:34.276863 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b0e3e-29cf-434b-9efe-90dfe8e6d4d6 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:34.277150 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b0e3e-29cf-434b-9efe-90dfe8e6d4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:34.334935 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-003b0e3e-29cf-434b-9efe-90dfe8e6d4d6 None None] MFA Rules not processed for user `b68d0745d9cb49a5bd9331148967764a`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:17:34.336719 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-003b0e3e-29cf-434b-9efe-90dfe8e6d4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:34.350117 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1180/2361] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:17:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:17:34.362219 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb89b64-14ba-4004-85d7-94068916c191 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:34.364745 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-7fb89b64-14ba-4004-85d7-94068916c191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:34.428347 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1182/2362] 10.222.0.54 () {58 vars in 1009 bytes} [Tue Nov 23 04:17:34 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:17:34.441221 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b0e3e-29cf-434b-9efe-90dfe8e6d4d6 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:34.442851 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-003b0e3e-29cf-434b-9efe-90dfe8e6d4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:34.444264 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb89b64-14ba-4004-85d7-94068916c191 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:34.450363 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17293052-6188-4b8b-a7cc-db686f26ed63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:34.451378 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17293052-6188-4b8b-a7cc-db686f26ed63 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:34.451663 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17293052-6188-4b8b-a7cc-db686f26ed63 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:34.451936 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17293052-6188-4b8b-a7cc-db686f26ed63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:34.462236 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17293052-6188-4b8b-a7cc-db686f26ed63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:34.463846 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17293052-6188-4b8b-a7cc-db686f26ed63 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:34.475865 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1181/2363] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:17:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:17:34.559905 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b0e3e-29cf-434b-9efe-90dfe8e6d4d6 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:34.566425 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c895a-0cba-4cad-9bae-d2819f921b13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd439c1f0764f4cac7eb641a485937a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:34.567086 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c895a-0cba-4cad-9bae-d2819f921b13 service swift] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:34.567406 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c895a-0cba-4cad-9bae-d2819f921b13 service swift] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:34.567689 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c895a-0cba-4cad-9bae-d2819f921b13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:34.583539 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c895a-0cba-4cad-9bae-d2819f921b13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:34.586483 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c895a-0cba-4cad-9bae-d2819f921b13 service swift] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:34.596235 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1183/2364] 10.222.0.54 () {60 vars in 1384 bytes} [Tue Nov 23 04:17:34 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 23 04:17:35.143115 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17293052-6188-4b8b-a7cc-db686f26ed63 service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:35.144911 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-17293052-6188-4b8b-a7cc-db686f26ed63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:35.178375 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17293052-6188-4b8b-a7cc-db686f26ed63 service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:35.185837 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481e788-35fa-4235-8e8d-0af56d9fc7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:35.186703 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481e788-35fa-4235-8e8d-0af56d9fc7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:35.186992 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481e788-35fa-4235-8e8d-0af56d9fc7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:35.187312 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481e788-35fa-4235-8e8d-0af56d9fc7d4 admin admin] PATH_INFO: `/v3/projects/1d4133ed319e467793a71af59c9cb798` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:35.190711 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481e788-35fa-4235-8e8d-0af56d9fc7d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d4133ed319e467793a71af59c9cb798)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:35.192851 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481e788-35fa-4235-8e8d-0af56d9fc7d4 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:35.385129 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0481e788-35fa-4235-8e8d-0af56d9fc7d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d4133ed319e467793a71af59c9cb798', 'request_id': 'req-0481e788-35fa-4235-8e8d-0af56d9fc7d4'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:35.394523 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0481e788-35fa-4235-8e8d-0af56d9fc7d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d4133ed319e467793a71af59c9cb798', 'request_id': 'req-0481e788-35fa-4235-8e8d-0af56d9fc7d4'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:35.411656 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0481e788-35fa-4235-8e8d-0af56d9fc7d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d4133ed319e467793a71af59c9cb798', 'request_id': 'req-0481e788-35fa-4235-8e8d-0af56d9fc7d4'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:35.502229 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0481e788-35fa-4235-8e8d-0af56d9fc7d4 admin admin] The token cache is being invalidate because project 1d4133ed319e467793a71af59c9cb798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:17:35.502851 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0481e788-35fa-4235-8e8d-0af56d9fc7d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:35.503717 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0481e788-35fa-4235-8e8d-0af56d9fc7d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:17:35.510418 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1182/2365] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:17:35 2021] DELETE /identity/v3/projects/1d4133ed319e467793a71af59c9cb798 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:17:48.103041 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc1f5a-6dd0-4092-aca9-f575aa843c7a None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:48.103643 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc1f5a-6dd0-4092-aca9-f575aa843c7a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:48.103643 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc1f5a-6dd0-4092-aca9-f575aa843c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:48.123548 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-b1fc1f5a-6dd0-4092-aca9-f575aa843c7a None None] MFA Rules not processed for user `b68d0745d9cb49a5bd9331148967764a`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:17:48.124750 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-b1fc1f5a-6dd0-4092-aca9-f575aa843c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:48.183030 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1184/2366] 10.222.0.54 () {58 vars in 1009 bytes} [Tue Nov 23 04:17:48 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:17:48.207377 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481e788-35fa-4235-8e8d-0af56d9fc7d4 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:17:48.208906 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-0481e788-35fa-4235-8e8d-0af56d9fc7d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:17:48.298342 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481e788-35fa-4235-8e8d-0af56d9fc7d4 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:17:48.303959 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14f021-83e7-4a61-b58c-ed8aa992e268 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd439c1f0764f4cac7eb641a485937a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:17:48.304680 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14f021-83e7-4a61-b58c-ed8aa992e268 service swift] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:17:48.305160 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14f021-83e7-4a61-b58c-ed8aa992e268 service swift] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:17:48.305160 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14f021-83e7-4a61-b58c-ed8aa992e268 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:17:48.316133 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14f021-83e7-4a61-b58c-ed8aa992e268 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:17:48.317871 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14f021-83e7-4a61-b58c-ed8aa992e268 service swift] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:17:48.345692 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1183/2367] 10.222.0.54 () {60 vars in 1384 bytes} [Tue Nov 23 04:17:48 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 04:18:03.711388 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe1c13-4e10-476a-92a1-222003de065f None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:03.713553 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe1c13-4e10-476a-92a1-222003de065f None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:03.713553 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe1c13-4e10-476a-92a1-222003de065f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:03.731285 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-7bbe1c13-4e10-476a-92a1-222003de065f None None] MFA Rules not processed for user `b20ce08f5765442dbdf399983b8df856`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:03.732495 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-7bbe1c13-4e10-476a-92a1-222003de065f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:03.792626 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1185/2368] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:03 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:08.068248 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e800a49-01fc-460d-9a1b-2e89ce0d3cb6 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:08.069203 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e800a49-01fc-460d-9a1b-2e89ce0d3cb6 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:08.070253 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e800a49-01fc-460d-9a1b-2e89ce0d3cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:08.098926 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-0e800a49-01fc-460d-9a1b-2e89ce0d3cb6 None None] MFA Rules not processed for user `b68d0745d9cb49a5bd9331148967764a`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:08.100637 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-0e800a49-01fc-460d-9a1b-2e89ce0d3cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:08.117170 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1184/2369] 10.222.0.54 () {58 vars in 967 bytes} [Tue Nov 23 04:18:08 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:18:08.133661 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe1c13-4e10-476a-92a1-222003de065f None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:08.146132 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe1c13-4e10-476a-92a1-222003de065f None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:08.153225 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4e455-1d87-42d4-a55b-023253149eb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd439c1f0764f4cac7eb641a485937a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:08.153959 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4e455-1d87-42d4-a55b-023253149eb8 service swift] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:08.154306 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4e455-1d87-42d4-a55b-023253149eb8 service swift] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:08.154810 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4e455-1d87-42d4-a55b-023253149eb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:08.164077 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4e455-1d87-42d4-a55b-023253149eb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:08.165771 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4e455-1d87-42d4-a55b-023253149eb8 service swift] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:08.174387 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1186/2370] 10.222.0.54 () {60 vars in 1384 bytes} [Tue Nov 23 04:18:08 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 04:18:19.148801 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e800a49-01fc-460d-9a1b-2e89ce0d3cb6 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:19.148801 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-0e800a49-01fc-460d-9a1b-2e89ce0d3cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:19.228440 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e800a49-01fc-460d-9a1b-2e89ce0d3cb6 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:19.233236 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b657e8a-4b6d-45fc-ad9e-64afa1c932ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:19.234376 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b657e8a-4b6d-45fc-ad9e-64afa1c932ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:19.234725 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b657e8a-4b6d-45fc-ad9e-64afa1c932ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:19.235060 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b657e8a-4b6d-45fc-ad9e-64afa1c932ff admin admin] PATH_INFO: `/v3/users/882a63823deb40dcb93ddc76f81ab9d0` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:19.236398 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b657e8a-4b6d-45fc-ad9e-64afa1c932ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=882a63823deb40dcb93ddc76f81ab9d0)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:19.238780 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b657e8a-4b6d-45fc-ad9e-64afa1c932ff admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:19.468339 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-6b657e8a-4b6d-45fc-ad9e-64afa1c932ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '882a63823deb40dcb93ddc76f81ab9d0'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:19.564018 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-6b657e8a-4b6d-45fc-ad9e-64afa1c932ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '882a63823deb40dcb93ddc76f81ab9d0'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:19.571904 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-6b657e8a-4b6d-45fc-ad9e-64afa1c932ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '882a63823deb40dcb93ddc76f81ab9d0'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:19.572632 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-6b657e8a-4b6d-45fc-ad9e-64afa1c932ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '882a63823deb40dcb93ddc76f81ab9d0'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:19.587030 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-6b657e8a-4b6d-45fc-ad9e-64afa1c932ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '882a63823deb40dcb93ddc76f81ab9d0'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:19.593004 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1185/2371] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:18:19 2021] DELETE /identity/v3/users/882a63823deb40dcb93ddc76f81ab9d0 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:19.864952 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4e455-1d87-42d4-a55b-023253149eb8 service swift] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:19.876690 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4e455-1d87-42d4-a55b-023253149eb8 service swift] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:19.932689 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0a95b-239a-4dc0-a9d9-ff40cca26b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:19.933535 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0a95b-239a-4dc0-a9d9-ff40cca26b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:19.933822 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0a95b-239a-4dc0-a9d9-ff40cca26b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:19.934098 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0a95b-239a-4dc0-a9d9-ff40cca26b3f admin admin] PATH_INFO: `/v3/projects/dc51e914f5e74ceca4086caa5a05b8f0` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:19.935349 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0a95b-239a-4dc0-a9d9-ff40cca26b3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc51e914f5e74ceca4086caa5a05b8f0)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:19.937227 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0a95b-239a-4dc0-a9d9-ff40cca26b3f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:20.063310 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2cc0a95b-239a-4dc0-a9d9-ff40cca26b3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc51e914f5e74ceca4086caa5a05b8f0', 'request_id': 'req-2cc0a95b-239a-4dc0-a9d9-ff40cca26b3f'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:20.066921 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2cc0a95b-239a-4dc0-a9d9-ff40cca26b3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc51e914f5e74ceca4086caa5a05b8f0', 'request_id': 'req-2cc0a95b-239a-4dc0-a9d9-ff40cca26b3f'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:20.072578 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2cc0a95b-239a-4dc0-a9d9-ff40cca26b3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc51e914f5e74ceca4086caa5a05b8f0', 'request_id': 'req-2cc0a95b-239a-4dc0-a9d9-ff40cca26b3f'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:20.169589 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2cc0a95b-239a-4dc0-a9d9-ff40cca26b3f admin admin] The token cache is being invalidate because project dc51e914f5e74ceca4086caa5a05b8f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:18:20.169894 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2cc0a95b-239a-4dc0-a9d9-ff40cca26b3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:20.170496 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2cc0a95b-239a-4dc0-a9d9-ff40cca26b3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:20.172093 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1187/2372] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:18:19 2021] DELETE /identity/v3/projects/dc51e914f5e74ceca4086caa5a05b8f0 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:20.178013 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04fa32-8a3c-488d-a906-1ea40dcdad44 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:20.178477 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04fa32-8a3c-488d-a906-1ea40dcdad44 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:20.178610 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04fa32-8a3c-488d-a906-1ea40dcdad44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:20.197966 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-3f04fa32-8a3c-488d-a906-1ea40dcdad44 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:20.199154 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-3f04fa32-8a3c-488d-a906-1ea40dcdad44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:20.259080 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1186/2373] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:20.267469 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b132b-d5b5-4c9b-ba2c-7b435876b943 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:20.267769 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b132b-d5b5-4c9b-ba2c-7b435876b943 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:20.268048 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b132b-d5b5-4c9b-ba2c-7b435876b943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:20.288541 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-607b132b-d5b5-4c9b-ba2c-7b435876b943 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:20.289846 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-607b132b-d5b5-4c9b-ba2c-7b435876b943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:20.298208 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1188/2374] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:20.302958 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04fa32-8a3c-488d-a906-1ea40dcdad44 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:20.315156 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04fa32-8a3c-488d-a906-1ea40dcdad44 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:20.320742 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74838b1d-e3a8-4397-a845-dda83051e138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:20.321524 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74838b1d-e3a8-4397-a845-dda83051e138 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:20.321844 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74838b1d-e3a8-4397-a845-dda83051e138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:20.322114 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74838b1d-e3a8-4397-a845-dda83051e138 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:20.322854 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74838b1d-e3a8-4397-a845-dda83051e138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:18:20.323176 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74838b1d-e3a8-4397-a845-dda83051e138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:20.324817 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74838b1d-e3a8-4397-a845-dda83051e138 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:20.337304 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1187/2375] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:18:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:18:20.343896 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b132b-d5b5-4c9b-ba2c-7b435876b943 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:20.353891 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b132b-d5b5-4c9b-ba2c-7b435876b943 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:20.359526 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c64e82-9e9a-4b86-98c9-420d15dae16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:20.360179 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c64e82-9e9a-4b86-98c9-420d15dae16c admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:20.360464 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c64e82-9e9a-4b86-98c9-420d15dae16c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:20.360734 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c64e82-9e9a-4b86-98c9-420d15dae16c admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:20.361435 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c64e82-9e9a-4b86-98c9-420d15dae16c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:20.363402 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c64e82-9e9a-4b86-98c9-420d15dae16c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:20.482614 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1189/2376] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:18:20 2021] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:20.486746 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74838b1d-e3a8-4397-a845-dda83051e138 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:20.496579 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74838b1d-e3a8-4397-a845-dda83051e138 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:20.560370 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c80e4-b5ed-4a18-afb0-68402b50edfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:20.561171 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c80e4-b5ed-4a18-afb0-68402b50edfd admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:20.561456 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c80e4-b5ed-4a18-afb0-68402b50edfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:20.561729 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c80e4-b5ed-4a18-afb0-68402b50edfd admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:20.562435 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c80e4-b5ed-4a18-afb0-68402b50edfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:20.564400 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c80e4-b5ed-4a18-afb0-68402b50edfd admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:20.650370 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1188/2377] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:18:20 2021] POST /identity/v3/users => generated 284 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:20.651686 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c64e82-9e9a-4b86-98c9-420d15dae16c admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:20.661885 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c64e82-9e9a-4b86-98c9-420d15dae16c admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:20.669225 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a20f94-f6f5-49ce-9aac-49302cc08118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:20.669908 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a20f94-f6f5-49ce-9aac-49302cc08118 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:20.670196 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a20f94-f6f5-49ce-9aac-49302cc08118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:20.670475 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a20f94-f6f5-49ce-9aac-49302cc08118 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:20.671270 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a20f94-f6f5-49ce-9aac-49302cc08118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:20.672902 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a20f94-f6f5-49ce-9aac-49302cc08118 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:20.686323 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1190/2378] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:20 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:18:20.690253 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c80e4-b5ed-4a18-afb0-68402b50edfd admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:20.701245 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c80e4-b5ed-4a18-afb0-68402b50edfd admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:20.706391 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84aca4-6039-44ed-b29f-3115dc4bf62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:20.707043 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84aca4-6039-44ed-b29f-3115dc4bf62b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:20.707357 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84aca4-6039-44ed-b29f-3115dc4bf62b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:20.707634 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84aca4-6039-44ed-b29f-3115dc4bf62b admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:20.708403 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84aca4-6039-44ed-b29f-3115dc4bf62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:20.710685 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84aca4-6039-44ed-b29f-3115dc4bf62b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:20.721226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1189/2379] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:20 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:18:20.725440 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a20f94-f6f5-49ce-9aac-49302cc08118 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:20.735942 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a20f94-f6f5-49ce-9aac-49302cc08118 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:20.740583 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17beef16-1825-48e2-9836-1ae9c609d341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:20.741760 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17beef16-1825-48e2-9836-1ae9c609d341 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:20.742039 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17beef16-1825-48e2-9836-1ae9c609d341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:20.742310 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17beef16-1825-48e2-9836-1ae9c609d341 admin admin] PATH_INFO: `/v3/projects/a753fb72f1554b0191457171f64167f4/users/977bcc0c16d1499eac810fecdde01477/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:20.758458 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17beef16-1825-48e2-9836-1ae9c609d341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a753fb72f1554b0191457171f64167f4, user_id=977bcc0c16d1499eac810fecdde01477, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:20.761229 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17beef16-1825-48e2-9836-1ae9c609d341 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:20.868466 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1191/2380] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:20 2021] PUT /identity/v3/projects/a753fb72f1554b0191457171f64167f4/users/977bcc0c16d1499eac810fecdde01477/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:20.878646 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e5b47-1389-4534-a725-c5cdf0750213 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:20.878941 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e5b47-1389-4534-a725-c5cdf0750213 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:20.879246 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e5b47-1389-4534-a725-c5cdf0750213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:20.906283 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-318e5b47-1389-4534-a725-c5cdf0750213 None None] MFA Rules not processed for user `977bcc0c16d1499eac810fecdde01477`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:20.907442 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-318e5b47-1389-4534-a725-c5cdf0750213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:20.969432 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1190/2381] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:20 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:20.980239 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17beef16-1825-48e2-9836-1ae9c609d341 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:20.982038 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-17beef16-1825-48e2-9836-1ae9c609d341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:21.040300 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17beef16-1825-48e2-9836-1ae9c609d341 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:21.043986 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72ba53-187d-470d-80b1-fe19a56772ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:21.044626 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72ba53-187d-470d-80b1-fe19a56772ce service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:21.044927 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72ba53-187d-470d-80b1-fe19a56772ce service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:21.045189 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72ba53-187d-470d-80b1-fe19a56772ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:21.054382 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72ba53-187d-470d-80b1-fe19a56772ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:21.055845 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72ba53-187d-470d-80b1-fe19a56772ce service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:21.064915 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1192/2382] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:18:20 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:18:24.047318 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e5b47-1389-4534-a725-c5cdf0750213 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:24.047839 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-318e5b47-1389-4534-a725-c5cdf0750213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:24.115432 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e5b47-1389-4534-a725-c5cdf0750213 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:24.119278 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe389f0-8e79-4ca7-9fc1-c53736fa955b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:24.119925 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe389f0-8e79-4ca7-9fc1-c53736fa955b service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:24.120208 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe389f0-8e79-4ca7-9fc1-c53736fa955b service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:24.120483 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe389f0-8e79-4ca7-9fc1-c53736fa955b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:24.122395 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-0fe389f0-8e79-4ca7-9fc1-c53736fa955b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:24.182801 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe389f0-8e79-4ca7-9fc1-c53736fa955b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:24.184254 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe389f0-8e79-4ca7-9fc1-c53736fa955b service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:24.193442 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1191/2383] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:18:24 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:18:24.223182 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72ba53-187d-470d-80b1-fe19a56772ce service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:24.225250 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-9d72ba53-187d-470d-80b1-fe19a56772ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:24.311796 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72ba53-187d-470d-80b1-fe19a56772ce service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:24.318422 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9620e5-a9f4-4235-a28b-ae4a77f3f5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:24.319430 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9620e5-a9f4-4235-a28b-ae4a77f3f5d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:24.319716 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9620e5-a9f4-4235-a28b-ae4a77f3f5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:24.319994 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9620e5-a9f4-4235-a28b-ae4a77f3f5d9 admin admin] PATH_INFO: `/v3/users/9477961ce0bc4164be46f0a54a309d7c` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:24.321210 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9620e5-a9f4-4235-a28b-ae4a77f3f5d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9477961ce0bc4164be46f0a54a309d7c)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:24.323152 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9620e5-a9f4-4235-a28b-ae4a77f3f5d9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:24.657195 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ad9620e5-a9f4-4235-a28b-ae4a77f3f5d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9477961ce0bc4164be46f0a54a309d7c'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:24.811940 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ad9620e5-a9f4-4235-a28b-ae4a77f3f5d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9477961ce0bc4164be46f0a54a309d7c'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:24.822108 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ad9620e5-a9f4-4235-a28b-ae4a77f3f5d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9477961ce0bc4164be46f0a54a309d7c'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:24.824252 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ad9620e5-a9f4-4235-a28b-ae4a77f3f5d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9477961ce0bc4164be46f0a54a309d7c'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:24.836996 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ad9620e5-a9f4-4235-a28b-ae4a77f3f5d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9477961ce0bc4164be46f0a54a309d7c'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:24.843430 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1193/2384] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:18:24 2021] DELETE /identity/v3/users/9477961ce0bc4164be46f0a54a309d7c => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:25.390325 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe389f0-8e79-4ca7-9fc1-c53736fa955b service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:25.404962 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe389f0-8e79-4ca7-9fc1-c53736fa955b service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:25.472027 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809f4f7-cc16-4817-a821-2a7877e42c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:25.472876 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809f4f7-cc16-4817-a821-2a7877e42c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:25.473158 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809f4f7-cc16-4817-a821-2a7877e42c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:25.473430 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809f4f7-cc16-4817-a821-2a7877e42c4a admin admin] PATH_INFO: `/v3/projects/79d1a358755a4113b0a35cf50d3cc95a` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:25.474659 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809f4f7-cc16-4817-a821-2a7877e42c4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=79d1a358755a4113b0a35cf50d3cc95a)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:25.477211 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809f4f7-cc16-4817-a821-2a7877e42c4a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:25.665933 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c809f4f7-cc16-4817-a821-2a7877e42c4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79d1a358755a4113b0a35cf50d3cc95a', 'request_id': 'req-c809f4f7-cc16-4817-a821-2a7877e42c4a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:25.672559 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c809f4f7-cc16-4817-a821-2a7877e42c4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79d1a358755a4113b0a35cf50d3cc95a', 'request_id': 'req-c809f4f7-cc16-4817-a821-2a7877e42c4a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:25.678171 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c809f4f7-cc16-4817-a821-2a7877e42c4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79d1a358755a4113b0a35cf50d3cc95a', 'request_id': 'req-c809f4f7-cc16-4817-a821-2a7877e42c4a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:25.883930 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c809f4f7-cc16-4817-a821-2a7877e42c4a admin admin] The token cache is being invalidate because project 79d1a358755a4113b0a35cf50d3cc95a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:18:25.884301 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c809f4f7-cc16-4817-a821-2a7877e42c4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:25.885155 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-c809f4f7-cc16-4817-a821-2a7877e42c4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:25.886827 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1192/2385] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:18:25 2021] DELETE /identity/v3/projects/79d1a358755a4113b0a35cf50d3cc95a => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:25.892739 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9dfd8-081f-4f9b-a251-ab3b70238053 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:25.894655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9dfd8-081f-4f9b-a251-ab3b70238053 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:25.894655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9dfd8-081f-4f9b-a251-ab3b70238053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:25.912776 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-6aa9dfd8-081f-4f9b-a251-ab3b70238053 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:25.915693 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-6aa9dfd8-081f-4f9b-a251-ab3b70238053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:25.981326 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1194/2386] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:25.989172 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718704a-a17b-4cd2-9e6a-4972e05b8628 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:25.989471 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718704a-a17b-4cd2-9e6a-4972e05b8628 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:25.989748 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718704a-a17b-4cd2-9e6a-4972e05b8628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:26.009429 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-a718704a-a17b-4cd2-9e6a-4972e05b8628 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:26.010702 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-a718704a-a17b-4cd2-9e6a-4972e05b8628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:26.019537 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1193/2387] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:26.024949 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9dfd8-081f-4f9b-a251-ab3b70238053 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:26.034486 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9dfd8-081f-4f9b-a251-ab3b70238053 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:26.042263 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1e881-bec6-4e1c-9aa1-43b1560784eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:26.042925 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1e881-bec6-4e1c-9aa1-43b1560784eb admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:26.043226 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1e881-bec6-4e1c-9aa1-43b1560784eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:26.043926 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1e881-bec6-4e1c-9aa1-43b1560784eb admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:26.044333 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1e881-bec6-4e1c-9aa1-43b1560784eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:18:26.044661 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1e881-bec6-4e1c-9aa1-43b1560784eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:26.046257 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1e881-bec6-4e1c-9aa1-43b1560784eb admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:26.058891 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1195/2388] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:18:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 04:18:26.063392 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718704a-a17b-4cd2-9e6a-4972e05b8628 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:26.074070 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718704a-a17b-4cd2-9e6a-4972e05b8628 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:26.078876 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85551d-29d7-4c86-86be-36d8c060400c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:26.079561 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85551d-29d7-4c86-86be-36d8c060400c admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:26.079848 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85551d-29d7-4c86-86be-36d8c060400c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:26.080127 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85551d-29d7-4c86-86be-36d8c060400c admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:26.080854 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a85551d-29d7-4c86-86be-36d8c060400c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:26.083015 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a85551d-29d7-4c86-86be-36d8c060400c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:26.193591 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1194/2389] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:18:26 2021] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:26.198609 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1e881-bec6-4e1c-9aa1-43b1560784eb admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:26.211517 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1e881-bec6-4e1c-9aa1-43b1560784eb admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:26.274893 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66431c9f-7ae3-4f67-95d8-0b63c7f260e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:26.275626 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66431c9f-7ae3-4f67-95d8-0b63c7f260e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:26.275907 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66431c9f-7ae3-4f67-95d8-0b63c7f260e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:26.276181 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66431c9f-7ae3-4f67-95d8-0b63c7f260e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:26.276896 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66431c9f-7ae3-4f67-95d8-0b63c7f260e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:26.278839 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66431c9f-7ae3-4f67-95d8-0b63c7f260e8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:26.926573 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1196/2390] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:18:26 2021] POST /identity/v3/users => generated 284 bytes in 728 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:18:26.931656 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85551d-29d7-4c86-86be-36d8c060400c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:26.943841 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85551d-29d7-4c86-86be-36d8c060400c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:26.949826 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0963f15-e9b4-4a1a-9346-0af4bdfe71f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:26.950794 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0963f15-e9b4-4a1a-9346-0af4bdfe71f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:26.950918 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0963f15-e9b4-4a1a-9346-0af4bdfe71f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:26.951202 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0963f15-e9b4-4a1a-9346-0af4bdfe71f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:26.952020 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0963f15-e9b4-4a1a-9346-0af4bdfe71f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:26.954395 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0963f15-e9b4-4a1a-9346-0af4bdfe71f9 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:26.968663 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1195/2391] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:26 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:18:26.976040 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66431c9f-7ae3-4f67-95d8-0b63c7f260e8 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:26.987082 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66431c9f-7ae3-4f67-95d8-0b63c7f260e8 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:26.992401 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867530e-d0eb-4a8d-8d41-ff7363d28048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:26.993078 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867530e-d0eb-4a8d-8d41-ff7363d28048 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:26.993362 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867530e-d0eb-4a8d-8d41-ff7363d28048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:26.993636 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867530e-d0eb-4a8d-8d41-ff7363d28048 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:26.994364 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867530e-d0eb-4a8d-8d41-ff7363d28048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:26.995953 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867530e-d0eb-4a8d-8d41-ff7363d28048 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:27.006066 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1197/2392] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:26 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:18:27.010519 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0963f15-e9b4-4a1a-9346-0af4bdfe71f9 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:27.020869 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0963f15-e9b4-4a1a-9346-0af4bdfe71f9 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:27.025992 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8afd2-d69e-4bbb-a88e-e4fbe18f2ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:27.026860 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8afd2-d69e-4bbb-a88e-e4fbe18f2ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:27.027142 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8afd2-d69e-4bbb-a88e-e4fbe18f2ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:27.027449 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8afd2-d69e-4bbb-a88e-e4fbe18f2ecd admin admin] PATH_INFO: `/v3/projects/e10a83f318414fc498f1d5966f07bd54/users/e70f43ccbf114817a614823398a2f26c/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:27.043512 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8afd2-d69e-4bbb-a88e-e4fbe18f2ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10a83f318414fc498f1d5966f07bd54, user_id=e70f43ccbf114817a614823398a2f26c, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:27.046209 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8afd2-d69e-4bbb-a88e-e4fbe18f2ecd admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:27.149858 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1196/2393] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:27 2021] PUT /identity/v3/projects/e10a83f318414fc498f1d5966f07bd54/users/e70f43ccbf114817a614823398a2f26c/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:18:27.160262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497823a-5eb9-48db-a647-d0491050dabe None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:27.160552 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497823a-5eb9-48db-a647-d0491050dabe None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:27.160832 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497823a-5eb9-48db-a647-d0491050dabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:27.191731 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-b497823a-5eb9-48db-a647-d0491050dabe None None] MFA Rules not processed for user `e70f43ccbf114817a614823398a2f26c`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:27.192091 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-b497823a-5eb9-48db-a647-d0491050dabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:27.260339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1198/2394] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:27 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:18:27.262066 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8afd2-d69e-4bbb-a88e-e4fbe18f2ecd admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:27.336078 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8afd2-d69e-4bbb-a88e-e4fbe18f2ecd admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:27.340804 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473be9d4-2408-4d8d-b420-a6dc56256b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:27.341454 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473be9d4-2408-4d8d-b420-a6dc56256b5f admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:27.341732 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473be9d4-2408-4d8d-b420-a6dc56256b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:27.342011 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473be9d4-2408-4d8d-b420-a6dc56256b5f admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:27.342714 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473be9d4-2408-4d8d-b420-a6dc56256b5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:27.344620 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473be9d4-2408-4d8d-b420-a6dc56256b5f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:27.448713 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1197/2395] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:18:27 2021] POST /identity/v3/projects => generated 367 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:27.451763 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497823a-5eb9-48db-a647-d0491050dabe None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:27.463902 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497823a-5eb9-48db-a647-d0491050dabe None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:27.528099 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a05432-6801-417d-af25-ee38a543ed7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:27.528933 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a05432-6801-417d-af25-ee38a543ed7f admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:27.529374 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a05432-6801-417d-af25-ee38a543ed7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:27.529708 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a05432-6801-417d-af25-ee38a543ed7f admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:27.530566 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a05432-6801-417d-af25-ee38a543ed7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:27.532832 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a05432-6801-417d-af25-ee38a543ed7f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:27.844135 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1199/2396] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:18:27 2021] POST /identity/v3/users => generated 290 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:27.848279 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473be9d4-2408-4d8d-b420-a6dc56256b5f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:27.858572 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473be9d4-2408-4d8d-b420-a6dc56256b5f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:27.863263 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76f25e-5e51-4390-8796-31d7efc99ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:27.863906 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76f25e-5e51-4390-8796-31d7efc99ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:27.864185 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76f25e-5e51-4390-8796-31d7efc99ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:27.864459 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76f25e-5e51-4390-8796-31d7efc99ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:27.865232 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76f25e-5e51-4390-8796-31d7efc99ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:27.867361 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76f25e-5e51-4390-8796-31d7efc99ae7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:27.880111 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1198/2397] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:27 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:18:27.885684 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a05432-6801-417d-af25-ee38a543ed7f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:27.898183 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a05432-6801-417d-af25-ee38a543ed7f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:27.903142 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfc4a2-0e4f-4914-9257-7a8668556c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:27.904056 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfc4a2-0e4f-4914-9257-7a8668556c6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:27.904339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfc4a2-0e4f-4914-9257-7a8668556c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:27.904616 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfc4a2-0e4f-4914-9257-7a8668556c6a admin admin] PATH_INFO: `/v3/projects/9f5e3ccacc1249caab48c842d1b69879/users/e36548b2a3fb4186ab537f9ddf7ef8c0/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:27.920900 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfc4a2-0e4f-4914-9257-7a8668556c6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5e3ccacc1249caab48c842d1b69879, user_id=e36548b2a3fb4186ab537f9ddf7ef8c0, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:27.923760 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfc4a2-0e4f-4914-9257-7a8668556c6a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:28.017307 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1200/2398] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:27 2021] PUT /identity/v3/projects/9f5e3ccacc1249caab48c842d1b69879/users/e36548b2a3fb4186ab537f9ddf7ef8c0/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:28.023142 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76f25e-5e51-4390-8796-31d7efc99ae7 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:28.033165 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76f25e-5e51-4390-8796-31d7efc99ae7 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:28.087906 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20385c8-3e1c-451c-9dd3-eb957696dbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:28.088576 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20385c8-3e1c-451c-9dd3-eb957696dbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:28.088862 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20385c8-3e1c-451c-9dd3-eb957696dbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:28.089143 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20385c8-3e1c-451c-9dd3-eb957696dbb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:28.089905 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20385c8-3e1c-451c-9dd3-eb957696dbb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:28.091500 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20385c8-3e1c-451c-9dd3-eb957696dbb8 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:28.101414 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1199/2399] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:28 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:18:28.105797 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfc4a2-0e4f-4914-9257-7a8668556c6a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:28.116575 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfc4a2-0e4f-4914-9257-7a8668556c6a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:28.121271 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52d63e-f7e0-4a72-be97-13a85241daea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:28.122168 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52d63e-f7e0-4a72-be97-13a85241daea admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:28.122455 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52d63e-f7e0-4a72-be97-13a85241daea admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:28.122731 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52d63e-f7e0-4a72-be97-13a85241daea admin admin] PATH_INFO: `/v3/projects/9f5e3ccacc1249caab48c842d1b69879/users/e36548b2a3fb4186ab537f9ddf7ef8c0/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:28.124845 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52d63e-f7e0-4a72-be97-13a85241daea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5e3ccacc1249caab48c842d1b69879, user_id=e36548b2a3fb4186ab537f9ddf7ef8c0, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:28.127541 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52d63e-f7e0-4a72-be97-13a85241daea admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:28.138562 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1201/2400] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:28 2021] PUT /identity/v3/projects/9f5e3ccacc1249caab48c842d1b69879/users/e36548b2a3fb4186ab537f9ddf7ef8c0/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:28.150214 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60db581-45b7-48cf-b1c8-c0f3820102e3 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:28.150513 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60db581-45b7-48cf-b1c8-c0f3820102e3 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:28.150802 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60db581-45b7-48cf-b1c8-c0f3820102e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:28.177509 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-c60db581-45b7-48cf-b1c8-c0f3820102e3 None None] MFA Rules not processed for user `e36548b2a3fb4186ab537f9ddf7ef8c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:28.179610 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c60db581-45b7-48cf-b1c8-c0f3820102e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:28.248250 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1200/2401] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:28 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:28.258755 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52d63e-f7e0-4a72-be97-13a85241daea admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:28.269566 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-4e52d63e-f7e0-4a72-be97-13a85241daea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:28.319861 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52d63e-f7e0-4a72-be97-13a85241daea admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:28.325747 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0a04b-f836-4e71-a5bd-d6665c7097fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:28.325747 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0a04b-f836-4e71-a5bd-d6665c7097fd service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:28.325747 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0a04b-f836-4e71-a5bd-d6665c7097fd service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:28.325747 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0a04b-f836-4e71-a5bd-d6665c7097fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:28.333750 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0a04b-f836-4e71-a5bd-d6665c7097fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:28.335941 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0a04b-f836-4e71-a5bd-d6665c7097fd service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:28.345208 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1202/2402] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:18:28 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:18:30.503525 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96967c78-0e7d-4d7e-8238-e81ea0696261 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:30.503525 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96967c78-0e7d-4d7e-8238-e81ea0696261 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:30.503525 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96967c78-0e7d-4d7e-8238-e81ea0696261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:30.530365 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-96967c78-0e7d-4d7e-8238-e81ea0696261 None None] MFA Rules not processed for user `b68d0745d9cb49a5bd9331148967764a`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:30.531918 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-96967c78-0e7d-4d7e-8238-e81ea0696261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:30.597976 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1201/2403] 10.222.0.54 () {58 vars in 1009 bytes} [Tue Nov 23 04:18:30 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:30.611789 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0a04b-f836-4e71-a5bd-d6665c7097fd service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:30.613240 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-48f0a04b-f836-4e71-a5bd-d6665c7097fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:30.713192 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0a04b-f836-4e71-a5bd-d6665c7097fd service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:30.727135 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a21f57-0b3c-4ea3-bdeb-dd157a0a87e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd439c1f0764f4cac7eb641a485937a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:30.728355 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a21f57-0b3c-4ea3-bdeb-dd157a0a87e2 service swift] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:30.728855 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a21f57-0b3c-4ea3-bdeb-dd157a0a87e2 service swift] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:30.729357 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a21f57-0b3c-4ea3-bdeb-dd157a0a87e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:30.760170 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a21f57-0b3c-4ea3-bdeb-dd157a0a87e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:30.764106 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a21f57-0b3c-4ea3-bdeb-dd157a0a87e2 service swift] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:30.799274 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1203/2404] 10.222.0.54 () {60 vars in 1384 bytes} [Tue Nov 23 04:18:30 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 04:18:32.028628 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96967c78-0e7d-4d7e-8238-e81ea0696261 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:32.097373 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96967c78-0e7d-4d7e-8238-e81ea0696261 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:32.102889 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc045ee-1ec5-49b9-8040-ec78e53dcf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:32.103793 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc045ee-1ec5-49b9-8040-ec78e53dcf0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:32.104071 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc045ee-1ec5-49b9-8040-ec78e53dcf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:32.104340 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc045ee-1ec5-49b9-8040-ec78e53dcf0c admin admin] PATH_INFO: `/v3/users/e70f43ccbf114817a614823398a2f26c` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:32.105544 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc045ee-1ec5-49b9-8040-ec78e53dcf0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e70f43ccbf114817a614823398a2f26c)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:32.107465 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc045ee-1ec5-49b9-8040-ec78e53dcf0c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:32.369969 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-5cc045ee-1ec5-49b9-8040-ec78e53dcf0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e70f43ccbf114817a614823398a2f26c'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:32.484049 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-5cc045ee-1ec5-49b9-8040-ec78e53dcf0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e70f43ccbf114817a614823398a2f26c'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:32.492833 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-5cc045ee-1ec5-49b9-8040-ec78e53dcf0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e70f43ccbf114817a614823398a2f26c'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:32.493669 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-5cc045ee-1ec5-49b9-8040-ec78e53dcf0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e70f43ccbf114817a614823398a2f26c'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:32.507371 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-5cc045ee-1ec5-49b9-8040-ec78e53dcf0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e70f43ccbf114817a614823398a2f26c'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:32.518329 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1202/2405] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:18:32 2021] DELETE /identity/v3/users/e70f43ccbf114817a614823398a2f26c => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:32.523024 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96213166-519c-4bb8-8aaf-471fe57bc6dd None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:32.523506 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96213166-519c-4bb8-8aaf-471fe57bc6dd None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:32.523662 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96213166-519c-4bb8-8aaf-471fe57bc6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:32.543400 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-96213166-519c-4bb8-8aaf-471fe57bc6dd None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:32.544963 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-96213166-519c-4bb8-8aaf-471fe57bc6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:32.618732 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1204/2406] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:32.631226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc045ee-1ec5-49b9-8040-ec78e53dcf0c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:32.634196 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-5cc045ee-1ec5-49b9-8040-ec78e53dcf0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:32.708636 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc045ee-1ec5-49b9-8040-ec78e53dcf0c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:32.714736 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4404fc-d85c-4c2e-b57e-3c4a5ec568c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:32.716220 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4404fc-d85c-4c2e-b57e-3c4a5ec568c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:32.716733 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4404fc-d85c-4c2e-b57e-3c4a5ec568c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:32.717117 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4404fc-d85c-4c2e-b57e-3c4a5ec568c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:32.729777 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4404fc-d85c-4c2e-b57e-3c4a5ec568c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:32.731556 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4404fc-d85c-4c2e-b57e-3c4a5ec568c2 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:32.742527 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1203/2407] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:18:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:18:33.274813 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96213166-519c-4bb8-8aaf-471fe57bc6dd None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:33.276693 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-96213166-519c-4bb8-8aaf-471fe57bc6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:33.302517 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96213166-519c-4bb8-8aaf-471fe57bc6dd None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:33.308506 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb7eef-aa6f-46c8-859a-d75441dba7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:33.310067 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb7eef-aa6f-46c8-859a-d75441dba7eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:33.310374 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb7eef-aa6f-46c8-859a-d75441dba7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:33.310659 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb7eef-aa6f-46c8-859a-d75441dba7eb admin admin] PATH_INFO: `/v3/projects/e10a83f318414fc498f1d5966f07bd54` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:33.316515 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb7eef-aa6f-46c8-859a-d75441dba7eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e10a83f318414fc498f1d5966f07bd54)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:33.319794 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb7eef-aa6f-46c8-859a-d75441dba7eb admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:33.481904 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-32cb7eef-aa6f-46c8-859a-d75441dba7eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e10a83f318414fc498f1d5966f07bd54', 'request_id': 'req-32cb7eef-aa6f-46c8-859a-d75441dba7eb'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:33.488618 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-32cb7eef-aa6f-46c8-859a-d75441dba7eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e10a83f318414fc498f1d5966f07bd54', 'request_id': 'req-32cb7eef-aa6f-46c8-859a-d75441dba7eb'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:33.495131 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-32cb7eef-aa6f-46c8-859a-d75441dba7eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e10a83f318414fc498f1d5966f07bd54', 'request_id': 'req-32cb7eef-aa6f-46c8-859a-d75441dba7eb'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:33.590006 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-32cb7eef-aa6f-46c8-859a-d75441dba7eb admin admin] The token cache is being invalidate because project e10a83f318414fc498f1d5966f07bd54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:18:33.591995 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-32cb7eef-aa6f-46c8-859a-d75441dba7eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:33.593293 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-32cb7eef-aa6f-46c8-859a-d75441dba7eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:33.599826 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1205/2408] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:18:33 2021] DELETE /identity/v3/projects/e10a83f318414fc498f1d5966f07bd54 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:33.601340 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4404fc-d85c-4c2e-b57e-3c4a5ec568c2 service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:33.612412 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4404fc-d85c-4c2e-b57e-3c4a5ec568c2 service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:33.676679 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a59ea-7c08-407e-ae40-245a53cd143e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:33.677451 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a59ea-7c08-407e-ae40-245a53cd143e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:33.677908 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a59ea-7c08-407e-ae40-245a53cd143e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:33.678372 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a59ea-7c08-407e-ae40-245a53cd143e admin admin] PATH_INFO: `/v3/users/e36548b2a3fb4186ab537f9ddf7ef8c0` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:33.680577 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a59ea-7c08-407e-ae40-245a53cd143e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e36548b2a3fb4186ab537f9ddf7ef8c0)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:33.683606 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a59ea-7c08-407e-ae40-245a53cd143e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:33.931272 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-706a59ea-7c08-407e-ae40-245a53cd143e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e36548b2a3fb4186ab537f9ddf7ef8c0'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:34.024103 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-706a59ea-7c08-407e-ae40-245a53cd143e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e36548b2a3fb4186ab537f9ddf7ef8c0'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:34.033014 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-706a59ea-7c08-407e-ae40-245a53cd143e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e36548b2a3fb4186ab537f9ddf7ef8c0'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:34.033744 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-706a59ea-7c08-407e-ae40-245a53cd143e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e36548b2a3fb4186ab537f9ddf7ef8c0'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:34.051496 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-706a59ea-7c08-407e-ae40-245a53cd143e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e36548b2a3fb4186ab537f9ddf7ef8c0'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:34.060910 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1204/2409] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:18:33 2021] DELETE /identity/v3/users/e36548b2a3fb4186ab537f9ddf7ef8c0 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:18:34.713198 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb7eef-aa6f-46c8-859a-d75441dba7eb admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:34.713832 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-32cb7eef-aa6f-46c8-859a-d75441dba7eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:34.730785 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb7eef-aa6f-46c8-859a-d75441dba7eb admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:34.798014 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39ba82-e33e-4f4d-b6e6-28e6d582757e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:34.799267 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39ba82-e33e-4f4d-b6e6-28e6d582757e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:34.799766 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39ba82-e33e-4f4d-b6e6-28e6d582757e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:34.800275 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39ba82-e33e-4f4d-b6e6-28e6d582757e admin admin] PATH_INFO: `/v3/projects/9f5e3ccacc1249caab48c842d1b69879` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:34.802394 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39ba82-e33e-4f4d-b6e6-28e6d582757e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f5e3ccacc1249caab48c842d1b69879)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:34.804769 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39ba82-e33e-4f4d-b6e6-28e6d582757e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:34.934037 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-1e39ba82-e33e-4f4d-b6e6-28e6d582757e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f5e3ccacc1249caab48c842d1b69879', 'request_id': 'req-1e39ba82-e33e-4f4d-b6e6-28e6d582757e'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:34.940535 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-1e39ba82-e33e-4f4d-b6e6-28e6d582757e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f5e3ccacc1249caab48c842d1b69879', 'request_id': 'req-1e39ba82-e33e-4f4d-b6e6-28e6d582757e'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:34.947103 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-1e39ba82-e33e-4f4d-b6e6-28e6d582757e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f5e3ccacc1249caab48c842d1b69879', 'request_id': 'req-1e39ba82-e33e-4f4d-b6e6-28e6d582757e'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:35.024126 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-1e39ba82-e33e-4f4d-b6e6-28e6d582757e admin admin] The token cache is being invalidate because project 9f5e3ccacc1249caab48c842d1b69879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:18:35.024583 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-1e39ba82-e33e-4f4d-b6e6-28e6d582757e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:35.025726 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-1e39ba82-e33e-4f4d-b6e6-28e6d582757e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:35.031247 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1206/2410] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:18:34 2021] DELETE /identity/v3/projects/9f5e3ccacc1249caab48c842d1b69879 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:35.034642 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5dcb9-5887-4be7-95e4-fe4bb7d5dfcd None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:35.035094 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5dcb9-5887-4be7-95e4-fe4bb7d5dfcd None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:35.035546 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5dcb9-5887-4be7-95e4-fe4bb7d5dfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:35.059825 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-ead5dcb9-5887-4be7-95e4-fe4bb7d5dfcd None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:35.059825 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-ead5dcb9-5887-4be7-95e4-fe4bb7d5dfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:35.136858 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1205/2411] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:35.145175 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd701a0b-8139-40e1-aae2-770b5f2a3b36 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:35.145468 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd701a0b-8139-40e1-aae2-770b5f2a3b36 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:35.145750 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd701a0b-8139-40e1-aae2-770b5f2a3b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:35.166578 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-fd701a0b-8139-40e1-aae2-770b5f2a3b36 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:35.168178 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-fd701a0b-8139-40e1-aae2-770b5f2a3b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:35.179517 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1207/2412] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:35.184423 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5dcb9-5887-4be7-95e4-fe4bb7d5dfcd None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:35.200483 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5dcb9-5887-4be7-95e4-fe4bb7d5dfcd None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:35.205512 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109d945-7417-412b-a8fa-3ee49b72a85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:35.206262 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109d945-7417-412b-a8fa-3ee49b72a85a admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:35.208805 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109d945-7417-412b-a8fa-3ee49b72a85a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:35.208805 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109d945-7417-412b-a8fa-3ee49b72a85a admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:35.208805 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109d945-7417-412b-a8fa-3ee49b72a85a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:18:35.208805 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109d945-7417-412b-a8fa-3ee49b72a85a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:35.211434 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109d945-7417-412b-a8fa-3ee49b72a85a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:35.227387 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1206/2413] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:18:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:18:35.229582 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd701a0b-8139-40e1-aae2-770b5f2a3b36 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:35.239636 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd701a0b-8139-40e1-aae2-770b5f2a3b36 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:35.245518 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a6b56-a84a-4424-98be-ff47bbc0bc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:35.246084 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a6b56-a84a-4424-98be-ff47bbc0bc92 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:35.246258 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a6b56-a84a-4424-98be-ff47bbc0bc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:35.246692 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a6b56-a84a-4424-98be-ff47bbc0bc92 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:35.247258 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a6b56-a84a-4424-98be-ff47bbc0bc92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:35.249126 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a6b56-a84a-4424-98be-ff47bbc0bc92 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:35.379749 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1208/2414] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:18:35 2021] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:18:35.381068 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109d945-7417-412b-a8fa-3ee49b72a85a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:35.392837 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109d945-7417-412b-a8fa-3ee49b72a85a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:35.470447 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fb1d3-67a4-402b-ae5b-8095d5e5980b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:35.471688 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fb1d3-67a4-402b-ae5b-8095d5e5980b admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:35.472341 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fb1d3-67a4-402b-ae5b-8095d5e5980b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:35.472936 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fb1d3-67a4-402b-ae5b-8095d5e5980b admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:35.474070 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4fb1d3-67a4-402b-ae5b-8095d5e5980b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:35.477482 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4fb1d3-67a4-402b-ae5b-8095d5e5980b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:35.631100 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1207/2415] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:18:35 2021] POST /identity/v3/users => generated 294 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:35.632767 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a6b56-a84a-4424-98be-ff47bbc0bc92 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:35.644001 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a6b56-a84a-4424-98be-ff47bbc0bc92 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:35.651530 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fe10d-9296-4b49-a31f-0766cf3b3806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:35.652284 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fe10d-9296-4b49-a31f-0766cf3b3806 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:35.652809 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fe10d-9296-4b49-a31f-0766cf3b3806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:35.653164 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fe10d-9296-4b49-a31f-0766cf3b3806 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:35.654923 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fe10d-9296-4b49-a31f-0766cf3b3806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:35.655966 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fe10d-9296-4b49-a31f-0766cf3b3806 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:35.684418 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fb1d3-67a4-402b-ae5b-8095d5e5980b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:35.686398 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-0e4fb1d3-67a4-402b-ae5b-8095d5e5980b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:35.700526 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1209/2416] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:35 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:18:35.703310 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fe10d-9296-4b49-a31f-0766cf3b3806 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:35.707092 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fb1d3-67a4-402b-ae5b-8095d5e5980b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:35.713619 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10298a0-c243-45ab-8f14-360766fc5d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:35.714785 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10298a0-c243-45ab-8f14-360766fc5d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:35.715581 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10298a0-c243-45ab-8f14-360766fc5d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:35.716094 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10298a0-c243-45ab-8f14-360766fc5d92 admin admin] PATH_INFO: `/v3/users/977bcc0c16d1499eac810fecdde01477` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:35.716317 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fe10d-9296-4b49-a31f-0766cf3b3806 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:35.718699 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10298a0-c243-45ab-8f14-360766fc5d92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=977bcc0c16d1499eac810fecdde01477)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:35.721270 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10298a0-c243-45ab-8f14-360766fc5d92 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:35.723022 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff4bd8-0d8c-4848-8918-82f5437559ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:35.723991 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff4bd8-0d8c-4848-8918-82f5437559ad admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:35.724479 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff4bd8-0d8c-4848-8918-82f5437559ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:35.724795 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff4bd8-0d8c-4848-8918-82f5437559ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:35.726062 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff4bd8-0d8c-4848-8918-82f5437559ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:35.727991 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff4bd8-0d8c-4848-8918-82f5437559ad admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:35.740544 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1210/2417] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:35 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:18:35.745401 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff4bd8-0d8c-4848-8918-82f5437559ad admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:35.758438 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff4bd8-0d8c-4848-8918-82f5437559ad admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:35.765273 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285b3e8-4bec-40ec-8ef4-4cbceac82502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:35.766654 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285b3e8-4bec-40ec-8ef4-4cbceac82502 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:35.767342 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285b3e8-4bec-40ec-8ef4-4cbceac82502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:35.767846 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285b3e8-4bec-40ec-8ef4-4cbceac82502 admin admin] PATH_INFO: `/v3/projects/f43de6edf73e4fb9b53232f12bed2103/users/92d048fb753044c6a539969539db33f4/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:35.788216 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285b3e8-4bec-40ec-8ef4-4cbceac82502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43de6edf73e4fb9b53232f12bed2103, user_id=92d048fb753044c6a539969539db33f4, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:35.791710 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285b3e8-4bec-40ec-8ef4-4cbceac82502 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:35.920885 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1211/2418] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:35 2021] PUT /identity/v3/projects/f43de6edf73e4fb9b53232f12bed2103/users/92d048fb753044c6a539969539db33f4/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:35.923522 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fede7-bc91-4984-a788-17baf1aca730 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:35.924119 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fede7-bc91-4984-a788-17baf1aca730 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:35.924779 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fede7-bc91-4984-a788-17baf1aca730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:35.948379 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-d10298a0-c243-45ab-8f14-360766fc5d92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '977bcc0c16d1499eac810fecdde01477'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:35.969356 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-3a7fede7-bc91-4984-a788-17baf1aca730 None None] MFA Rules not processed for user `92d048fb753044c6a539969539db33f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:35.970733 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-3a7fede7-bc91-4984-a788-17baf1aca730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:36.034873 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-d10298a0-c243-45ab-8f14-360766fc5d92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '977bcc0c16d1499eac810fecdde01477'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:36.045185 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-d10298a0-c243-45ab-8f14-360766fc5d92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '977bcc0c16d1499eac810fecdde01477'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:36.046012 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-d10298a0-c243-45ab-8f14-360766fc5d92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '977bcc0c16d1499eac810fecdde01477'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:36.057450 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1212/2419] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:35 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:36.062560 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fede7-bc91-4984-a788-17baf1aca730 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:36.068435 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-d10298a0-c243-45ab-8f14-360766fc5d92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '977bcc0c16d1499eac810fecdde01477'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:36.077528 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1208/2420] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:18:35 2021] DELETE /identity/v3/users/977bcc0c16d1499eac810fecdde01477 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:36.085288 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3730a7a-7043-4431-87dd-5c9d6a969f8e None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:36.085891 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3730a7a-7043-4431-87dd-5c9d6a969f8e None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:36.086497 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3730a7a-7043-4431-87dd-5c9d6a969f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:36.106875 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-d3730a7a-7043-4431-87dd-5c9d6a969f8e None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:36.108575 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-d3730a7a-7043-4431-87dd-5c9d6a969f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:36.146484 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fede7-bc91-4984-a788-17baf1aca730 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:36.193821 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1209/2421] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:36.207267 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3730a7a-7043-4431-87dd-5c9d6a969f8e None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:36.207267 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-d3730a7a-7043-4431-87dd-5c9d6a969f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:36.219955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c159a-a4cb-4e08-902b-7a3e870f3350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:36.220819 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c159a-a4cb-4e08-902b-7a3e870f3350 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:36.221112 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c159a-a4cb-4e08-902b-7a3e870f3350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:36.221419 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c159a-a4cb-4e08-902b-7a3e870f3350 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:36.222969 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c159a-a4cb-4e08-902b-7a3e870f3350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:36.225838 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c159a-a4cb-4e08-902b-7a3e870f3350 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:36.283167 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3730a7a-7043-4431-87dd-5c9d6a969f8e None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:36.286941 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e651e36-546b-4481-aabd-023ffc2d8aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:36.288488 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e651e36-546b-4481-aabd-023ffc2d8aea service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:36.288894 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e651e36-546b-4481-aabd-023ffc2d8aea service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:36.289279 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e651e36-546b-4481-aabd-023ffc2d8aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:36.301291 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e651e36-546b-4481-aabd-023ffc2d8aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:36.303528 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e651e36-546b-4481-aabd-023ffc2d8aea service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:36.314771 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1210/2422] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:18:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:18:36.329063 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1213/2423] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:18:36 2021] POST /identity/v3/projects => generated 383 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:36.333874 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e651e36-546b-4481-aabd-023ffc2d8aea service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:36.337199 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-1e651e36-546b-4481-aabd-023ffc2d8aea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:36.363355 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e651e36-546b-4481-aabd-023ffc2d8aea service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:36.463349 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b70dc-5c12-44ed-9dc3-1b62835e3ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:36.464284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b70dc-5c12-44ed-9dc3-1b62835e3ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:36.464743 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b70dc-5c12-44ed-9dc3-1b62835e3ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:36.465189 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b70dc-5c12-44ed-9dc3-1b62835e3ff4 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:36.465936 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b70dc-5c12-44ed-9dc3-1b62835e3ff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:36.467979 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b70dc-5c12-44ed-9dc3-1b62835e3ff4 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:36.581294 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1211/2424] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:18:36 2021] POST /identity/v3/users => generated 298 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:36.583287 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c159a-a4cb-4e08-902b-7a3e870f3350 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:36.597356 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c159a-a4cb-4e08-902b-7a3e870f3350 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:36.608677 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a12ac-71e9-4fdf-819d-75a976b78044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:36.608677 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a12ac-71e9-4fdf-819d-75a976b78044 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:36.608677 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a12ac-71e9-4fdf-819d-75a976b78044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:36.611164 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a12ac-71e9-4fdf-819d-75a976b78044 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:36.612784 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a12ac-71e9-4fdf-819d-75a976b78044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:36.614784 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a12ac-71e9-4fdf-819d-75a976b78044 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:36.655327 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1214/2425] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:36 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:18:36.659293 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b70dc-5c12-44ed-9dc3-1b62835e3ff4 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:36.670766 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b70dc-5c12-44ed-9dc3-1b62835e3ff4 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:36.681133 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038c0b5-b5bb-43d3-b21f-06e2374567e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:36.682049 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038c0b5-b5bb-43d3-b21f-06e2374567e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:36.682385 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038c0b5-b5bb-43d3-b21f-06e2374567e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:36.682662 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038c0b5-b5bb-43d3-b21f-06e2374567e2 admin admin] PATH_INFO: `/v3/projects/52bd8cf508ce4fe588d2e3309beadce8/users/2b02061d3b714786b73ad9bba1cf15e4/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:36.714745 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038c0b5-b5bb-43d3-b21f-06e2374567e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52bd8cf508ce4fe588d2e3309beadce8, user_id=2b02061d3b714786b73ad9bba1cf15e4, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:36.718033 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038c0b5-b5bb-43d3-b21f-06e2374567e2 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:36.889974 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1212/2426] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:36 2021] PUT /identity/v3/projects/52bd8cf508ce4fe588d2e3309beadce8/users/2b02061d3b714786b73ad9bba1cf15e4/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:18:36.894551 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a12ac-71e9-4fdf-819d-75a976b78044 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:36.905579 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a12ac-71e9-4fdf-819d-75a976b78044 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:36.975484 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038c0b5-b5bb-43d3-b21f-06e2374567e2 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:36.978301 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-7038c0b5-b5bb-43d3-b21f-06e2374567e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:36.986611 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a757f-1e71-4eca-bc28-c1301c0788ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:36.987168 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a757f-1e71-4eca-bc28-c1301c0788ba admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:36.987668 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a757f-1e71-4eca-bc28-c1301c0788ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:36.988632 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a757f-1e71-4eca-bc28-c1301c0788ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:36.990461 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a757f-1e71-4eca-bc28-c1301c0788ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:36.993690 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a757f-1e71-4eca-bc28-c1301c0788ba admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:37.000428 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038c0b5-b5bb-43d3-b21f-06e2374567e2 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:37.009803 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1215/2427] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:36 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:18:37.011522 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a757f-1e71-4eca-bc28-c1301c0788ba admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:37.012447 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343aadf3-1045-40ad-a937-faa324e15370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:37.013228 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343aadf3-1045-40ad-a937-faa324e15370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:37.013638 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343aadf3-1045-40ad-a937-faa324e15370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:37.015064 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343aadf3-1045-40ad-a937-faa324e15370 admin admin] PATH_INFO: `/v3/projects/a753fb72f1554b0191457171f64167f4` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:37.016710 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343aadf3-1045-40ad-a937-faa324e15370 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a753fb72f1554b0191457171f64167f4)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:37.026439 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343aadf3-1045-40ad-a937-faa324e15370 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:37.034223 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a757f-1e71-4eca-bc28-c1301c0788ba admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:37.044677 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69291ace-3029-4285-9d9f-0fa93feadb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:37.045964 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69291ace-3029-4285-9d9f-0fa93feadb15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:37.046419 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69291ace-3029-4285-9d9f-0fa93feadb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:37.046728 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69291ace-3029-4285-9d9f-0fa93feadb15 admin admin] PATH_INFO: `/v3/projects/52bd8cf508ce4fe588d2e3309beadce8/users/2b02061d3b714786b73ad9bba1cf15e4/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:37.049470 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69291ace-3029-4285-9d9f-0fa93feadb15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52bd8cf508ce4fe588d2e3309beadce8, user_id=2b02061d3b714786b73ad9bba1cf15e4, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:37.052448 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69291ace-3029-4285-9d9f-0fa93feadb15 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:37.065244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1216/2428] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:37 2021] PUT /identity/v3/projects/52bd8cf508ce4fe588d2e3309beadce8/users/2b02061d3b714786b73ad9bba1cf15e4/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:18:37.079864 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b9e53-ab98-4f6b-869a-56530c64663a None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:37.080168 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b9e53-ab98-4f6b-869a-56530c64663a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:37.080455 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b9e53-ab98-4f6b-869a-56530c64663a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:37.111320 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-bc6b9e53-ab98-4f6b-869a-56530c64663a None None] MFA Rules not processed for user `2b02061d3b714786b73ad9bba1cf15e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:37.115318 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-bc6b9e53-ab98-4f6b-869a-56530c64663a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:37.160709 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-343aadf3-1045-40ad-a937-faa324e15370 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a753fb72f1554b0191457171f64167f4', 'request_id': 'req-343aadf3-1045-40ad-a937-faa324e15370'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:37.169769 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-343aadf3-1045-40ad-a937-faa324e15370 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a753fb72f1554b0191457171f64167f4', 'request_id': 'req-343aadf3-1045-40ad-a937-faa324e15370'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:37.175741 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-343aadf3-1045-40ad-a937-faa324e15370 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a753fb72f1554b0191457171f64167f4', 'request_id': 'req-343aadf3-1045-40ad-a937-faa324e15370'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:37.192679 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1217/2429] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:37 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:37.206301 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b9e53-ab98-4f6b-869a-56530c64663a None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:37.207893 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-bc6b9e53-ab98-4f6b-869a-56530c64663a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:37.264362 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-343aadf3-1045-40ad-a937-faa324e15370 admin admin] The token cache is being invalidate because project a753fb72f1554b0191457171f64167f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:18:37.264778 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-343aadf3-1045-40ad-a937-faa324e15370 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:37.265364 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-343aadf3-1045-40ad-a937-faa324e15370 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:37.271562 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1213/2430] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:18:36 2021] DELETE /identity/v3/projects/a753fb72f1554b0191457171f64167f4 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:37.274105 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df203008-adc2-4ad7-a90e-fe6230f3b0c3 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:37.274398 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df203008-adc2-4ad7-a90e-fe6230f3b0c3 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:37.274773 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df203008-adc2-4ad7-a90e-fe6230f3b0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:37.277505 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b9e53-ab98-4f6b-869a-56530c64663a None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:37.301852 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-df203008-adc2-4ad7-a90e-fe6230f3b0c3 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:37.303503 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-df203008-adc2-4ad7-a90e-fe6230f3b0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:37.345403 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4be23-e546-47ca-aef5-e1026f40b0c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:37.346051 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4be23-e546-47ca-aef5-e1026f40b0c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:37.346342 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4be23-e546-47ca-aef5-e1026f40b0c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:37.346623 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4be23-e546-47ca-aef5-e1026f40b0c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:37.348486 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-fed4be23-e546-47ca-aef5-e1026f40b0c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:37.377572 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1214/2431] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:18:37.386008 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad689f-f79c-4111-9c3b-e2f22bc217fe None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:37.386297 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad689f-f79c-4111-9c3b-e2f22bc217fe None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:37.386582 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad689f-f79c-4111-9c3b-e2f22bc217fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:37.404870 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-4bad689f-f79c-4111-9c3b-e2f22bc217fe None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:37.406090 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-4bad689f-f79c-4111-9c3b-e2f22bc217fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:37.416172 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1215/2432] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:18:37.420583 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4be23-e546-47ca-aef5-e1026f40b0c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:37.421729 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad689f-f79c-4111-9c3b-e2f22bc217fe None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:37.422041 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4be23-e546-47ca-aef5-e1026f40b0c1 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:37.432537 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad689f-f79c-4111-9c3b-e2f22bc217fe None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:37.434007 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1218/2433] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:18:37 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:18:37.437989 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ef8f6-ecb4-4cc4-b9d1-af18857fd780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:37.438723 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ef8f6-ecb4-4cc4-b9d1-af18857fd780 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:37.439011 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ef8f6-ecb4-4cc4-b9d1-af18857fd780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:37.439324 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ef8f6-ecb4-4cc4-b9d1-af18857fd780 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:37.440138 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ef8f6-ecb4-4cc4-b9d1-af18857fd780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:18:37.440380 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ef8f6-ecb4-4cc4-b9d1-af18857fd780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:37.442077 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ef8f6-ecb4-4cc4-b9d1-af18857fd780 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:37.455523 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1216/2434] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:18:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 04:18:37.460693 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4be23-e546-47ca-aef5-e1026f40b0c1 service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:37.465173 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ef8f6-ecb4-4cc4-b9d1-af18857fd780 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:37.466912 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-eb3ef8f6-ecb4-4cc4-b9d1-af18857fd780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:37.471382 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4be23-e546-47ca-aef5-e1026f40b0c1 service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:37.476156 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f58bc-56aa-4ff6-bc0d-5f08d4ec4b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:37.476803 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f58bc-56aa-4ff6-bc0d-5f08d4ec4b79 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:37.477081 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f58bc-56aa-4ff6-bc0d-5f08d4ec4b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:37.477357 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f58bc-56aa-4ff6-bc0d-5f08d4ec4b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:37.478136 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f58bc-56aa-4ff6-bc0d-5f08d4ec4b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:37.479384 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ef8f6-ecb4-4cc4-b9d1-af18857fd780 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:37.480124 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f58bc-56aa-4ff6-bc0d-5f08d4ec4b79 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:37.484004 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a7e49-d04c-4d64-8a65-e38e1d3ef847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:37.485034 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a7e49-d04c-4d64-8a65-e38e1d3ef847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:37.485283 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a7e49-d04c-4d64-8a65-e38e1d3ef847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:37.485566 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a7e49-d04c-4d64-8a65-e38e1d3ef847 admin admin] PATH_INFO: `/v3/users/92d048fb753044c6a539969539db33f4` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:37.486771 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a7e49-d04c-4d64-8a65-e38e1d3ef847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92d048fb753044c6a539969539db33f4)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:37.488728 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a7e49-d04c-4d64-8a65-e38e1d3ef847 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:37.577771 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1219/2435] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:18:37 2021] POST /identity/v3/projects => generated 405 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:37.581958 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f58bc-56aa-4ff6-bc0d-5f08d4ec4b79 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:37.643452 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f58bc-56aa-4ff6-bc0d-5f08d4ec4b79 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:37.648473 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391da51-cb72-4a9e-982f-92edee6e0b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:37.649137 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391da51-cb72-4a9e-982f-92edee6e0b31 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:37.649431 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391da51-cb72-4a9e-982f-92edee6e0b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:37.649701 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391da51-cb72-4a9e-982f-92edee6e0b31 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:37.650556 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391da51-cb72-4a9e-982f-92edee6e0b31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:37.652480 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391da51-cb72-4a9e-982f-92edee6e0b31 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:37.712104 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0e6a7e49-d04c-4d64-8a65-e38e1d3ef847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92d048fb753044c6a539969539db33f4'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:37.784032 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1220/2436] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:18:37 2021] POST /identity/v3/users => generated 303 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:18:37.788268 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391da51-cb72-4a9e-982f-92edee6e0b31 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:37.798469 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391da51-cb72-4a9e-982f-92edee6e0b31 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:37.805791 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88361f-e46b-4803-964f-7906ada39648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:37.806492 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88361f-e46b-4803-964f-7906ada39648 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:37.806781 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88361f-e46b-4803-964f-7906ada39648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:37.807061 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88361f-e46b-4803-964f-7906ada39648 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:37.807848 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88361f-e46b-4803-964f-7906ada39648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:37.809441 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88361f-e46b-4803-964f-7906ada39648 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:37.811832 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0e6a7e49-d04c-4d64-8a65-e38e1d3ef847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92d048fb753044c6a539969539db33f4'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:37.821817 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0e6a7e49-d04c-4d64-8a65-e38e1d3ef847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92d048fb753044c6a539969539db33f4'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:37.822252 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1221/2437] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:37 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:18:37.823237 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0e6a7e49-d04c-4d64-8a65-e38e1d3ef847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92d048fb753044c6a539969539db33f4'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:37.826893 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88361f-e46b-4803-964f-7906ada39648 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:37.837938 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88361f-e46b-4803-964f-7906ada39648 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:37.842688 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0e6a7e49-d04c-4d64-8a65-e38e1d3ef847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92d048fb753044c6a539969539db33f4'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:37.843079 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da41bb7-1d7f-467d-bca8-487119d4e739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:37.843788 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da41bb7-1d7f-467d-bca8-487119d4e739 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:37.844085 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da41bb7-1d7f-467d-bca8-487119d4e739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:37.844596 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da41bb7-1d7f-467d-bca8-487119d4e739 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:37.845381 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da41bb7-1d7f-467d-bca8-487119d4e739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:37.846981 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da41bb7-1d7f-467d-bca8-487119d4e739 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:37.849723 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1217/2438] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:18:37 2021] DELETE /identity/v3/users/92d048fb753044c6a539969539db33f4 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:37.855260 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2fec6-eae9-4915-80e7-3a38cb74c883 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:37.855879 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2fec6-eae9-4915-80e7-3a38cb74c883 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:37.856382 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2fec6-eae9-4915-80e7-3a38cb74c883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:37.862940 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1222/2439] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:37 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:18:37.868841 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da41bb7-1d7f-467d-bca8-487119d4e739 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:37.876459 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-0da41bb7-1d7f-467d-bca8-487119d4e739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:37.891884 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-f9b2fec6-eae9-4915-80e7-3a38cb74c883 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:37.893400 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-f9b2fec6-eae9-4915-80e7-3a38cb74c883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:37.904560 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da41bb7-1d7f-467d-bca8-487119d4e739 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:37.991417 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed132184-28fa-4627-978f-c3b76866adf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:37.992442 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed132184-28fa-4627-978f-c3b76866adf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:37.992795 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed132184-28fa-4627-978f-c3b76866adf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:37.993183 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed132184-28fa-4627-978f-c3b76866adf7 admin admin] PATH_INFO: `/v3/projects/0b53767ee05b49aaa7493e90d35af94f/users/c8d522fe3fa04b4bbfc81941b16ab9b1/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:38.002662 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1218/2440] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:38.003682 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2fec6-eae9-4915-80e7-3a38cb74c883 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:38.005134 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-f9b2fec6-eae9-4915-80e7-3a38cb74c883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:38.014978 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed132184-28fa-4627-978f-c3b76866adf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b53767ee05b49aaa7493e90d35af94f, user_id=c8d522fe3fa04b4bbfc81941b16ab9b1, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:38.017732 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed132184-28fa-4627-978f-c3b76866adf7 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:38.080151 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2fec6-eae9-4915-80e7-3a38cb74c883 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:38.090091 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1223/2441] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:37 2021] PUT /identity/v3/projects/0b53767ee05b49aaa7493e90d35af94f/users/c8d522fe3fa04b4bbfc81941b16ab9b1/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:18:38.107038 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc49f8-4813-4959-9f6e-4df04689df77 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:38.107390 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc49f8-4813-4959-9f6e-4df04689df77 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:38.107580 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc49f8-4813-4959-9f6e-4df04689df77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:38.143559 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-f0dc49f8-4813-4959-9f6e-4df04689df77 None None] MFA Rules not processed for user `c8d522fe3fa04b4bbfc81941b16ab9b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:38.144820 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-f0dc49f8-4813-4959-9f6e-4df04689df77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:38.171168 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6395ab9-3e40-4958-86ab-79d9b9561b6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:38.171921 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6395ab9-3e40-4958-86ab-79d9b9561b6e service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:38.172314 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6395ab9-3e40-4958-86ab-79d9b9561b6e service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:38.172560 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6395ab9-3e40-4958-86ab-79d9b9561b6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:38.231431 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1224/2442] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:38 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:18:38.233548 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc49f8-4813-4959-9f6e-4df04689df77 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:38.251016 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6395ab9-3e40-4958-86ab-79d9b9561b6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:38.252522 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6395ab9-3e40-4958-86ab-79d9b9561b6e service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:38.279393 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1219/2443] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:18:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:18:38.318509 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc49f8-4813-4959-9f6e-4df04689df77 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:38.327441 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd721f-420e-435b-94ac-c02bb557607b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:38.330922 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd721f-420e-435b-94ac-c02bb557607b admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:38.330922 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd721f-420e-435b-94ac-c02bb557607b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:38.330922 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd721f-420e-435b-94ac-c02bb557607b admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:38.330922 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd721f-420e-435b-94ac-c02bb557607b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:38.331849 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd721f-420e-435b-94ac-c02bb557607b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:38.422829 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1225/2444] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:18:38 2021] POST /identity/v3/projects => generated 405 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:38.424043 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6395ab9-3e40-4958-86ab-79d9b9561b6e service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:38.435364 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6395ab9-3e40-4958-86ab-79d9b9561b6e service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:38.520619 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e78137-83b1-4e4b-9bae-6ffc253911e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:38.520619 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e78137-83b1-4e4b-9bae-6ffc253911e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:38.520619 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e78137-83b1-4e4b-9bae-6ffc253911e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:38.520619 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e78137-83b1-4e4b-9bae-6ffc253911e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:38.520908 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e78137-83b1-4e4b-9bae-6ffc253911e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:38.520908 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e78137-83b1-4e4b-9bae-6ffc253911e1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:38.637157 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1220/2445] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:18:38 2021] POST /identity/v3/users => generated 309 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:38.637359 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd721f-420e-435b-94ac-c02bb557607b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:38.650480 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd721f-420e-435b-94ac-c02bb557607b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:38.656721 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd116f-900a-4221-8358-3d1ced809a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:38.657566 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd116f-900a-4221-8358-3d1ced809a40 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:38.657937 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd116f-900a-4221-8358-3d1ced809a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:38.658301 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd116f-900a-4221-8358-3d1ced809a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:38.659251 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd116f-900a-4221-8358-3d1ced809a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:38.661232 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd116f-900a-4221-8358-3d1ced809a40 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:38.675843 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1226/2446] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:38 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:18:38.680952 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e78137-83b1-4e4b-9bae-6ffc253911e1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:38.693149 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e78137-83b1-4e4b-9bae-6ffc253911e1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:38.700431 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895937c-3fba-476d-845a-316a973071b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:38.701601 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895937c-3fba-476d-845a-316a973071b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:38.702053 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895937c-3fba-476d-845a-316a973071b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:38.702457 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895937c-3fba-476d-845a-316a973071b6 admin admin] PATH_INFO: `/v3/projects/09a8951074104338ac3e8eaa2e378578/users/52180f379c9f47f3a69891781a02fe76/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:38.723282 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895937c-3fba-476d-845a-316a973071b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09a8951074104338ac3e8eaa2e378578, user_id=52180f379c9f47f3a69891781a02fe76, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:38.728371 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895937c-3fba-476d-845a-316a973071b6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:38.744602 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd116f-900a-4221-8358-3d1ced809a40 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:38.746519 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-48bd116f-900a-4221-8358-3d1ced809a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:38.776000 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd116f-900a-4221-8358-3d1ced809a40 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:38.783739 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5eb44-90d1-4f0b-8461-ecf92b0ac318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:38.784684 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5eb44-90d1-4f0b-8461-ecf92b0ac318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:38.784871 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5eb44-90d1-4f0b-8461-ecf92b0ac318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:38.785146 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5eb44-90d1-4f0b-8461-ecf92b0ac318 admin admin] PATH_INFO: `/v3/projects/f43de6edf73e4fb9b53232f12bed2103` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:38.786471 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5eb44-90d1-4f0b-8461-ecf92b0ac318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f43de6edf73e4fb9b53232f12bed2103)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:38.789894 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5eb44-90d1-4f0b-8461-ecf92b0ac318 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:38.829729 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1221/2447] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:38 2021] PUT /identity/v3/projects/09a8951074104338ac3e8eaa2e378578/users/52180f379c9f47f3a69891781a02fe76/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:38.833892 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895937c-3fba-476d-845a-316a973071b6 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:38.906949 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895937c-3fba-476d-845a-316a973071b6 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:38.915440 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c0e49-8892-4996-b46d-4ba5c768a03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:38.915440 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c0e49-8892-4996-b46d-4ba5c768a03c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:38.915725 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c0e49-8892-4996-b46d-4ba5c768a03c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:38.915887 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c0e49-8892-4996-b46d-4ba5c768a03c admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:38.916677 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c0e49-8892-4996-b46d-4ba5c768a03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:38.918522 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c0e49-8892-4996-b46d-4ba5c768a03c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:38.936548 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1222/2448] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:38 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:18:38.940755 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c0e49-8892-4996-b46d-4ba5c768a03c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:38.949057 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-29a5eb44-90d1-4f0b-8461-ecf92b0ac318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f43de6edf73e4fb9b53232f12bed2103', 'request_id': 'req-29a5eb44-90d1-4f0b-8461-ecf92b0ac318'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:38.953597 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c0e49-8892-4996-b46d-4ba5c768a03c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:38.958747 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-29a5eb44-90d1-4f0b-8461-ecf92b0ac318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f43de6edf73e4fb9b53232f12bed2103', 'request_id': 'req-29a5eb44-90d1-4f0b-8461-ecf92b0ac318'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:38.966261 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-29a5eb44-90d1-4f0b-8461-ecf92b0ac318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f43de6edf73e4fb9b53232f12bed2103', 'request_id': 'req-29a5eb44-90d1-4f0b-8461-ecf92b0ac318'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:39.028652 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdba6bc-c5df-46e8-adb4-2d78d29e28d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:39.029546 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdba6bc-c5df-46e8-adb4-2d78d29e28d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:39.029814 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdba6bc-c5df-46e8-adb4-2d78d29e28d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:39.030137 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdba6bc-c5df-46e8-adb4-2d78d29e28d9 admin admin] PATH_INFO: `/v3/projects/09a8951074104338ac3e8eaa2e378578/users/52180f379c9f47f3a69891781a02fe76/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:39.032408 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdba6bc-c5df-46e8-adb4-2d78d29e28d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09a8951074104338ac3e8eaa2e378578, user_id=52180f379c9f47f3a69891781a02fe76, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:39.035552 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdba6bc-c5df-46e8-adb4-2d78d29e28d9 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:39.051429 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1223/2449] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:38 2021] PUT /identity/v3/projects/09a8951074104338ac3e8eaa2e378578/users/52180f379c9f47f3a69891781a02fe76/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:39.059759 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d7c53-7f02-4f37-b1ad-e549cd525aa7 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:39.061226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d7c53-7f02-4f37-b1ad-e549cd525aa7 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:39.061681 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d7c53-7f02-4f37-b1ad-e549cd525aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:39.072884 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-29a5eb44-90d1-4f0b-8461-ecf92b0ac318 admin admin] The token cache is being invalidate because project f43de6edf73e4fb9b53232f12bed2103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:18:39.073446 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-29a5eb44-90d1-4f0b-8461-ecf92b0ac318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:39.074768 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-29a5eb44-90d1-4f0b-8461-ecf92b0ac318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:39.076525 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1227/2450] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:18:38 2021] DELETE /identity/v3/projects/f43de6edf73e4fb9b53232f12bed2103 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:39.082907 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5eb44-90d1-4f0b-8461-ecf92b0ac318 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:39.086013 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-29a5eb44-90d1-4f0b-8461-ecf92b0ac318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:39.100280 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5eb44-90d1-4f0b-8461-ecf92b0ac318 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:39.102330 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-024d7c53-7f02-4f37-b1ad-e549cd525aa7 None None] MFA Rules not processed for user `52180f379c9f47f3a69891781a02fe76`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:39.103925 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-024d7c53-7f02-4f37-b1ad-e549cd525aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:39.172446 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf56c4-b5bc-4d34-b725-85353d9e71a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:39.173379 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf56c4-b5bc-4d34-b725-85353d9e71a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:39.173704 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf56c4-b5bc-4d34-b725-85353d9e71a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:39.174057 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf56c4-b5bc-4d34-b725-85353d9e71a2 admin admin] PATH_INFO: `/v3/users/2b02061d3b714786b73ad9bba1cf15e4` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:39.176427 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf56c4-b5bc-4d34-b725-85353d9e71a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b02061d3b714786b73ad9bba1cf15e4)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:39.177798 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf56c4-b5bc-4d34-b725-85353d9e71a2 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:39.249975 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1224/2451] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:39 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:39.261664 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d7c53-7f02-4f37-b1ad-e549cd525aa7 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:39.263276 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-024d7c53-7f02-4f37-b1ad-e549cd525aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:39.339112 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d7c53-7f02-4f37-b1ad-e549cd525aa7 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:39.342899 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768ad2b-859f-44c9-995c-96fd6b24a4fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:39.343582 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768ad2b-859f-44c9-995c-96fd6b24a4fd service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:39.343873 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768ad2b-859f-44c9-995c-96fd6b24a4fd service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:39.344150 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768ad2b-859f-44c9-995c-96fd6b24a4fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:39.354425 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768ad2b-859f-44c9-995c-96fd6b24a4fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:39.357940 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768ad2b-859f-44c9-995c-96fd6b24a4fd service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:39.366897 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1225/2452] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:18:39 2021] GET /identity/v3/auth/tokens => generated 3339 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:18:39.447806 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d7bf56c4-b5bc-4d34-b725-85353d9e71a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b02061d3b714786b73ad9bba1cf15e4'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:39.529567 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d7bf56c4-b5bc-4d34-b725-85353d9e71a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b02061d3b714786b73ad9bba1cf15e4'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:39.539245 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d7bf56c4-b5bc-4d34-b725-85353d9e71a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b02061d3b714786b73ad9bba1cf15e4'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:39.540401 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d7bf56c4-b5bc-4d34-b725-85353d9e71a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b02061d3b714786b73ad9bba1cf15e4'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:39.548775 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768ad2b-859f-44c9-995c-96fd6b24a4fd service cinder] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:39.550231 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-0768ad2b-859f-44c9-995c-96fd6b24a4fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:39.562265 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d7bf56c4-b5bc-4d34-b725-85353d9e71a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b02061d3b714786b73ad9bba1cf15e4'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:39.573636 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768ad2b-859f-44c9-995c-96fd6b24a4fd service cinder] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:39.574997 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1228/2453] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:18:39 2021] DELETE /identity/v3/users/2b02061d3b714786b73ad9bba1cf15e4 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:39.644340 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5a66d-71d7-4641-8883-49a63402a4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:39.645379 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5a66d-71d7-4641-8883-49a63402a4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:39.650572 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5a66d-71d7-4641-8883-49a63402a4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:39.650572 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5a66d-71d7-4641-8883-49a63402a4c6 admin admin] PATH_INFO: `/v3/users/c8d522fe3fa04b4bbfc81941b16ab9b1` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:39.650572 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5a66d-71d7-4641-8883-49a63402a4c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d522fe3fa04b4bbfc81941b16ab9b1)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:39.650572 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5a66d-71d7-4641-8883-49a63402a4c6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:39.828368 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-e4d5a66d-71d7-4641-8883-49a63402a4c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d522fe3fa04b4bbfc81941b16ab9b1'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:39.903474 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-e4d5a66d-71d7-4641-8883-49a63402a4c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d522fe3fa04b4bbfc81941b16ab9b1'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:39.915090 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-e4d5a66d-71d7-4641-8883-49a63402a4c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d522fe3fa04b4bbfc81941b16ab9b1'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:39.917509 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-e4d5a66d-71d7-4641-8883-49a63402a4c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d522fe3fa04b4bbfc81941b16ab9b1'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:39.938500 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-e4d5a66d-71d7-4641-8883-49a63402a4c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d522fe3fa04b4bbfc81941b16ab9b1'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:39.946884 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1226/2454] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:18:39 2021] DELETE /identity/v3/users/c8d522fe3fa04b4bbfc81941b16ab9b1 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:39.951520 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1039c20-f2fe-4f5a-9b62-187916e9c34b None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:39.952494 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1039c20-f2fe-4f5a-9b62-187916e9c34b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:39.953443 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1039c20-f2fe-4f5a-9b62-187916e9c34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:39.987805 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-d1039c20-f2fe-4f5a-9b62-187916e9c34b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:39.989331 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-d1039c20-f2fe-4f5a-9b62-187916e9c34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:40.063158 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1229/2455] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:40.074084 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5a66d-71d7-4641-8883-49a63402a4c6 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:40.075893 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-e4d5a66d-71d7-4641-8883-49a63402a4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:40.083774 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1039c20-f2fe-4f5a-9b62-187916e9c34b None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:40.090173 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-d1039c20-f2fe-4f5a-9b62-187916e9c34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:40.102749 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1039c20-f2fe-4f5a-9b62-187916e9c34b None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:40.107583 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cda5b-2f21-4881-82a6-17483ccfac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:40.108447 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cda5b-2f21-4881-82a6-17483ccfac5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:40.108735 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cda5b-2f21-4881-82a6-17483ccfac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:40.109170 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cda5b-2f21-4881-82a6-17483ccfac5d admin admin] PATH_INFO: `/v3/projects/52bd8cf508ce4fe588d2e3309beadce8` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:40.110398 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cda5b-2f21-4881-82a6-17483ccfac5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=52bd8cf508ce4fe588d2e3309beadce8)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:40.112476 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cda5b-2f21-4881-82a6-17483ccfac5d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:40.154731 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5a66d-71d7-4641-8883-49a63402a4c6 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:40.158610 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef89bc-6c49-46c8-aec5-d2339e6c5b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:40.159283 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef89bc-6c49-46c8-aec5-d2339e6c5b13 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:40.159573 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef89bc-6c49-46c8-aec5-d2339e6c5b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:40.159860 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef89bc-6c49-46c8-aec5-d2339e6c5b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:40.170871 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef89bc-6c49-46c8-aec5-d2339e6c5b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:40.172456 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef89bc-6c49-46c8-aec5-d2339e6c5b13 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:40.183032 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1227/2456] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:18:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:18:40.230280 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a67cda5b-2f21-4881-82a6-17483ccfac5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52bd8cf508ce4fe588d2e3309beadce8', 'request_id': 'req-a67cda5b-2f21-4881-82a6-17483ccfac5d'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:40.237282 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a67cda5b-2f21-4881-82a6-17483ccfac5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52bd8cf508ce4fe588d2e3309beadce8', 'request_id': 'req-a67cda5b-2f21-4881-82a6-17483ccfac5d'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:40.245140 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a67cda5b-2f21-4881-82a6-17483ccfac5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52bd8cf508ce4fe588d2e3309beadce8', 'request_id': 'req-a67cda5b-2f21-4881-82a6-17483ccfac5d'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:40.316870 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a67cda5b-2f21-4881-82a6-17483ccfac5d admin admin] The token cache is being invalidate because project 52bd8cf508ce4fe588d2e3309beadce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:18:40.316870 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a67cda5b-2f21-4881-82a6-17483ccfac5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:40.316870 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a67cda5b-2f21-4881-82a6-17483ccfac5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:40.316870 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1230/2457] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:18:40 2021] DELETE /identity/v3/projects/52bd8cf508ce4fe588d2e3309beadce8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:40.325546 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0b77c-9112-4d00-a90a-0617adff769d None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:40.326057 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0b77c-9112-4d00-a90a-0617adff769d None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:40.326247 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0b77c-9112-4d00-a90a-0617adff769d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:40.346172 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-6cf0b77c-9112-4d00-a90a-0617adff769d None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:40.347652 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-6cf0b77c-9112-4d00-a90a-0617adff769d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:40.419534 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1228/2458] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:40.421286 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f9ee7-e5e5-4ac9-a391-41486d86583f None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:40.421571 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f9ee7-e5e5-4ac9-a391-41486d86583f None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:40.421891 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f9ee7-e5e5-4ac9-a391-41486d86583f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:40.454706 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-2c5f9ee7-e5e5-4ac9-a391-41486d86583f None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:40.457439 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-2c5f9ee7-e5e5-4ac9-a391-41486d86583f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:40.474677 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1231/2459] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:40.479585 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0b77c-9112-4d00-a90a-0617adff769d None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:40.493184 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0b77c-9112-4d00-a90a-0617adff769d None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:40.506083 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154c27a-42e6-42a7-81fa-523cae428984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:40.507898 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154c27a-42e6-42a7-81fa-523cae428984 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:40.508254 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154c27a-42e6-42a7-81fa-523cae428984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:40.508602 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154c27a-42e6-42a7-81fa-523cae428984 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:40.509678 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154c27a-42e6-42a7-81fa-523cae428984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:18:40.510065 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154c27a-42e6-42a7-81fa-523cae428984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:40.512752 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154c27a-42e6-42a7-81fa-523cae428984 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:40.554842 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1229/2460] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:18:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:18:40.568457 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f9ee7-e5e5-4ac9-a391-41486d86583f None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:40.580378 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f9ee7-e5e5-4ac9-a391-41486d86583f None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:40.585606 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d58b20-deee-42bc-a969-485c34e1b809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:40.586284 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d58b20-deee-42bc-a969-485c34e1b809 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:40.586860 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d58b20-deee-42bc-a969-485c34e1b809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:40.586860 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d58b20-deee-42bc-a969-485c34e1b809 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:40.587688 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d58b20-deee-42bc-a969-485c34e1b809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:40.589685 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d58b20-deee-42bc-a969-485c34e1b809 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:41.202080 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1232/2461] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:18:40 2021] POST /identity/v3/projects => generated 381 bytes in 634 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:41.206352 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154c27a-42e6-42a7-81fa-523cae428984 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:41.216404 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154c27a-42e6-42a7-81fa-523cae428984 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:41.270106 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f066b-5812-4754-999c-874f348a5fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:41.270759 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f066b-5812-4754-999c-874f348a5fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:41.271044 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f066b-5812-4754-999c-874f348a5fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:41.271354 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f066b-5812-4754-999c-874f348a5fb4 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:41.272063 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f066b-5812-4754-999c-874f348a5fb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:41.273942 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f066b-5812-4754-999c-874f348a5fb4 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:41.288728 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d58b20-deee-42bc-a969-485c34e1b809 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:41.290406 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-57d58b20-deee-42bc-a969-485c34e1b809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:41.302792 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d58b20-deee-42bc-a969-485c34e1b809 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:41.308241 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3fde6-fa18-493a-96b2-c5bcb49cc6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:41.313497 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3fde6-fa18-493a-96b2-c5bcb49cc6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:41.313497 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3fde6-fa18-493a-96b2-c5bcb49cc6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:41.313497 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3fde6-fa18-493a-96b2-c5bcb49cc6bf admin admin] PATH_INFO: `/v3/projects/0b53767ee05b49aaa7493e90d35af94f` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:41.313497 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3fde6-fa18-493a-96b2-c5bcb49cc6bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b53767ee05b49aaa7493e90d35af94f)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:41.313497 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3fde6-fa18-493a-96b2-c5bcb49cc6bf admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:41.404756 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1230/2462] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:18:41 2021] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:18:41.406121 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f066b-5812-4754-999c-874f348a5fb4 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:41.418458 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f066b-5812-4754-999c-874f348a5fb4 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:41.430667 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b685a5-5f36-4a16-ba9e-5729bc3fff00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:41.433976 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b685a5-5f36-4a16-ba9e-5729bc3fff00 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:41.434331 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b685a5-5f36-4a16-ba9e-5729bc3fff00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:41.434684 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b685a5-5f36-4a16-ba9e-5729bc3fff00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:41.435541 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b685a5-5f36-4a16-ba9e-5729bc3fff00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:41.437399 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b685a5-5f36-4a16-ba9e-5729bc3fff00 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:41.449591 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-84d3fde6-fa18-493a-96b2-c5bcb49cc6bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b53767ee05b49aaa7493e90d35af94f', 'request_id': 'req-84d3fde6-fa18-493a-96b2-c5bcb49cc6bf'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:41.453321 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1231/2463] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:41 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:18:41.454210 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b685a5-5f36-4a16-ba9e-5729bc3fff00 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:41.457308 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-84d3fde6-fa18-493a-96b2-c5bcb49cc6bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b53767ee05b49aaa7493e90d35af94f', 'request_id': 'req-84d3fde6-fa18-493a-96b2-c5bcb49cc6bf'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:41.464460 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-84d3fde6-fa18-493a-96b2-c5bcb49cc6bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b53767ee05b49aaa7493e90d35af94f', 'request_id': 'req-84d3fde6-fa18-493a-96b2-c5bcb49cc6bf'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:41.467798 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b685a5-5f36-4a16-ba9e-5729bc3fff00 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:41.526778 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-84d3fde6-fa18-493a-96b2-c5bcb49cc6bf admin admin] The token cache is being invalidate because project 0b53767ee05b49aaa7493e90d35af94f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:18:41.527084 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-84d3fde6-fa18-493a-96b2-c5bcb49cc6bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:41.528254 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-84d3fde6-fa18-493a-96b2-c5bcb49cc6bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:41.529916 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1233/2464] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:18:41 2021] DELETE /identity/v3/projects/0b53767ee05b49aaa7493e90d35af94f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:18:41.534556 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3fde6-fa18-493a-96b2-c5bcb49cc6bf admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:41.536492 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-84d3fde6-fa18-493a-96b2-c5bcb49cc6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:41.550699 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f4f94-9e77-4ea7-9909-45605242cee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:41.552169 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f4f94-9e77-4ea7-9909-45605242cee0 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:41.552885 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f4f94-9e77-4ea7-9909-45605242cee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:41.553464 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f4f94-9e77-4ea7-9909-45605242cee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:41.558489 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f4f94-9e77-4ea7-9909-45605242cee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:41.560462 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f4f94-9e77-4ea7-9909-45605242cee0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:41.575342 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1232/2465] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:41 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:18:41.581765 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f4f94-9e77-4ea7-9909-45605242cee0 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:41.583311 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-1d0f4f94-9e77-4ea7-9909-45605242cee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:41.600897 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f4f94-9e77-4ea7-9909-45605242cee0 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:41.604454 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bb571-81f4-47d4-897b-09fadbdcbd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:41.605058 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bb571-81f4-47d4-897b-09fadbdcbd33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:41.605708 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bb571-81f4-47d4-897b-09fadbdcbd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:41.606127 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bb571-81f4-47d4-897b-09fadbdcbd33 admin admin] PATH_INFO: `/v3/projects/c3813ed97e3b47b096dd4603701e1490/users/79bbe69e7fdd45ce83990563819b9568/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:41.624844 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bb571-81f4-47d4-897b-09fadbdcbd33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3813ed97e3b47b096dd4603701e1490, user_id=79bbe69e7fdd45ce83990563819b9568, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:41.629067 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bb571-81f4-47d4-897b-09fadbdcbd33 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:41.642946 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3fde6-fa18-493a-96b2-c5bcb49cc6bf admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:41.650054 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da33be-e29f-4b94-9b5e-527a8069dc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:41.651065 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da33be-e29f-4b94-9b5e-527a8069dc53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:41.651389 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da33be-e29f-4b94-9b5e-527a8069dc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:41.651666 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da33be-e29f-4b94-9b5e-527a8069dc53 admin admin] PATH_INFO: `/v3/users/52180f379c9f47f3a69891781a02fe76` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:41.652980 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da33be-e29f-4b94-9b5e-527a8069dc53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52180f379c9f47f3a69891781a02fe76)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:41.654984 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da33be-e29f-4b94-9b5e-527a8069dc53 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:41.712971 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1233/2466] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:41 2021] PUT /identity/v3/projects/c3813ed97e3b47b096dd4603701e1490/users/79bbe69e7fdd45ce83990563819b9568/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:41.724157 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ef923-c69e-48ab-b9c8-5a495d206238 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:41.724497 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ef923-c69e-48ab-b9c8-5a495d206238 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:41.725363 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ef923-c69e-48ab-b9c8-5a495d206238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:41.758608 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-667ef923-c69e-48ab-b9c8-5a495d206238 None None] MFA Rules not processed for user `79bbe69e7fdd45ce83990563819b9568`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:41.762698 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-667ef923-c69e-48ab-b9c8-5a495d206238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:41.838093 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1234/2467] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:41 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:18:41.842699 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ef923-c69e-48ab-b9c8-5a495d206238 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:41.866563 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-11da33be-e29f-4b94-9b5e-527a8069dc53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52180f379c9f47f3a69891781a02fe76'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:41.929290 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ef923-c69e-48ab-b9c8-5a495d206238 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:41.935142 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216dd78-c298-48f5-939c-2fcd9a331851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:41.936026 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216dd78-c298-48f5-939c-2fcd9a331851 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:41.936356 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216dd78-c298-48f5-939c-2fcd9a331851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:41.938944 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216dd78-c298-48f5-939c-2fcd9a331851 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:41.939849 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216dd78-c298-48f5-939c-2fcd9a331851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:41.942283 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216dd78-c298-48f5-939c-2fcd9a331851 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:41.943129 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-11da33be-e29f-4b94-9b5e-527a8069dc53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52180f379c9f47f3a69891781a02fe76'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:41.955506 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-11da33be-e29f-4b94-9b5e-527a8069dc53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52180f379c9f47f3a69891781a02fe76'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:41.956224 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-11da33be-e29f-4b94-9b5e-527a8069dc53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52180f379c9f47f3a69891781a02fe76'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:41.973377 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-11da33be-e29f-4b94-9b5e-527a8069dc53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52180f379c9f47f3a69891781a02fe76'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:41.981353 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1234/2468] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:18:41 2021] DELETE /identity/v3/users/52180f379c9f47f3a69891781a02fe76 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:42.062133 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1235/2469] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:18:41 2021] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:42.065742 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da33be-e29f-4b94-9b5e-527a8069dc53 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:42.067615 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-11da33be-e29f-4b94-9b5e-527a8069dc53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:42.149739 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da33be-e29f-4b94-9b5e-527a8069dc53 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:42.222203 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ec9d0-0658-4333-bf39-4e5ec2c6bc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:42.223144 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ec9d0-0658-4333-bf39-4e5ec2c6bc9a admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:42.223144 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ec9d0-0658-4333-bf39-4e5ec2c6bc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:42.223144 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ec9d0-0658-4333-bf39-4e5ec2c6bc9a admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:42.224779 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ec9d0-0658-4333-bf39-4e5ec2c6bc9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:42.228138 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ec9d0-0658-4333-bf39-4e5ec2c6bc9a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:42.326117 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1235/2470] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:18:42 2021] POST /identity/v3/users => generated 296 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:42.327550 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216dd78-c298-48f5-939c-2fcd9a331851 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:42.341244 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216dd78-c298-48f5-939c-2fcd9a331851 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:42.348534 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23525a9-0dd8-491f-bd3d-75a83d546b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:42.349441 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23525a9-0dd8-491f-bd3d-75a83d546b2d admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:42.349971 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23525a9-0dd8-491f-bd3d-75a83d546b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:42.351036 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23525a9-0dd8-491f-bd3d-75a83d546b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:42.351984 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23525a9-0dd8-491f-bd3d-75a83d546b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:42.353743 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23525a9-0dd8-491f-bd3d-75a83d546b2d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:42.365054 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1236/2471] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:42 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:18:42.369762 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ec9d0-0658-4333-bf39-4e5ec2c6bc9a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:42.384114 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ec9d0-0658-4333-bf39-4e5ec2c6bc9a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:42.395876 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304230f-28ec-4f72-8979-f7f43a24e1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:42.397768 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304230f-28ec-4f72-8979-f7f43a24e1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:42.399936 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304230f-28ec-4f72-8979-f7f43a24e1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:42.399936 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304230f-28ec-4f72-8979-f7f43a24e1c4 admin admin] PATH_INFO: `/v3/projects/1feea01b687543b9b960bb82c67969f8/users/e093e3b3f4974cefa303b3798a5a84c5/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:42.417362 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304230f-28ec-4f72-8979-f7f43a24e1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1feea01b687543b9b960bb82c67969f8, user_id=e093e3b3f4974cefa303b3798a5a84c5, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:42.419981 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304230f-28ec-4f72-8979-f7f43a24e1c4 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:42.486960 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23525a9-0dd8-491f-bd3d-75a83d546b2d admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:42.488839 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-e23525a9-0dd8-491f-bd3d-75a83d546b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:42.529910 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23525a9-0dd8-491f-bd3d-75a83d546b2d admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:42.538856 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782f378-308f-4102-9c44-5dde90bd910a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:42.540847 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782f378-308f-4102-9c44-5dde90bd910a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:42.542218 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782f378-308f-4102-9c44-5dde90bd910a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:42.542218 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782f378-308f-4102-9c44-5dde90bd910a admin admin] PATH_INFO: `/v3/projects/09a8951074104338ac3e8eaa2e378578` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:42.543786 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782f378-308f-4102-9c44-5dde90bd910a admin admin] RBAC: Authorizing `identity:delete_project(project_id=09a8951074104338ac3e8eaa2e378578)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:42.545907 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782f378-308f-4102-9c44-5dde90bd910a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:42.552447 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1236/2472] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:42 2021] PUT /identity/v3/projects/1feea01b687543b9b960bb82c67969f8/users/e093e3b3f4974cefa303b3798a5a84c5/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:42.557342 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304230f-28ec-4f72-8979-f7f43a24e1c4 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:42.632956 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304230f-28ec-4f72-8979-f7f43a24e1c4 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:42.638218 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ceb22-0d73-40a5-ad2d-bed0a671eb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:42.639008 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ceb22-0d73-40a5-ad2d-bed0a671eb52 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:42.639430 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ceb22-0d73-40a5-ad2d-bed0a671eb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:42.639797 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ceb22-0d73-40a5-ad2d-bed0a671eb52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:42.640613 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ceb22-0d73-40a5-ad2d-bed0a671eb52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:42.642251 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ceb22-0d73-40a5-ad2d-bed0a671eb52 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:42.656349 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1237/2473] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:42 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:18:42.657472 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ceb22-0d73-40a5-ad2d-bed0a671eb52 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:42.672199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ceb22-0d73-40a5-ad2d-bed0a671eb52 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:42.686910 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbefd58-9f13-41c8-84bc-c8737c8fbbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:42.687940 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbefd58-9f13-41c8-84bc-c8737c8fbbba admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:42.688289 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbefd58-9f13-41c8-84bc-c8737c8fbbba admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:42.688630 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbefd58-9f13-41c8-84bc-c8737c8fbbba admin admin] PATH_INFO: `/v3/projects/1feea01b687543b9b960bb82c67969f8/users/e093e3b3f4974cefa303b3798a5a84c5/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:42.690880 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbefd58-9f13-41c8-84bc-c8737c8fbbba admin admin] RBAC: Authorizing `identity:create_grant(project_id=1feea01b687543b9b960bb82c67969f8, user_id=e093e3b3f4974cefa303b3798a5a84c5, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:42.694737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbefd58-9f13-41c8-84bc-c8737c8fbbba admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:42.703350 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-d782f378-308f-4102-9c44-5dde90bd910a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09a8951074104338ac3e8eaa2e378578', 'request_id': 'req-d782f378-308f-4102-9c44-5dde90bd910a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:42.717735 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-d782f378-308f-4102-9c44-5dde90bd910a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09a8951074104338ac3e8eaa2e378578', 'request_id': 'req-d782f378-308f-4102-9c44-5dde90bd910a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:42.718879 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1238/2474] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:42 2021] PUT /identity/v3/projects/1feea01b687543b9b960bb82c67969f8/users/e093e3b3f4974cefa303b3798a5a84c5/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:42.719777 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-d782f378-308f-4102-9c44-5dde90bd910a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09a8951074104338ac3e8eaa2e378578', 'request_id': 'req-d782f378-308f-4102-9c44-5dde90bd910a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:42.720915 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c25495-25f4-4f5f-bfa6-7a363d3b3457 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:42.721367 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c25495-25f4-4f5f-bfa6-7a363d3b3457 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:42.721860 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c25495-25f4-4f5f-bfa6-7a363d3b3457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:42.756774 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-65c25495-25f4-4f5f-bfa6-7a363d3b3457 None None] MFA Rules not processed for user `e093e3b3f4974cefa303b3798a5a84c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:42.758025 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-65c25495-25f4-4f5f-bfa6-7a363d3b3457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:42.842242 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-d782f378-308f-4102-9c44-5dde90bd910a admin admin] The token cache is being invalidate because project 09a8951074104338ac3e8eaa2e378578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:18:42.842627 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-d782f378-308f-4102-9c44-5dde90bd910a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:42.844269 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-d782f378-308f-4102-9c44-5dde90bd910a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:42.846739 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1237/2475] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:18:42 2021] DELETE /identity/v3/projects/09a8951074104338ac3e8eaa2e378578 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:42.851309 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1239/2476] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:42 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:42.853368 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182606a1-75d0-4c2d-a4f5-a5e841a87b54 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:42.854268 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182606a1-75d0-4c2d-a4f5-a5e841a87b54 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:42.854756 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182606a1-75d0-4c2d-a4f5-a5e841a87b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:42.875092 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c25495-25f4-4f5f-bfa6-7a363d3b3457 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:42.877334 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-65c25495-25f4-4f5f-bfa6-7a363d3b3457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:42.886002 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-182606a1-75d0-4c2d-a4f5-a5e841a87b54 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:42.894924 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-182606a1-75d0-4c2d-a4f5-a5e841a87b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:42.966706 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c25495-25f4-4f5f-bfa6-7a363d3b3457 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:42.970598 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1238/2477] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:42.972469 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7a71a-3ff7-4bba-a1ac-155187941d44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:42.973117 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7a71a-3ff7-4bba-a1ac-155187941d44 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:42.973398 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7a71a-3ff7-4bba-a1ac-155187941d44 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:42.973699 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7a71a-3ff7-4bba-a1ac-155187941d44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:42.975831 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-64a7a71a-3ff7-4bba-a1ac-155187941d44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:42.978481 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914fa2a-af0c-477e-a53d-dc8e84572793 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:42.978785 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914fa2a-af0c-477e-a53d-dc8e84572793 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:42.979055 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914fa2a-af0c-477e-a53d-dc8e84572793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:42.989189 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7a71a-3ff7-4bba-a1ac-155187941d44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:42.991620 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7a71a-3ff7-4bba-a1ac-155187941d44 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:42.999044 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-1914fa2a-af0c-477e-a53d-dc8e84572793 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:43.000356 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-1914fa2a-af0c-477e-a53d-dc8e84572793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:43.002086 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1240/2478] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:18:42 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:18:43.011368 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1239/2479] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:18:43.014494 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7a71a-3ff7-4bba-a1ac-155187941d44 service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:43.027853 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7a71a-3ff7-4bba-a1ac-155187941d44 service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:43.036098 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09972feb-2fc7-43b5-babd-48e4030b9fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:43.036772 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09972feb-2fc7-43b5-babd-48e4030b9fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:43.037064 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09972feb-2fc7-43b5-babd-48e4030b9fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:43.044602 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09972feb-2fc7-43b5-babd-48e4030b9fb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:43.044602 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09972feb-2fc7-43b5-babd-48e4030b9fb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:18:43.044602 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09972feb-2fc7-43b5-babd-48e4030b9fb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:43.044602 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09972feb-2fc7-43b5-babd-48e4030b9fb9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:43.064820 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1241/2480] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:18:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 04:18:43.070031 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914fa2a-af0c-477e-a53d-dc8e84572793 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:43.081917 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914fa2a-af0c-477e-a53d-dc8e84572793 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:43.088113 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf9e74-de41-45e2-8f9d-c57b22b275f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:43.089015 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf9e74-de41-45e2-8f9d-c57b22b275f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:43.089350 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf9e74-de41-45e2-8f9d-c57b22b275f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:43.089688 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf9e74-de41-45e2-8f9d-c57b22b275f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:43.096771 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf9e74-de41-45e2-8f9d-c57b22b275f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:43.098875 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf9e74-de41-45e2-8f9d-c57b22b275f0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:43.222735 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1240/2481] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:18:43 2021] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:43.229811 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09972feb-2fc7-43b5-babd-48e4030b9fb9 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:43.242995 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09972feb-2fc7-43b5-babd-48e4030b9fb9 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:43.315029 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d80d31-6d9f-4bf6-9874-9ce4f2d1635a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:43.315641 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d80d31-6d9f-4bf6-9874-9ce4f2d1635a admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:43.315957 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d80d31-6d9f-4bf6-9874-9ce4f2d1635a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:43.316203 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d80d31-6d9f-4bf6-9874-9ce4f2d1635a admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:43.316912 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d80d31-6d9f-4bf6-9874-9ce4f2d1635a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:43.319413 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d80d31-6d9f-4bf6-9874-9ce4f2d1635a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:43.438452 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1242/2482] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:18:43 2021] POST /identity/v3/users => generated 287 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:18:43.442528 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf9e74-de41-45e2-8f9d-c57b22b275f0 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:43.453523 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf9e74-de41-45e2-8f9d-c57b22b275f0 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:43.458754 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f130409-238d-4bff-9e2a-eca058ca6055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:43.459447 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f130409-238d-4bff-9e2a-eca058ca6055 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:43.459783 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f130409-238d-4bff-9e2a-eca058ca6055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:43.460060 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f130409-238d-4bff-9e2a-eca058ca6055 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:43.460804 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f130409-238d-4bff-9e2a-eca058ca6055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:43.462401 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f130409-238d-4bff-9e2a-eca058ca6055 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:43.476351 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1241/2483] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:43 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:18:43.480402 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d80d31-6d9f-4bf6-9874-9ce4f2d1635a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:43.491415 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d80d31-6d9f-4bf6-9874-9ce4f2d1635a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:43.496874 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfaf47f-64e1-43dc-922a-7885ec30f144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:43.498085 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaf47f-64e1-43dc-922a-7885ec30f144 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:43.498085 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaf47f-64e1-43dc-922a-7885ec30f144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:43.498085 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaf47f-64e1-43dc-922a-7885ec30f144 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:43.498808 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfaf47f-64e1-43dc-922a-7885ec30f144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:43.500415 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfaf47f-64e1-43dc-922a-7885ec30f144 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:43.514658 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1243/2484] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:43 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:18:43.519956 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f130409-238d-4bff-9e2a-eca058ca6055 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:43.533206 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f130409-238d-4bff-9e2a-eca058ca6055 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:43.539407 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02d8fe-87ca-4b74-b345-7925656dc242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:43.540355 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02d8fe-87ca-4b74-b345-7925656dc242 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:43.540763 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02d8fe-87ca-4b74-b345-7925656dc242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:43.541049 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02d8fe-87ca-4b74-b345-7925656dc242 admin admin] PATH_INFO: `/v3/projects/3e6cc7dff67e4f87a8fd37563e11efda/users/7bddd37f0edd4183a43eaeb753790f1b/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:43.557438 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02d8fe-87ca-4b74-b345-7925656dc242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6cc7dff67e4f87a8fd37563e11efda, user_id=7bddd37f0edd4183a43eaeb753790f1b, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:43.560332 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02d8fe-87ca-4b74-b345-7925656dc242 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:43.653692 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1242/2485] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:43 2021] PUT /identity/v3/projects/3e6cc7dff67e4f87a8fd37563e11efda/users/7bddd37f0edd4183a43eaeb753790f1b/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:43.671755 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96096fd0-6ab8-4912-8a95-3330dca126df None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:43.672308 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96096fd0-6ab8-4912-8a95-3330dca126df None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:43.672827 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96096fd0-6ab8-4912-8a95-3330dca126df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:43.714335 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-96096fd0-6ab8-4912-8a95-3330dca126df None None] MFA Rules not processed for user `7bddd37f0edd4183a43eaeb753790f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:43.716008 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-96096fd0-6ab8-4912-8a95-3330dca126df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:43.790373 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1244/2486] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:43 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:43.794910 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02d8fe-87ca-4b74-b345-7925656dc242 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:43.870959 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02d8fe-87ca-4b74-b345-7925656dc242 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:43.882038 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07435d-8fba-4109-80ba-7759c7064720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:43.882689 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07435d-8fba-4109-80ba-7759c7064720 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:43.883050 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07435d-8fba-4109-80ba-7759c7064720 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:43.883545 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07435d-8fba-4109-80ba-7759c7064720 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:43.884198 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07435d-8fba-4109-80ba-7759c7064720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:43.886193 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07435d-8fba-4109-80ba-7759c7064720 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:44.018958 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1243/2487] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:18:43 2021] POST /identity/v3/projects => generated 373 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:44.023955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96096fd0-6ab8-4912-8a95-3330dca126df None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:44.039519 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07435d-8fba-4109-80ba-7759c7064720 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:44.048436 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96096fd0-6ab8-4912-8a95-3330dca126df None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:44.123420 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07435d-8fba-4109-80ba-7759c7064720 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:44.141581 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1791c95-ef04-4034-a046-9b46f38a30b7 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e093e3b3f4974cefa303b3798a5a84c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1feea01b687543b9b960bb82c67969f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:44.142588 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1791c95-ef04-4034-a046-9b46f38a30b7 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:44.142967 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1791c95-ef04-4034-a046-9b46f38a30b7 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:44.143369 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1791c95-ef04-4034-a046-9b46f38a30b7 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:44.144254 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1791c95-ef04-4034-a046-9b46f38a30b7 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:18:44.144568 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1791c95-ef04-4034-a046-9b46f38a30b7 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:44.146263 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1791c95-ef04-4034-a046-9b46f38a30b7 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:44.149180 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342338c-0b80-4c50-ad3f-c90ce0b2e19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:44.150053 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342338c-0b80-4c50-ad3f-c90ce0b2e19c admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:44.150186 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342338c-0b80-4c50-ad3f-c90ce0b2e19c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:44.150460 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342338c-0b80-4c50-ad3f-c90ce0b2e19c admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:44.151314 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342338c-0b80-4c50-ad3f-c90ce0b2e19c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:44.153467 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342338c-0b80-4c50-ad3f-c90ce0b2e19c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:44.193304 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1244/2488] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:18:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:18:44.232643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1791c95-ef04-4034-a046-9b46f38a30b7 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:44.246615 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1791c95-ef04-4034-a046-9b46f38a30b7 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:44.251648 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01564edd-9fba-476e-a7d4-5cfac58ece31 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e093e3b3f4974cefa303b3798a5a84c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1feea01b687543b9b960bb82c67969f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:44.252315 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01564edd-9fba-476e-a7d4-5cfac58ece31 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:44.252599 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01564edd-9fba-476e-a7d4-5cfac58ece31 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:44.252879 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01564edd-9fba-476e-a7d4-5cfac58ece31 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:44.253589 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01564edd-9fba-476e-a7d4-5cfac58ece31 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:44.255539 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01564edd-9fba-476e-a7d4-5cfac58ece31 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:44.310081 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1245/2489] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:18:44 2021] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:44.315807 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342338c-0b80-4c50-ad3f-c90ce0b2e19c admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:44.326713 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342338c-0b80-4c50-ad3f-c90ce0b2e19c admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:44.331229 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b905e5-ba5e-4552-95b4-6f3f402698a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:44.331897 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b905e5-ba5e-4552-95b4-6f3f402698a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:44.332176 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b905e5-ba5e-4552-95b4-6f3f402698a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:44.332481 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b905e5-ba5e-4552-95b4-6f3f402698a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:44.333171 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b905e5-ba5e-4552-95b4-6f3f402698a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:44.334880 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b905e5-ba5e-4552-95b4-6f3f402698a9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:44.344683 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1246/2490] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:44 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:18:44.348726 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b905e5-ba5e-4552-95b4-6f3f402698a9 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:44.357786 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b905e5-ba5e-4552-95b4-6f3f402698a9 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:44.363955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce9b31-f94d-4fd1-a4b6-89acb6342e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:44.363955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce9b31-f94d-4fd1-a4b6-89acb6342e8f admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:44.363955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce9b31-f94d-4fd1-a4b6-89acb6342e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:44.363955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce9b31-f94d-4fd1-a4b6-89acb6342e8f admin admin] PATH_INFO: `/v3/projects/f16afedf8bdc4770ae60da0ddce7238a/users/a37cfffd90e14aa8aa8f37e7164326c4/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:44.378371 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce9b31-f94d-4fd1-a4b6-89acb6342e8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16afedf8bdc4770ae60da0ddce7238a, user_id=a37cfffd90e14aa8aa8f37e7164326c4, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:44.381179 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce9b31-f94d-4fd1-a4b6-89acb6342e8f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:44.404466 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1245/2491] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:18:44 2021] POST /identity/v3/projects => generated 354 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:18:44.409869 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01564edd-9fba-476e-a7d4-5cfac58ece31 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:44.467423 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01564edd-9fba-476e-a7d4-5cfac58ece31 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:44.470870 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1247/2492] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:44 2021] PUT /identity/v3/projects/f16afedf8bdc4770ae60da0ddce7238a/users/a37cfffd90e14aa8aa8f37e7164326c4/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:18:44.479314 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce9b31-f94d-4fd1-a4b6-89acb6342e8f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:44.546594 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce9b31-f94d-4fd1-a4b6-89acb6342e8f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:44.551859 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13671d9d-89d5-493a-bdeb-fbe1767676df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:44.557650 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13671d9d-89d5-493a-bdeb-fbe1767676df admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:44.557650 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13671d9d-89d5-493a-bdeb-fbe1767676df admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:44.557650 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13671d9d-89d5-493a-bdeb-fbe1767676df admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:44.557650 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13671d9d-89d5-493a-bdeb-fbe1767676df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:44.557650 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13671d9d-89d5-493a-bdeb-fbe1767676df admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:44.559823 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa0a7f-13c1-4678-b5fa-55e75771c3cc tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e093e3b3f4974cefa303b3798a5a84c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1feea01b687543b9b960bb82c67969f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:44.560517 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa0a7f-13c1-4678-b5fa-55e75771c3cc tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:44.560806 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa0a7f-13c1-4678-b5fa-55e75771c3cc tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:44.561086 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa0a7f-13c1-4678-b5fa-55e75771c3cc tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:44.561971 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa0a7f-13c1-4678-b5fa-55e75771c3cc tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:18:44.562287 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa0a7f-13c1-4678-b5fa-55e75771c3cc tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:44.564062 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa0a7f-13c1-4678-b5fa-55e75771c3cc tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:44.572811 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1248/2493] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:44 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:18:44.576741 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13671d9d-89d5-493a-bdeb-fbe1767676df admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:44.582119 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1246/2494] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:18:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:18:44.589969 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13671d9d-89d5-493a-bdeb-fbe1767676df admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:44.596942 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f9e40-a69b-460a-9082-be3d046b5717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:44.598248 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f9e40-a69b-460a-9082-be3d046b5717 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:44.598630 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f9e40-a69b-460a-9082-be3d046b5717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:44.599001 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f9e40-a69b-460a-9082-be3d046b5717 admin admin] PATH_INFO: `/v3/projects/f16afedf8bdc4770ae60da0ddce7238a/users/a37cfffd90e14aa8aa8f37e7164326c4/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:44.601460 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f9e40-a69b-460a-9082-be3d046b5717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16afedf8bdc4770ae60da0ddce7238a, user_id=a37cfffd90e14aa8aa8f37e7164326c4, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:44.604388 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f9e40-a69b-460a-9082-be3d046b5717 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:44.619026 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa0a7f-13c1-4678-b5fa-55e75771c3cc tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:44.622564 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1249/2495] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:44 2021] PUT /identity/v3/projects/f16afedf8bdc4770ae60da0ddce7238a/users/a37cfffd90e14aa8aa8f37e7164326c4/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:44.634192 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ba9dc-91ed-4932-83e9-f8d4c5919fde None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:44.634192 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ba9dc-91ed-4932-83e9-f8d4c5919fde None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:44.634192 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ba9dc-91ed-4932-83e9-f8d4c5919fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:44.638168 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa0a7f-13c1-4678-b5fa-55e75771c3cc tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:44.674876 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-419ba9dc-91ed-4932-83e9-f8d4c5919fde None None] MFA Rules not processed for user `a37cfffd90e14aa8aa8f37e7164326c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:44.680271 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-419ba9dc-91ed-4932-83e9-f8d4c5919fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:44.727282 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea12f70-bd30-48eb-b9e5-7bd41048e758 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e093e3b3f4974cefa303b3798a5a84c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1feea01b687543b9b960bb82c67969f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:44.728746 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea12f70-bd30-48eb-b9e5-7bd41048e758 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:44.729330 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea12f70-bd30-48eb-b9e5-7bd41048e758 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:44.729903 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea12f70-bd30-48eb-b9e5-7bd41048e758 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] PATH_INFO: `/v3/projects/208025bdcc5346b9adf487c6ca6f72ef` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:44.731723 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea12f70-bd30-48eb-b9e5-7bd41048e758 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] RBAC: Authorizing `identity:delete_project(project_id=208025bdcc5346b9adf487c6ca6f72ef)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:44.733621 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea12f70-bd30-48eb-b9e5-7bd41048e758 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:44.767258 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1250/2496] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:44 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:18:44.777383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ba9dc-91ed-4932-83e9-f8d4c5919fde None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:44.778873 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-419ba9dc-91ed-4932-83e9-f8d4c5919fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:44.838009 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ba9dc-91ed-4932-83e9-f8d4c5919fde None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:44.842604 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c36a93-8746-4ef5-bda4-5a6b94483fde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:44.843274 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c36a93-8746-4ef5-bda4-5a6b94483fde service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:44.843561 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c36a93-8746-4ef5-bda4-5a6b94483fde service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:44.843835 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c36a93-8746-4ef5-bda4-5a6b94483fde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:44.858289 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c36a93-8746-4ef5-bda4-5a6b94483fde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:44.859766 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c36a93-8746-4ef5-bda4-5a6b94483fde service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:44.870634 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1251/2497] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:18:44 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:18:44.888097 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-dea12f70-bd30-48eb-b9e5-7bd41048e758 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '208025bdcc5346b9adf487c6ca6f72ef', 'request_id': 'req-dea12f70-bd30-48eb-b9e5-7bd41048e758'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:44.897451 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-dea12f70-bd30-48eb-b9e5-7bd41048e758 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '208025bdcc5346b9adf487c6ca6f72ef', 'request_id': 'req-dea12f70-bd30-48eb-b9e5-7bd41048e758'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:44.902961 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-dea12f70-bd30-48eb-b9e5-7bd41048e758 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '208025bdcc5346b9adf487c6ca6f72ef', 'request_id': 'req-dea12f70-bd30-48eb-b9e5-7bd41048e758'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:45.013018 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-dea12f70-bd30-48eb-b9e5-7bd41048e758 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] The token cache is being invalidate because project 208025bdcc5346b9adf487c6ca6f72ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:18:45.013342 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-dea12f70-bd30-48eb-b9e5-7bd41048e758 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:45.014068 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-dea12f70-bd30-48eb-b9e5-7bd41048e758 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:45.015992 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1247/2498] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:18:44 2021] DELETE /identity/v3/projects/208025bdcc5346b9adf487c6ca6f72ef => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:18:45.667912 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c36a93-8746-4ef5-bda4-5a6b94483fde service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:45.763165 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c36a93-8746-4ef5-bda4-5a6b94483fde service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:45.829363 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea12f70-bd30-48eb-b9e5-7bd41048e758 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:45.832690 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-dea12f70-bd30-48eb-b9e5-7bd41048e758 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:45.851984 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf15d1d-9ebd-4b7a-97c6-45effbd69ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:45.853088 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf15d1d-9ebd-4b7a-97c6-45effbd69ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:45.853443 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf15d1d-9ebd-4b7a-97c6-45effbd69ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:45.853789 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf15d1d-9ebd-4b7a-97c6-45effbd69ebf admin admin] PATH_INFO: `/v3/users/7bddd37f0edd4183a43eaeb753790f1b` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:45.855405 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf15d1d-9ebd-4b7a-97c6-45effbd69ebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bddd37f0edd4183a43eaeb753790f1b)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:45.860778 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf15d1d-9ebd-4b7a-97c6-45effbd69ebf admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:45.922135 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea12f70-bd30-48eb-b9e5-7bd41048e758 tempest-VolumeQuotaClassesTest-259703267 tempest-VolumeQuotaClassesTest-259703267-project-admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:45.927337 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3803c4-db8a-4cf0-b0ab-461a0c4c355b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:45.929850 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3803c4-db8a-4cf0-b0ab-461a0c4c355b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:45.930492 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3803c4-db8a-4cf0-b0ab-461a0c4c355b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:45.930902 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3803c4-db8a-4cf0-b0ab-461a0c4c355b admin admin] PATH_INFO: `/v3/users/79bbe69e7fdd45ce83990563819b9568` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:45.932966 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3803c4-db8a-4cf0-b0ab-461a0c4c355b admin admin] RBAC: Authorizing `identity:delete_user(user_id=79bbe69e7fdd45ce83990563819b9568)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:45.936675 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3803c4-db8a-4cf0-b0ab-461a0c4c355b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:46.087415 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-dcf15d1d-9ebd-4b7a-97c6-45effbd69ebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bddd37f0edd4183a43eaeb753790f1b'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:46.135121 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-af3803c4-db8a-4cf0-b0ab-461a0c4c355b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79bbe69e7fdd45ce83990563819b9568'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:46.200921 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-dcf15d1d-9ebd-4b7a-97c6-45effbd69ebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bddd37f0edd4183a43eaeb753790f1b'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:46.212096 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-dcf15d1d-9ebd-4b7a-97c6-45effbd69ebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bddd37f0edd4183a43eaeb753790f1b'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:46.212952 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-dcf15d1d-9ebd-4b7a-97c6-45effbd69ebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bddd37f0edd4183a43eaeb753790f1b'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:46.228031 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-dcf15d1d-9ebd-4b7a-97c6-45effbd69ebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bddd37f0edd4183a43eaeb753790f1b'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:46.241445 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1252/2499] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:18:45 2021] DELETE /identity/v3/users/7bddd37f0edd4183a43eaeb753790f1b => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:46.246636 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a819a0b-b966-4956-a802-b9e202026a4b None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:46.246636 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a819a0b-b966-4956-a802-b9e202026a4b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:46.246636 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a819a0b-b966-4956-a802-b9e202026a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:46.264446 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-0a819a0b-b966-4956-a802-b9e202026a4b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:46.266078 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-0a819a0b-b966-4956-a802-b9e202026a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:46.274579 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-af3803c4-db8a-4cf0-b0ab-461a0c4c355b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79bbe69e7fdd45ce83990563819b9568'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:46.284581 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-af3803c4-db8a-4cf0-b0ab-461a0c4c355b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79bbe69e7fdd45ce83990563819b9568'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:46.285309 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-af3803c4-db8a-4cf0-b0ab-461a0c4c355b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79bbe69e7fdd45ce83990563819b9568'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:46.303537 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-af3803c4-db8a-4cf0-b0ab-461a0c4c355b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79bbe69e7fdd45ce83990563819b9568'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:46.318222 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1248/2500] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:18:45 2021] DELETE /identity/v3/users/79bbe69e7fdd45ce83990563819b9568 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:18:46.320763 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645a2a6-f416-4a2b-a131-70dd90a86854 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:46.321194 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645a2a6-f416-4a2b-a131-70dd90a86854 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:46.321562 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645a2a6-f416-4a2b-a131-70dd90a86854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:46.340135 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-b645a2a6-f416-4a2b-a131-70dd90a86854 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:46.341563 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-b645a2a6-f416-4a2b-a131-70dd90a86854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:46.390216 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1253/2501] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:46.397201 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a819a0b-b966-4956-a802-b9e202026a4b None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:46.400351 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-0a819a0b-b966-4956-a802-b9e202026a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:46.444586 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1249/2502] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:46.462487 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645a2a6-f416-4a2b-a131-70dd90a86854 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:46.463952 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-b645a2a6-f416-4a2b-a131-70dd90a86854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:46.516355 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a819a0b-b966-4956-a802-b9e202026a4b None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:46.569783 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645a2a6-f416-4a2b-a131-70dd90a86854 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:46.576561 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d237c5-4edc-467b-8112-81652bd58777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:46.578068 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d237c5-4edc-467b-8112-81652bd58777 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:46.578424 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d237c5-4edc-467b-8112-81652bd58777 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:46.578796 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d237c5-4edc-467b-8112-81652bd58777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:46.590433 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d237c5-4edc-467b-8112-81652bd58777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:46.592099 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d237c5-4edc-467b-8112-81652bd58777 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:46.605906 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905696ff-67a9-423c-b142-b1d38756f69e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:46.606848 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1250/2503] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:18:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:18:46.614109 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905696ff-67a9-423c-b142-b1d38756f69e service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:46.619867 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905696ff-67a9-423c-b142-b1d38756f69e service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:46.620345 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905696ff-67a9-423c-b142-b1d38756f69e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:46.634087 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905696ff-67a9-423c-b142-b1d38756f69e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:46.635771 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905696ff-67a9-423c-b142-b1d38756f69e service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:46.647141 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1254/2504] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:18:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:18:47.135236 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d237c5-4edc-467b-8112-81652bd58777 service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:47.138329 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-57d237c5-4edc-467b-8112-81652bd58777 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:47.155662 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d237c5-4edc-467b-8112-81652bd58777 service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:47.172101 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42db40d-0a4e-4849-b8ff-e3db2fbbee3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:47.172974 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42db40d-0a4e-4849-b8ff-e3db2fbbee3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:47.173265 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42db40d-0a4e-4849-b8ff-e3db2fbbee3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:47.173543 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42db40d-0a4e-4849-b8ff-e3db2fbbee3d admin admin] PATH_INFO: `/v3/projects/c3813ed97e3b47b096dd4603701e1490` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:47.174800 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42db40d-0a4e-4849-b8ff-e3db2fbbee3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3813ed97e3b47b096dd4603701e1490)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:47.177137 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42db40d-0a4e-4849-b8ff-e3db2fbbee3d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:47.194225 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905696ff-67a9-423c-b142-b1d38756f69e service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:47.198824 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-905696ff-67a9-423c-b142-b1d38756f69e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:47.221620 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905696ff-67a9-423c-b142-b1d38756f69e service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:47.248937 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94135457-b4e1-46c7-b3a6-606dd398c10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:47.249319 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94135457-b4e1-46c7-b3a6-606dd398c10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:47.249673 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94135457-b4e1-46c7-b3a6-606dd398c10a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:47.249941 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94135457-b4e1-46c7-b3a6-606dd398c10a admin admin] PATH_INFO: `/v3/projects/3e6cc7dff67e4f87a8fd37563e11efda` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:47.251401 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94135457-b4e1-46c7-b3a6-606dd398c10a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e6cc7dff67e4f87a8fd37563e11efda)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:47.253336 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94135457-b4e1-46c7-b3a6-606dd398c10a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:47.327472 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-a42db40d-0a4e-4849-b8ff-e3db2fbbee3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3813ed97e3b47b096dd4603701e1490', 'request_id': 'req-a42db40d-0a4e-4849-b8ff-e3db2fbbee3d'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:47.335987 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-a42db40d-0a4e-4849-b8ff-e3db2fbbee3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3813ed97e3b47b096dd4603701e1490', 'request_id': 'req-a42db40d-0a4e-4849-b8ff-e3db2fbbee3d'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:47.358899 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-a42db40d-0a4e-4849-b8ff-e3db2fbbee3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3813ed97e3b47b096dd4603701e1490', 'request_id': 'req-a42db40d-0a4e-4849-b8ff-e3db2fbbee3d'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:47.456881 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-94135457-b4e1-46c7-b3a6-606dd398c10a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e6cc7dff67e4f87a8fd37563e11efda', 'request_id': 'req-94135457-b4e1-46c7-b3a6-606dd398c10a'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:47.462926 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-94135457-b4e1-46c7-b3a6-606dd398c10a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e6cc7dff67e4f87a8fd37563e11efda', 'request_id': 'req-94135457-b4e1-46c7-b3a6-606dd398c10a'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:47.468167 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-94135457-b4e1-46c7-b3a6-606dd398c10a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e6cc7dff67e4f87a8fd37563e11efda', 'request_id': 'req-94135457-b4e1-46c7-b3a6-606dd398c10a'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:47.509563 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-a42db40d-0a4e-4849-b8ff-e3db2fbbee3d admin admin] The token cache is being invalidate because project c3813ed97e3b47b096dd4603701e1490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:18:47.509962 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-a42db40d-0a4e-4849-b8ff-e3db2fbbee3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:47.510657 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-a42db40d-0a4e-4849-b8ff-e3db2fbbee3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:47.512538 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1251/2505] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:18:47 2021] DELETE /identity/v3/projects/c3813ed97e3b47b096dd4603701e1490 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:47.516470 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42db40d-0a4e-4849-b8ff-e3db2fbbee3d admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:47.517889 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-a42db40d-0a4e-4849-b8ff-e3db2fbbee3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:47.592270 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42db40d-0a4e-4849-b8ff-e3db2fbbee3d admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:47.603189 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-94135457-b4e1-46c7-b3a6-606dd398c10a admin admin] The token cache is being invalidate because project 3e6cc7dff67e4f87a8fd37563e11efda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:18:47.603520 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-94135457-b4e1-46c7-b3a6-606dd398c10a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:47.604432 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-94135457-b4e1-46c7-b3a6-606dd398c10a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:47.606370 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1255/2506] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:18:47 2021] DELETE /identity/v3/projects/3e6cc7dff67e4f87a8fd37563e11efda => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:47.610895 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94135457-b4e1-46c7-b3a6-606dd398c10a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:47.612759 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-94135457-b4e1-46c7-b3a6-606dd398c10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:47.704401 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b8563-3d73-48db-bdd3-6838dbe225cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:47.705548 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b8563-3d73-48db-bdd3-6838dbe225cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:47.706138 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b8563-3d73-48db-bdd3-6838dbe225cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:47.706581 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b8563-3d73-48db-bdd3-6838dbe225cf admin admin] PATH_INFO: `/v3/users/e093e3b3f4974cefa303b3798a5a84c5` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:47.708076 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b8563-3d73-48db-bdd3-6838dbe225cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e093e3b3f4974cefa303b3798a5a84c5)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:47.711299 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b8563-3d73-48db-bdd3-6838dbe225cf admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:47.720728 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94135457-b4e1-46c7-b3a6-606dd398c10a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:47.727914 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b00854-f2ed-4b87-ac5b-84ec1fd015d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:47.728792 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b00854-f2ed-4b87-ac5b-84ec1fd015d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:47.729086 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b00854-f2ed-4b87-ac5b-84ec1fd015d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:47.729349 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b00854-f2ed-4b87-ac5b-84ec1fd015d3 admin admin] PATH_INFO: `/v3/users/a37cfffd90e14aa8aa8f37e7164326c4` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:47.730550 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b00854-f2ed-4b87-ac5b-84ec1fd015d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a37cfffd90e14aa8aa8f37e7164326c4)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:47.732812 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b00854-f2ed-4b87-ac5b-84ec1fd015d3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:47.924576 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-fa1b8563-3d73-48db-bdd3-6838dbe225cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e093e3b3f4974cefa303b3798a5a84c5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:47.988016 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d1b00854-f2ed-4b87-ac5b-84ec1fd015d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a37cfffd90e14aa8aa8f37e7164326c4'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:47.994933 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-fa1b8563-3d73-48db-bdd3-6838dbe225cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e093e3b3f4974cefa303b3798a5a84c5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:48.006310 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-fa1b8563-3d73-48db-bdd3-6838dbe225cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e093e3b3f4974cefa303b3798a5a84c5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:48.006917 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-fa1b8563-3d73-48db-bdd3-6838dbe225cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e093e3b3f4974cefa303b3798a5a84c5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:48.020746 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-fa1b8563-3d73-48db-bdd3-6838dbe225cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e093e3b3f4974cefa303b3798a5a84c5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:48.029327 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1252/2507] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:18:47 2021] DELETE /identity/v3/users/e093e3b3f4974cefa303b3798a5a84c5 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:18:48.069394 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d1b00854-f2ed-4b87-ac5b-84ec1fd015d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a37cfffd90e14aa8aa8f37e7164326c4'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:48.078751 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d1b00854-f2ed-4b87-ac5b-84ec1fd015d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a37cfffd90e14aa8aa8f37e7164326c4'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:48.080835 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d1b00854-f2ed-4b87-ac5b-84ec1fd015d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a37cfffd90e14aa8aa8f37e7164326c4'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:48.098195 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d1b00854-f2ed-4b87-ac5b-84ec1fd015d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a37cfffd90e14aa8aa8f37e7164326c4'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:48.118556 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1256/2508] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:18:47 2021] DELETE /identity/v3/users/a37cfffd90e14aa8aa8f37e7164326c4 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:18:48.567816 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b8563-3d73-48db-bdd3-6838dbe225cf admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:48.569400 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-fa1b8563-3d73-48db-bdd3-6838dbe225cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:48.634189 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b8563-3d73-48db-bdd3-6838dbe225cf admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:48.653145 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b00854-f2ed-4b87-ac5b-84ec1fd015d3 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:48.653145 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-d1b00854-f2ed-4b87-ac5b-84ec1fd015d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:48.699381 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bde887-dee0-46c4-8536-b6ed3d42d227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:48.700234 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bde887-dee0-46c4-8536-b6ed3d42d227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:48.700519 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bde887-dee0-46c4-8536-b6ed3d42d227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:48.700827 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bde887-dee0-46c4-8536-b6ed3d42d227 admin admin] PATH_INFO: `/v3/projects/1feea01b687543b9b960bb82c67969f8` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:48.702093 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bde887-dee0-46c4-8536-b6ed3d42d227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1feea01b687543b9b960bb82c67969f8)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:48.704014 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bde887-dee0-46c4-8536-b6ed3d42d227 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:48.729827 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b00854-f2ed-4b87-ac5b-84ec1fd015d3 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:48.734479 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f9bb0-9dc9-4ff2-bf55-19b992f5f02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:48.735355 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f9bb0-9dc9-4ff2-bf55-19b992f5f02f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:48.735638 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f9bb0-9dc9-4ff2-bf55-19b992f5f02f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:48.735909 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f9bb0-9dc9-4ff2-bf55-19b992f5f02f admin admin] PATH_INFO: `/v3/projects/f16afedf8bdc4770ae60da0ddce7238a` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:48.737113 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f9bb0-9dc9-4ff2-bf55-19b992f5f02f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f16afedf8bdc4770ae60da0ddce7238a)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:48.739059 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f9bb0-9dc9-4ff2-bf55-19b992f5f02f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:48.879117 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ea2f9bb0-9dc9-4ff2-bf55-19b992f5f02f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f16afedf8bdc4770ae60da0ddce7238a', 'request_id': 'req-ea2f9bb0-9dc9-4ff2-bf55-19b992f5f02f'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:48.880363 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f4bde887-dee0-46c4-8536-b6ed3d42d227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1feea01b687543b9b960bb82c67969f8', 'request_id': 'req-f4bde887-dee0-46c4-8536-b6ed3d42d227'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:48.886403 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ea2f9bb0-9dc9-4ff2-bf55-19b992f5f02f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f16afedf8bdc4770ae60da0ddce7238a', 'request_id': 'req-ea2f9bb0-9dc9-4ff2-bf55-19b992f5f02f'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:48.886853 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f4bde887-dee0-46c4-8536-b6ed3d42d227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1feea01b687543b9b960bb82c67969f8', 'request_id': 'req-f4bde887-dee0-46c4-8536-b6ed3d42d227'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:48.892198 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ea2f9bb0-9dc9-4ff2-bf55-19b992f5f02f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f16afedf8bdc4770ae60da0ddce7238a', 'request_id': 'req-ea2f9bb0-9dc9-4ff2-bf55-19b992f5f02f'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:48.902119 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f4bde887-dee0-46c4-8536-b6ed3d42d227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1feea01b687543b9b960bb82c67969f8', 'request_id': 'req-f4bde887-dee0-46c4-8536-b6ed3d42d227'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:48.999292 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ea2f9bb0-9dc9-4ff2-bf55-19b992f5f02f admin admin] The token cache is being invalidate because project f16afedf8bdc4770ae60da0ddce7238a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:18:48.999563 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ea2f9bb0-9dc9-4ff2-bf55-19b992f5f02f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:49.000185 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ea2f9bb0-9dc9-4ff2-bf55-19b992f5f02f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:49.001724 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1257/2509] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:18:48 2021] DELETE /identity/v3/projects/f16afedf8bdc4770ae60da0ddce7238a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:18:49.007349 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30454597-1e7a-467e-8e73-4d1c35873327 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:49.007631 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30454597-1e7a-467e-8e73-4d1c35873327 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:49.007906 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30454597-1e7a-467e-8e73-4d1c35873327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:49.025756 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-30454597-1e7a-467e-8e73-4d1c35873327 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:49.026936 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-30454597-1e7a-467e-8e73-4d1c35873327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:49.062219 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f4bde887-dee0-46c4-8536-b6ed3d42d227 admin admin] The token cache is being invalidate because project 1feea01b687543b9b960bb82c67969f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:18:49.062435 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f4bde887-dee0-46c4-8536-b6ed3d42d227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:49.063049 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f4bde887-dee0-46c4-8536-b6ed3d42d227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:49.064681 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1253/2510] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:18:48 2021] DELETE /identity/v3/projects/1feea01b687543b9b960bb82c67969f8 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:49.070496 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f91e0a-cdf5-40bd-be31-7af6715bc1a4 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:49.070780 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f91e0a-cdf5-40bd-be31-7af6715bc1a4 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:49.071057 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f91e0a-cdf5-40bd-be31-7af6715bc1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:49.089149 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-36f91e0a-cdf5-40bd-be31-7af6715bc1a4 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:49.089707 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1258/2511] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:18:49.090645 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-36f91e0a-cdf5-40bd-be31-7af6715bc1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:49.098703 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bd812-f94b-4fd8-95ad-96af9eab3e9d None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:49.098990 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bd812-f94b-4fd8-95ad-96af9eab3e9d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:49.105645 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1254/2512] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:18:49.105795 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bd812-f94b-4fd8-95ad-96af9eab3e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:49.107052 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1364d88-26e5-4423-8d87-5c6e9004f2b9 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:49.107381 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1364d88-26e5-4423-8d87-5c6e9004f2b9 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:49.107661 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1364d88-26e5-4423-8d87-5c6e9004f2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:49.117911 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-612bd812-f94b-4fd8-95ad-96af9eab3e9d None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:49.119111 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-612bd812-f94b-4fd8-95ad-96af9eab3e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:49.127081 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1259/2513] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:18:49.128864 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-a1364d88-26e5-4423-8d87-5c6e9004f2b9 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:49.130046 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-a1364d88-26e5-4423-8d87-5c6e9004f2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:49.131364 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bd812-f94b-4fd8-95ad-96af9eab3e9d None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:49.141316 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1255/2514] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:18:49.141499 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bd812-f94b-4fd8-95ad-96af9eab3e9d None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:49.142444 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1364d88-26e5-4423-8d87-5c6e9004f2b9 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:49.145338 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd1aa4-81f0-4dce-aa25-705a5c6b8769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:49.145973 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd1aa4-81f0-4dce-aa25-705a5c6b8769 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:49.146256 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd1aa4-81f0-4dce-aa25-705a5c6b8769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:49.147047 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd1aa4-81f0-4dce-aa25-705a5c6b8769 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:49.147921 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd1aa4-81f0-4dce-aa25-705a5c6b8769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:18:49.148277 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd1aa4-81f0-4dce-aa25-705a5c6b8769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:49.150099 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd1aa4-81f0-4dce-aa25-705a5c6b8769 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:49.151987 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1364d88-26e5-4423-8d87-5c6e9004f2b9 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:49.156557 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ab995-c074-4093-8abc-bd45c09c702b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:49.157190 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ab995-c074-4093-8abc-bd45c09c702b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:49.157464 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ab995-c074-4093-8abc-bd45c09c702b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:49.157738 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ab995-c074-4093-8abc-bd45c09c702b admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:49.158467 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ab995-c074-4093-8abc-bd45c09c702b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:18:49.158772 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ab995-c074-4093-8abc-bd45c09c702b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:49.160361 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ab995-c074-4093-8abc-bd45c09c702b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:49.161724 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1260/2515] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:18:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 04:18:49.166738 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd1aa4-81f0-4dce-aa25-705a5c6b8769 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:49.175752 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1256/2516] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:18:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 04:18:49.176006 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd1aa4-81f0-4dce-aa25-705a5c6b8769 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:49.176827 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ab995-c074-4093-8abc-bd45c09c702b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:49.180623 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676029f-4715-4eef-ac64-90dab21e7702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:49.181262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676029f-4715-4eef-ac64-90dab21e7702 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:49.181540 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676029f-4715-4eef-ac64-90dab21e7702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:49.181812 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676029f-4715-4eef-ac64-90dab21e7702 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:49.182507 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676029f-4715-4eef-ac64-90dab21e7702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:49.184389 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676029f-4715-4eef-ac64-90dab21e7702 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:49.186463 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ab995-c074-4093-8abc-bd45c09c702b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:49.191223 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b968c-504f-4f52-9ace-7e12c2581f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:49.192054 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b968c-504f-4f52-9ace-7e12c2581f7f admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:49.192340 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b968c-504f-4f52-9ace-7e12c2581f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:49.192616 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b968c-504f-4f52-9ace-7e12c2581f7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:49.193320 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b968c-504f-4f52-9ace-7e12c2581f7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:49.195737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b968c-504f-4f52-9ace-7e12c2581f7f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:49.304395 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1261/2517] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:18:49 2021] POST /identity/v3/projects => generated 393 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:18:49.304832 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1257/2518] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:18:49 2021] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:18:49.308548 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b968c-504f-4f52-9ace-7e12c2581f7f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:49.313175 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676029f-4715-4eef-ac64-90dab21e7702 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:49.369540 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b968c-504f-4f52-9ace-7e12c2581f7f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:49.370405 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676029f-4715-4eef-ac64-90dab21e7702 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:49.374244 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f314bf1-3998-4bfc-b67f-a93137a51cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:49.374903 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f314bf1-3998-4bfc-b67f-a93137a51cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:49.375189 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f314bf1-3998-4bfc-b67f-a93137a51cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:49.375560 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad62a9a-394f-4c06-8cda-17fc0c32948f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:49.375668 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f314bf1-3998-4bfc-b67f-a93137a51cd7 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:49.376127 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad62a9a-394f-4c06-8cda-17fc0c32948f admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:49.376240 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f314bf1-3998-4bfc-b67f-a93137a51cd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:49.376417 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad62a9a-394f-4c06-8cda-17fc0c32948f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:49.376691 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad62a9a-394f-4c06-8cda-17fc0c32948f admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:49.377390 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad62a9a-394f-4c06-8cda-17fc0c32948f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:49.378082 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f314bf1-3998-4bfc-b67f-a93137a51cd7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:49.379309 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad62a9a-394f-4c06-8cda-17fc0c32948f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:49.463701 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1258/2519] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:18:49 2021] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:18:49.467724 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f314bf1-3998-4bfc-b67f-a93137a51cd7 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:49.477228 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f314bf1-3998-4bfc-b67f-a93137a51cd7 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:49.481825 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58387b-23b6-475a-b2e6-89b96e2d69f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:49.488220 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58387b-23b6-475a-b2e6-89b96e2d69f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:49.488220 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58387b-23b6-475a-b2e6-89b96e2d69f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:49.488220 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58387b-23b6-475a-b2e6-89b96e2d69f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:49.488220 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58387b-23b6-475a-b2e6-89b96e2d69f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:49.488220 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58387b-23b6-475a-b2e6-89b96e2d69f1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:49.495072 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1259/2520] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:49 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:18:49.498796 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58387b-23b6-475a-b2e6-89b96e2d69f1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:49.509284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58387b-23b6-475a-b2e6-89b96e2d69f1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:49.513886 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62562e-0b6b-4116-868b-4cf925caf976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:49.514504 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62562e-0b6b-4116-868b-4cf925caf976 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:49.514790 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62562e-0b6b-4116-868b-4cf925caf976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:49.515067 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62562e-0b6b-4116-868b-4cf925caf976 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:49.515816 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62562e-0b6b-4116-868b-4cf925caf976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:49.517366 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62562e-0b6b-4116-868b-4cf925caf976 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:49.528430 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1260/2521] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:49 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:18:49.533027 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1262/2522] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:18:49 2021] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:18:49.536898 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62562e-0b6b-4116-868b-4cf925caf976 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:49.537194 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad62a9a-394f-4c06-8cda-17fc0c32948f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:49.546772 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62562e-0b6b-4116-868b-4cf925caf976 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:49.547660 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad62a9a-394f-4c06-8cda-17fc0c32948f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:49.551386 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48735932-94a7-4118-b0b0-85cc131df394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:49.552250 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48735932-94a7-4118-b0b0-85cc131df394 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:49.552363 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e1fb4-a00c-4863-8e6d-35c852229e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:49.552529 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48735932-94a7-4118-b0b0-85cc131df394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:49.553514 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48735932-94a7-4118-b0b0-85cc131df394 admin admin] PATH_INFO: `/v3/projects/4d90e88077114e3bae58432c56aac5f5/users/10c16bffb25e4a7a84246613a19c6acb/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:49.553648 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e1fb4-a00c-4863-8e6d-35c852229e29 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:49.554298 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e1fb4-a00c-4863-8e6d-35c852229e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:49.554582 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e1fb4-a00c-4863-8e6d-35c852229e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:49.555362 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e1fb4-a00c-4863-8e6d-35c852229e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:49.556970 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e1fb4-a00c-4863-8e6d-35c852229e29 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:49.570802 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1263/2523] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:49 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:18:49.570978 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48735932-94a7-4118-b0b0-85cc131df394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d90e88077114e3bae58432c56aac5f5, user_id=10c16bffb25e4a7a84246613a19c6acb, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:49.571504 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48735932-94a7-4118-b0b0-85cc131df394 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:49.572624 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e1fb4-a00c-4863-8e6d-35c852229e29 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:49.582204 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e1fb4-a00c-4863-8e6d-35c852229e29 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:49.587000 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f0060-322e-4378-b631-6425232e54b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:49.587691 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f0060-322e-4378-b631-6425232e54b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:49.587973 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f0060-322e-4378-b631-6425232e54b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:49.588253 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f0060-322e-4378-b631-6425232e54b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:49.588979 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f0060-322e-4378-b631-6425232e54b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:49.590632 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f0060-322e-4378-b631-6425232e54b2 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:49.600532 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1264/2524] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:49 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:18:49.604537 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f0060-322e-4378-b631-6425232e54b2 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:49.613949 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f0060-322e-4378-b631-6425232e54b2 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:49.619380 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7e0ef-db83-4e76-8e4e-83a1cb16a792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:49.620220 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7e0ef-db83-4e76-8e4e-83a1cb16a792 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:49.620498 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7e0ef-db83-4e76-8e4e-83a1cb16a792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:49.620771 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7e0ef-db83-4e76-8e4e-83a1cb16a792 admin admin] PATH_INFO: `/v3/projects/05e1de207c9c458591fb3d9717e5baf9/users/3d81d2308c034f28a5f20d41bda8b201/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:49.635658 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7e0ef-db83-4e76-8e4e-83a1cb16a792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e1de207c9c458591fb3d9717e5baf9, user_id=3d81d2308c034f28a5f20d41bda8b201, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:49.638262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7e0ef-db83-4e76-8e4e-83a1cb16a792 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:49.649625 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1261/2525] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:49 2021] PUT /identity/v3/projects/4d90e88077114e3bae58432c56aac5f5/users/10c16bffb25e4a7a84246613a19c6acb/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:49.660626 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f053f-bbd0-4534-8865-0556f82e9b9f None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:49.660909 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f053f-bbd0-4534-8865-0556f82e9b9f None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:49.661184 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f053f-bbd0-4534-8865-0556f82e9b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:49.688069 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-8b8f053f-bbd0-4534-8865-0556f82e9b9f None None] MFA Rules not processed for user `10c16bffb25e4a7a84246613a19c6acb`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:49.689514 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-8b8f053f-bbd0-4534-8865-0556f82e9b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:49.735418 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1265/2526] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:49 2021] PUT /identity/v3/projects/05e1de207c9c458591fb3d9717e5baf9/users/3d81d2308c034f28a5f20d41bda8b201/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:18:49.746152 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749089c3-5b88-4fab-be78-e07c5866cb92 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:49.746436 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749089c3-5b88-4fab-be78-e07c5866cb92 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:49.746718 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749089c3-5b88-4fab-be78-e07c5866cb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:49.751947 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1262/2527] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:49 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:18:49.756619 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f053f-bbd0-4534-8865-0556f82e9b9f None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:49.775896 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-749089c3-5b88-4fab-be78-e07c5866cb92 None None] MFA Rules not processed for user `3d81d2308c034f28a5f20d41bda8b201`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:49.777097 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-749089c3-5b88-4fab-be78-e07c5866cb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:49.821470 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f053f-bbd0-4534-8865-0556f82e9b9f None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:49.847908 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1266/2528] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:49 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:18:49.848867 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749089c3-5b88-4fab-be78-e07c5866cb92 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:49.888406 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8973cde-4d93-45bc-b7b9-36294efd1284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:49.889453 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8973cde-4d93-45bc-b7b9-36294efd1284 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:49.889748 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8973cde-4d93-45bc-b7b9-36294efd1284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:49.890029 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8973cde-4d93-45bc-b7b9-36294efd1284 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:49.890733 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8973cde-4d93-45bc-b7b9-36294efd1284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:49.892639 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8973cde-4d93-45bc-b7b9-36294efd1284 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:49.917973 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749089c3-5b88-4fab-be78-e07c5866cb92 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:49.922563 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ee912-b138-45f7-8d2e-7046beac0c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:49.925292 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ee912-b138-45f7-8d2e-7046beac0c88 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:49.925292 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ee912-b138-45f7-8d2e-7046beac0c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:49.925292 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ee912-b138-45f7-8d2e-7046beac0c88 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:49.925292 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ee912-b138-45f7-8d2e-7046beac0c88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:49.926363 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ee912-b138-45f7-8d2e-7046beac0c88 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:50.015263 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1263/2529] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:18:49 2021] POST /identity/v3/projects => generated 385 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:18:50.016606 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e57f4f-2dfb-442a-8af4-c896dac975fb None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:50.016922 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e57f4f-2dfb-442a-8af4-c896dac975fb None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:50.017197 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e57f4f-2dfb-442a-8af4-c896dac975fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:50.034677 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-92e57f4f-2dfb-442a-8af4-c896dac975fb None None] MFA Rules not processed for user `b68d0745d9cb49a5bd9331148967764a`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:50.035892 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-92e57f4f-2dfb-442a-8af4-c896dac975fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:50.077539 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1267/2530] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:18:49 2021] POST /identity/v3/projects => generated 393 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:18:50.077539 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ee912-b138-45f7-8d2e-7046beac0c88 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:50.089055 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1264/2531] 10.222.0.54 () {58 vars in 967 bytes} [Tue Nov 23 04:18:50 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:50.092084 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e57f4f-2dfb-442a-8af4-c896dac975fb None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:50.137911 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ee912-b138-45f7-8d2e-7046beac0c88 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:50.142913 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7fefb-492a-4a5d-a3a7-9114134eaa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:50.143607 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7fefb-492a-4a5d-a3a7-9114134eaa9c admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:50.143893 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7fefb-492a-4a5d-a3a7-9114134eaa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:50.144170 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7fefb-492a-4a5d-a3a7-9114134eaa9c admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:50.144872 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7fefb-492a-4a5d-a3a7-9114134eaa9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:50.147760 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7fefb-492a-4a5d-a3a7-9114134eaa9c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:50.152901 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e57f4f-2dfb-442a-8af4-c896dac975fb None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:50.157437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c03fc0-bdaa-46d0-b5ff-6f096c144381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:50.158091 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c03fc0-bdaa-46d0-b5ff-6f096c144381 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:50.158376 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c03fc0-bdaa-46d0-b5ff-6f096c144381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:50.158649 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c03fc0-bdaa-46d0-b5ff-6f096c144381 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:50.159379 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c03fc0-bdaa-46d0-b5ff-6f096c144381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:50.161259 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c03fc0-bdaa-46d0-b5ff-6f096c144381 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:50.268843 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1268/2532] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:18:50 2021] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:50.269667 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7fefb-492a-4a5d-a3a7-9114134eaa9c admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:50.271248 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-52f7fefb-492a-4a5d-a3a7-9114134eaa9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:50.298734 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1265/2533] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:18:50 2021] POST /identity/v3/users => generated 303 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:50.298734 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c03fc0-bdaa-46d0-b5ff-6f096c144381 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:50.308549 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c03fc0-bdaa-46d0-b5ff-6f096c144381 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:50.313238 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5aa043-48b2-4466-952c-00de434e49ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:50.314167 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5aa043-48b2-4466-952c-00de434e49ba admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:50.314455 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5aa043-48b2-4466-952c-00de434e49ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:50.314736 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5aa043-48b2-4466-952c-00de434e49ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:50.315507 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5aa043-48b2-4466-952c-00de434e49ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:50.317164 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5aa043-48b2-4466-952c-00de434e49ba admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:50.328147 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1266/2534] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:18:50.329041 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5aa043-48b2-4466-952c-00de434e49ba admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:50.339415 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5aa043-48b2-4466-952c-00de434e49ba admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:50.340779 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7fefb-492a-4a5d-a3a7-9114134eaa9c admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:50.344032 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8eab7d-c2b1-41f0-8a76-cb26eb646751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:50.344657 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eab7d-c2b1-41f0-8a76-cb26eb646751 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:50.344939 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eab7d-c2b1-41f0-8a76-cb26eb646751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:50.345215 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eab7d-c2b1-41f0-8a76-cb26eb646751 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:50.345915 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0393a-368d-406a-baf3-f7056b8d6fee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd439c1f0764f4cac7eb641a485937a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:50.346053 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8eab7d-c2b1-41f0-8a76-cb26eb646751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:50.346573 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0393a-368d-406a-baf3-f7056b8d6fee service swift] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:50.346858 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0393a-368d-406a-baf3-f7056b8d6fee service swift] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:50.347133 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0393a-368d-406a-baf3-f7056b8d6fee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:50.347502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8eab7d-c2b1-41f0-8a76-cb26eb646751 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:50.357807 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1267/2535] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:50 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:18:50.358591 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8eab7d-c2b1-41f0-8a76-cb26eb646751 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:50.368121 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8eab7d-c2b1-41f0-8a76-cb26eb646751 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:50.372657 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78ecff-2dbe-43bc-ad37-4ec66ccb418c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:50.373277 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78ecff-2dbe-43bc-ad37-4ec66ccb418c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:50.373558 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78ecff-2dbe-43bc-ad37-4ec66ccb418c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:50.373831 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78ecff-2dbe-43bc-ad37-4ec66ccb418c admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:50.374570 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78ecff-2dbe-43bc-ad37-4ec66ccb418c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:50.376145 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78ecff-2dbe-43bc-ad37-4ec66ccb418c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:50.386169 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1268/2536] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:50 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:18:50.386924 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78ecff-2dbe-43bc-ad37-4ec66ccb418c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:50.395831 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78ecff-2dbe-43bc-ad37-4ec66ccb418c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:50.400993 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd6598-1437-4a6c-b7bf-fe224dbbac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:50.401844 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd6598-1437-4a6c-b7bf-fe224dbbac5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:50.402172 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd6598-1437-4a6c-b7bf-fe224dbbac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:50.402477 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd6598-1437-4a6c-b7bf-fe224dbbac5d admin admin] PATH_INFO: `/v3/projects/6a5d956d79f54aa0b8251255e243773c/users/b14c38eb84ed4c1cbc43b94f18889dad/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:50.406438 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0393a-368d-406a-baf3-f7056b8d6fee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:50.408049 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0393a-368d-406a-baf3-f7056b8d6fee service swift] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:50.416500 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1269/2537] 10.222.0.54 () {60 vars in 1384 bytes} [Tue Nov 23 04:18:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 04:18:50.416843 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd6598-1437-4a6c-b7bf-fe224dbbac5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5d956d79f54aa0b8251255e243773c, user_id=b14c38eb84ed4c1cbc43b94f18889dad, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:50.417267 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0393a-368d-406a-baf3-f7056b8d6fee service swift] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:50.419834 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd6598-1437-4a6c-b7bf-fe224dbbac5d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:50.427682 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0393a-368d-406a-baf3-f7056b8d6fee service swift] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:50.432482 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bc725-2156-45fe-8393-82dd5e08f1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:50.433442 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bc725-2156-45fe-8393-82dd5e08f1aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:50.436265 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bc725-2156-45fe-8393-82dd5e08f1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:50.436265 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bc725-2156-45fe-8393-82dd5e08f1aa admin admin] PATH_INFO: `/v3/projects/cc514336875048e0bc8007c9aa1bcd29/users/fe1bb386793f46a39901f619e1571566/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:50.450643 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bc725-2156-45fe-8393-82dd5e08f1aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc514336875048e0bc8007c9aa1bcd29, user_id=fe1bb386793f46a39901f619e1571566, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:50.453295 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bc725-2156-45fe-8393-82dd5e08f1aa admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:50.509966 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1269/2538] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:50 2021] PUT /identity/v3/projects/6a5d956d79f54aa0b8251255e243773c/users/b14c38eb84ed4c1cbc43b94f18889dad/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:50.513836 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd6598-1437-4a6c-b7bf-fe224dbbac5d admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:50.555348 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1270/2539] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:50 2021] PUT /identity/v3/projects/cc514336875048e0bc8007c9aa1bcd29/users/fe1bb386793f46a39901f619e1571566/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:50.565530 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d22a81-50cb-4f20-bdbe-69563f51c7f6 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:50.565824 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d22a81-50cb-4f20-bdbe-69563f51c7f6 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:50.566105 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d22a81-50cb-4f20-bdbe-69563f51c7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:50.580633 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd6598-1437-4a6c-b7bf-fe224dbbac5d admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:50.604769 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-a9d22a81-50cb-4f20-bdbe-69563f51c7f6 None None] MFA Rules not processed for user `fe1bb386793f46a39901f619e1571566`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:50.606146 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-a9d22a81-50cb-4f20-bdbe-69563f51c7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:50.639373 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e45c1-78c3-445f-b258-06dcbdfee4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:50.640038 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e45c1-78c3-445f-b258-06dcbdfee4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:50.640325 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e45c1-78c3-445f-b258-06dcbdfee4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:50.640601 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e45c1-78c3-445f-b258-06dcbdfee4b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:50.641342 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e45c1-78c3-445f-b258-06dcbdfee4b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:50.642919 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e45c1-78c3-445f-b258-06dcbdfee4b6 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:50.653016 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1270/2540] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:50 2021] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:18:50.657141 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e45c1-78c3-445f-b258-06dcbdfee4b6 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:50.667926 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e45c1-78c3-445f-b258-06dcbdfee4b6 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:50.672820 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aeef71-5a86-4ad5-8e4f-92ad121edb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:50.673835 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aeef71-5a86-4ad5-8e4f-92ad121edb7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:50.674185 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aeef71-5a86-4ad5-8e4f-92ad121edb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:50.674505 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aeef71-5a86-4ad5-8e4f-92ad121edb7f admin admin] PATH_INFO: `/v3/projects/6a5d956d79f54aa0b8251255e243773c/users/b14c38eb84ed4c1cbc43b94f18889dad/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:50.676529 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aeef71-5a86-4ad5-8e4f-92ad121edb7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5d956d79f54aa0b8251255e243773c, user_id=b14c38eb84ed4c1cbc43b94f18889dad, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:50.677399 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1271/2541] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:50 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:18:50.681254 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aeef71-5a86-4ad5-8e4f-92ad121edb7f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:50.689792 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d22a81-50cb-4f20-bdbe-69563f51c7f6 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:50.692088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1271/2542] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:50 2021] PUT /identity/v3/projects/6a5d956d79f54aa0b8251255e243773c/users/b14c38eb84ed4c1cbc43b94f18889dad/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:18:50.700909 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d22a81-50cb-4f20-bdbe-69563f51c7f6 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:50.702369 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd70942-ea00-4e29-92e0-7e27feb4c912 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:50.702717 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd70942-ea00-4e29-92e0-7e27feb4c912 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:50.702926 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd70942-ea00-4e29-92e0-7e27feb4c912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:50.730498 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-5dd70942-ea00-4e29-92e0-7e27feb4c912 None None] MFA Rules not processed for user `b14c38eb84ed4c1cbc43b94f18889dad`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:50.731754 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-5dd70942-ea00-4e29-92e0-7e27feb4c912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:50.761235 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe3091-6508-41d9-a600-2e41ddbc86e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:50.761911 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe3091-6508-41d9-a600-2e41ddbc86e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:50.762202 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe3091-6508-41d9-a600-2e41ddbc86e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:50.762477 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe3091-6508-41d9-a600-2e41ddbc86e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:50.763187 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe3091-6508-41d9-a600-2e41ddbc86e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:50.765176 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe3091-6508-41d9-a600-2e41ddbc86e8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:50.806587 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1272/2543] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:50 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:18:50.816819 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd70942-ea00-4e29-92e0-7e27feb4c912 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:50.818148 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-5dd70942-ea00-4e29-92e0-7e27feb4c912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:50.872942 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1272/2544] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:18:50 2021] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:18:50.873151 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd70942-ea00-4e29-92e0-7e27feb4c912 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:50.874061 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe3091-6508-41d9-a600-2e41ddbc86e8 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:50.923452 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169cbee-7c28-47bc-a2e8-2e01ddd865fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:50.924092 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169cbee-7c28-47bc-a2e8-2e01ddd865fc service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:50.924490 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169cbee-7c28-47bc-a2e8-2e01ddd865fc service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:50.924762 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169cbee-7c28-47bc-a2e8-2e01ddd865fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:50.939420 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe3091-6508-41d9-a600-2e41ddbc86e8 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:50.947535 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ca31b-8a8d-4920-9b6a-e89f3b11fea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:50.947535 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ca31b-8a8d-4920-9b6a-e89f3b11fea7 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:50.947535 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ca31b-8a8d-4920-9b6a-e89f3b11fea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:50.947535 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ca31b-8a8d-4920-9b6a-e89f3b11fea7 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:50.947933 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ca31b-8a8d-4920-9b6a-e89f3b11fea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:50.949062 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ca31b-8a8d-4920-9b6a-e89f3b11fea7 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:50.984559 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169cbee-7c28-47bc-a2e8-2e01ddd865fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:50.985975 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169cbee-7c28-47bc-a2e8-2e01ddd865fc service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:50.996220 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1273/2545] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:18:50 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:18:51.038713 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169cbee-7c28-47bc-a2e8-2e01ddd865fc service cinder] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:51.040141 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-3169cbee-7c28-47bc-a2e8-2e01ddd865fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:51.050952 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169cbee-7c28-47bc-a2e8-2e01ddd865fc service cinder] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:51.056722 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ceb4ed-3feb-4b18-809a-ef3c58512fcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:51.057381 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ceb4ed-3feb-4b18-809a-ef3c58512fcf service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:51.057665 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ceb4ed-3feb-4b18-809a-ef3c58512fcf service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:51.057968 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ceb4ed-3feb-4b18-809a-ef3c58512fcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:51.060965 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1273/2546] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:18:50 2021] POST /identity/v3/users => generated 300 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:18:51.067755 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ca31b-8a8d-4920-9b6a-e89f3b11fea7 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:51.080605 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ca31b-8a8d-4920-9b6a-e89f3b11fea7 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:51.086065 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814cf4f-19dd-4408-b996-c9dd2a8832a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:51.086725 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814cf4f-19dd-4408-b996-c9dd2a8832a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:51.087029 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814cf4f-19dd-4408-b996-c9dd2a8832a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:51.087341 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814cf4f-19dd-4408-b996-c9dd2a8832a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:51.088085 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814cf4f-19dd-4408-b996-c9dd2a8832a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:51.089697 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814cf4f-19dd-4408-b996-c9dd2a8832a6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:51.100631 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1274/2547] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:51 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:18:51.104522 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814cf4f-19dd-4408-b996-c9dd2a8832a6 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:51.114852 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814cf4f-19dd-4408-b996-c9dd2a8832a6 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:51.119161 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ceb4ed-3feb-4b18-809a-ef3c58512fcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:51.119705 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b8601-101e-4029-825d-d2736eabc9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:51.120598 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b8601-101e-4029-825d-d2736eabc9ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:51.120705 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ceb4ed-3feb-4b18-809a-ef3c58512fcf service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:51.120910 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b8601-101e-4029-825d-d2736eabc9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:51.121187 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b8601-101e-4029-825d-d2736eabc9ea admin admin] PATH_INFO: `/v3/projects/51a4bbb39c8448b08be3a445019f7742/users/a32196c7d59e426db8d6a042ce028e70/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:51.129849 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1274/2548] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:18:51 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:18:51.145705 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b8601-101e-4029-825d-d2736eabc9ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a4bbb39c8448b08be3a445019f7742, user_id=a32196c7d59e426db8d6a042ce028e70, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:51.145705 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b8601-101e-4029-825d-d2736eabc9ea admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:51.232801 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1275/2549] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:51 2021] PUT /identity/v3/projects/51a4bbb39c8448b08be3a445019f7742/users/a32196c7d59e426db8d6a042ce028e70/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:18:51.237008 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ceb4ed-3feb-4b18-809a-ef3c58512fcf service cinder] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:51.248328 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ceb4ed-3feb-4b18-809a-ef3c58512fcf service cinder] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:51.306351 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046724c-87aa-4b57-b575-c6ff8a316ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:51.307034 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046724c-87aa-4b57-b575-c6ff8a316ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:51.307362 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046724c-87aa-4b57-b575-c6ff8a316ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:51.307644 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046724c-87aa-4b57-b575-c6ff8a316ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:51.308382 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046724c-87aa-4b57-b575-c6ff8a316ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:51.309965 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046724c-87aa-4b57-b575-c6ff8a316ff5 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:51.320314 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1275/2550] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:51 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:18:51.324580 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b8601-101e-4029-825d-d2736eabc9ea admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:51.335172 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b8601-101e-4029-825d-d2736eabc9ea admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:51.339832 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871fc0d-37ee-4b59-a20e-87be0745a66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:51.340688 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871fc0d-37ee-4b59-a20e-87be0745a66c admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:51.340976 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871fc0d-37ee-4b59-a20e-87be0745a66c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:51.341242 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871fc0d-37ee-4b59-a20e-87be0745a66c admin admin] PATH_INFO: `/v3/projects/51a4bbb39c8448b08be3a445019f7742/users/a32196c7d59e426db8d6a042ce028e70/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:51.343197 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871fc0d-37ee-4b59-a20e-87be0745a66c admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a4bbb39c8448b08be3a445019f7742, user_id=a32196c7d59e426db8d6a042ce028e70, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:51.345901 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871fc0d-37ee-4b59-a20e-87be0745a66c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:51.356511 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1276/2551] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:51 2021] PUT /identity/v3/projects/51a4bbb39c8448b08be3a445019f7742/users/a32196c7d59e426db8d6a042ce028e70/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:51.373633 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa2196-43be-497d-b249-81b35765143f None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:51.373942 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa2196-43be-497d-b249-81b35765143f None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:51.374171 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa2196-43be-497d-b249-81b35765143f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:51.401372 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-f4fa2196-43be-497d-b249-81b35765143f None None] MFA Rules not processed for user `a32196c7d59e426db8d6a042ce028e70`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:51.402505 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-f4fa2196-43be-497d-b249-81b35765143f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:51.474449 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1276/2552] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:51 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:51.484985 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871fc0d-37ee-4b59-a20e-87be0745a66c admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:51.538026 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871fc0d-37ee-4b59-a20e-87be0745a66c admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:51.541668 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f6771-46cc-4e7c-a6f8-ab5f7e92202b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:51.542297 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f6771-46cc-4e7c-a6f8-ab5f7e92202b service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:51.542579 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f6771-46cc-4e7c-a6f8-ab5f7e92202b service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:51.542854 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f6771-46cc-4e7c-a6f8-ab5f7e92202b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:51.551692 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f6771-46cc-4e7c-a6f8-ab5f7e92202b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:51.553767 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f6771-46cc-4e7c-a6f8-ab5f7e92202b service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:51.562179 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1277/2553] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:18:51 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:18:52.792950 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa2196-43be-497d-b249-81b35765143f None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:52.802416 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa2196-43be-497d-b249-81b35765143f None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:52.806614 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60acd0-26d3-4f56-989f-1bd0580afa79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:52.807264 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60acd0-26d3-4f56-989f-1bd0580afa79 service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:52.807551 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60acd0-26d3-4f56-989f-1bd0580afa79 service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:52.807829 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60acd0-26d3-4f56-989f-1bd0580afa79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:52.862980 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60acd0-26d3-4f56-989f-1bd0580afa79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:52.864454 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60acd0-26d3-4f56-989f-1bd0580afa79 service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:52.873928 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1277/2554] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:18:52 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:18:54.012112 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f6771-46cc-4e7c-a6f8-ab5f7e92202b service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:54.023463 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-832f6771-46cc-4e7c-a6f8-ab5f7e92202b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:54.102451 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f6771-46cc-4e7c-a6f8-ab5f7e92202b service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:54.109276 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b857f8-9ede-4276-91b3-e346d49dafdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:54.110318 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b857f8-9ede-4276-91b3-e346d49dafdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:54.114234 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b857f8-9ede-4276-91b3-e346d49dafdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:54.114234 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b857f8-9ede-4276-91b3-e346d49dafdd admin admin] PATH_INFO: `/v3/users/b20ce08f5765442dbdf399983b8df856` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:54.114234 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b857f8-9ede-4276-91b3-e346d49dafdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b20ce08f5765442dbdf399983b8df856)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:54.114234 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b857f8-9ede-4276-91b3-e346d49dafdd admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:54.379144 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-82b857f8-9ede-4276-91b3-e346d49dafdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b20ce08f5765442dbdf399983b8df856'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:54.468910 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-82b857f8-9ede-4276-91b3-e346d49dafdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b20ce08f5765442dbdf399983b8df856'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:54.476547 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-82b857f8-9ede-4276-91b3-e346d49dafdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b20ce08f5765442dbdf399983b8df856'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:54.477314 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-82b857f8-9ede-4276-91b3-e346d49dafdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b20ce08f5765442dbdf399983b8df856'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:54.488838 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-82b857f8-9ede-4276-91b3-e346d49dafdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b20ce08f5765442dbdf399983b8df856'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:54.494846 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1278/2555] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:18:54 2021] DELETE /identity/v3/users/b20ce08f5765442dbdf399983b8df856 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:54.758132 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60acd0-26d3-4f56-989f-1bd0580afa79 service cinder] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:54.770382 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60acd0-26d3-4f56-989f-1bd0580afa79 service cinder] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:54.831690 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f004a-8fe6-4d0c-a079-75f6f7d36c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:54.832490 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f004a-8fe6-4d0c-a079-75f6f7d36c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:54.832789 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f004a-8fe6-4d0c-a079-75f6f7d36c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:54.833120 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f004a-8fe6-4d0c-a079-75f6f7d36c1b admin admin] PATH_INFO: `/v3/projects/78807cb7ca9445b38b7e896adc10ec2b` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:54.834888 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f004a-8fe6-4d0c-a079-75f6f7d36c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=78807cb7ca9445b38b7e896adc10ec2b)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:54.836799 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f004a-8fe6-4d0c-a079-75f6f7d36c1b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:54.980962 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-da8f004a-8fe6-4d0c-a079-75f6f7d36c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78807cb7ca9445b38b7e896adc10ec2b', 'request_id': 'req-da8f004a-8fe6-4d0c-a079-75f6f7d36c1b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:54.987364 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-da8f004a-8fe6-4d0c-a079-75f6f7d36c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78807cb7ca9445b38b7e896adc10ec2b', 'request_id': 'req-da8f004a-8fe6-4d0c-a079-75f6f7d36c1b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:54.993026 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-da8f004a-8fe6-4d0c-a079-75f6f7d36c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78807cb7ca9445b38b7e896adc10ec2b', 'request_id': 'req-da8f004a-8fe6-4d0c-a079-75f6f7d36c1b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:55.103388 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-da8f004a-8fe6-4d0c-a079-75f6f7d36c1b admin admin] The token cache is being invalidate because project 78807cb7ca9445b38b7e896adc10ec2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:18:55.103749 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-da8f004a-8fe6-4d0c-a079-75f6f7d36c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:55.104398 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-da8f004a-8fe6-4d0c-a079-75f6f7d36c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:55.106177 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1278/2556] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:18:54 2021] DELETE /identity/v3/projects/78807cb7ca9445b38b7e896adc10ec2b => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:55.113684 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d16e45-ccfa-46ae-ae7f-7f0330ccf4a2 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:55.114147 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d16e45-ccfa-46ae-ae7f-7f0330ccf4a2 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:55.114261 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d16e45-ccfa-46ae-ae7f-7f0330ccf4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:55.131957 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-09d16e45-ccfa-46ae-ae7f-7f0330ccf4a2 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:55.133168 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-09d16e45-ccfa-46ae-ae7f-7f0330ccf4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:55.202554 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1279/2557] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:55.211176 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c686274-4e29-48f9-a8ac-893bedec92a7 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:55.211663 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c686274-4e29-48f9-a8ac-893bedec92a7 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:55.211797 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c686274-4e29-48f9-a8ac-893bedec92a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:55.230482 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-7c686274-4e29-48f9-a8ac-893bedec92a7 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:55.231885 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-7c686274-4e29-48f9-a8ac-893bedec92a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:55.240138 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1279/2558] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:55.244406 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d16e45-ccfa-46ae-ae7f-7f0330ccf4a2 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:55.253902 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d16e45-ccfa-46ae-ae7f-7f0330ccf4a2 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:55.259753 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0757f-2e1f-4a4f-a7d8-16201e828615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:55.260557 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0757f-2e1f-4a4f-a7d8-16201e828615 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:55.260934 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0757f-2e1f-4a4f-a7d8-16201e828615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:55.261355 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0757f-2e1f-4a4f-a7d8-16201e828615 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:55.262169 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0757f-2e1f-4a4f-a7d8-16201e828615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:18:55.262577 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0757f-2e1f-4a4f-a7d8-16201e828615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:55.264268 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0757f-2e1f-4a4f-a7d8-16201e828615 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:55.279766 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1280/2559] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:18:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:18:55.280861 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c686274-4e29-48f9-a8ac-893bedec92a7 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:55.291002 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c686274-4e29-48f9-a8ac-893bedec92a7 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:55.296006 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46860e85-7348-4d96-8733-d7889f4aedf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:55.296670 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46860e85-7348-4d96-8733-d7889f4aedf7 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:55.296978 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46860e85-7348-4d96-8733-d7889f4aedf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:55.297257 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46860e85-7348-4d96-8733-d7889f4aedf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:55.297973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46860e85-7348-4d96-8733-d7889f4aedf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:55.299898 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46860e85-7348-4d96-8733-d7889f4aedf7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:55.437235 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1280/2560] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:18:55 2021] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:55.441168 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0757f-2e1f-4a4f-a7d8-16201e828615 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:55.451139 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0757f-2e1f-4a4f-a7d8-16201e828615 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:55.506567 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d6345-3ba5-48e3-99a6-884352143dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:55.507240 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d6345-3ba5-48e3-99a6-884352143dff admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:55.507553 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d6345-3ba5-48e3-99a6-884352143dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:55.507829 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d6345-3ba5-48e3-99a6-884352143dff admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:55.508533 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d6345-3ba5-48e3-99a6-884352143dff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:55.510427 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d6345-3ba5-48e3-99a6-884352143dff admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:55.618786 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1281/2561] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:18:55 2021] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:18:55.623055 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46860e85-7348-4d96-8733-d7889f4aedf7 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:55.633893 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46860e85-7348-4d96-8733-d7889f4aedf7 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:55.638792 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c51a8-d82b-4b60-835a-32dcd022bb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:55.639589 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c51a8-d82b-4b60-835a-32dcd022bb57 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:55.639924 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c51a8-d82b-4b60-835a-32dcd022bb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:55.640211 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c51a8-d82b-4b60-835a-32dcd022bb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:55.641002 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c51a8-d82b-4b60-835a-32dcd022bb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:55.642588 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c51a8-d82b-4b60-835a-32dcd022bb57 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:55.654236 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1281/2562] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:55 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:18:55.658285 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d6345-3ba5-48e3-99a6-884352143dff admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:55.669503 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d6345-3ba5-48e3-99a6-884352143dff admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:55.674286 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f3131-7fb7-4e15-abfb-00b5bc9d9ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:55.674949 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f3131-7fb7-4e15-abfb-00b5bc9d9ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:55.675262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f3131-7fb7-4e15-abfb-00b5bc9d9ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:55.675574 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f3131-7fb7-4e15-abfb-00b5bc9d9ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:55.676318 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f3131-7fb7-4e15-abfb-00b5bc9d9ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:55.678520 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f3131-7fb7-4e15-abfb-00b5bc9d9ea4 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:55.691260 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1282/2563] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:55 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:18:55.693551 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c51a8-d82b-4b60-835a-32dcd022bb57 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:55.704016 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c51a8-d82b-4b60-835a-32dcd022bb57 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:55.709340 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7184c-d536-4d09-bd4b-b3eed59feac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:55.710608 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7184c-d536-4d09-bd4b-b3eed59feac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:55.710893 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7184c-d536-4d09-bd4b-b3eed59feac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:55.711170 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7184c-d536-4d09-bd4b-b3eed59feac3 admin admin] PATH_INFO: `/v3/projects/efbadc9309ca492dbe3a0185cf774115/users/8e149c6a86f4491f91eca3bad26336e9/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:55.726297 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7184c-d536-4d09-bd4b-b3eed59feac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efbadc9309ca492dbe3a0185cf774115, user_id=8e149c6a86f4491f91eca3bad26336e9, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:55.729114 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7184c-d536-4d09-bd4b-b3eed59feac3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:55.811533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1282/2564] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:55 2021] PUT /identity/v3/projects/efbadc9309ca492dbe3a0185cf774115/users/8e149c6a86f4491f91eca3bad26336e9/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:55.822458 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aeca82-fe99-48a7-84c1-e278f49b8b80 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:55.822744 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aeca82-fe99-48a7-84c1-e278f49b8b80 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:55.823018 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aeca82-fe99-48a7-84c1-e278f49b8b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:55.849012 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-23aeca82-fe99-48a7-84c1-e278f49b8b80 None None] MFA Rules not processed for user `8e149c6a86f4491f91eca3bad26336e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:55.850870 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-23aeca82-fe99-48a7-84c1-e278f49b8b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:55.911869 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1283/2565] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:55 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:55.922891 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7184c-d536-4d09-bd4b-b3eed59feac3 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:55.924547 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-0dd7184c-d536-4d09-bd4b-b3eed59feac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:55.980121 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7184c-d536-4d09-bd4b-b3eed59feac3 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:55.983740 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6f4fa-d8ce-44f2-849e-55aea3f2fedc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:55.984386 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6f4fa-d8ce-44f2-849e-55aea3f2fedc service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:55.984670 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6f4fa-d8ce-44f2-849e-55aea3f2fedc service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:55.984945 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6f4fa-d8ce-44f2-849e-55aea3f2fedc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:55.993461 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6f4fa-d8ce-44f2-849e-55aea3f2fedc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:55.994885 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6f4fa-d8ce-44f2-849e-55aea3f2fedc service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:56.003581 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1283/2566] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:18:55 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:18:56.029770 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aeca82-fe99-48a7-84c1-e278f49b8b80 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:56.094281 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aeca82-fe99-48a7-84c1-e278f49b8b80 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:56.099036 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d5933-aeab-4475-a4f4-5e2e3843cbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:56.100188 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d5933-aeab-4475-a4f4-5e2e3843cbb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:56.100597 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d5933-aeab-4475-a4f4-5e2e3843cbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:56.100880 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d5933-aeab-4475-a4f4-5e2e3843cbb2 admin admin] PATH_INFO: `/v3/users/8e149c6a86f4491f91eca3bad26336e9` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:56.102171 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d5933-aeab-4475-a4f4-5e2e3843cbb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e149c6a86f4491f91eca3bad26336e9)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:56.104107 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d5933-aeab-4475-a4f4-5e2e3843cbb2 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:56.137691 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6f4fa-d8ce-44f2-849e-55aea3f2fedc service cinder] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:56.139184 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-e0a6f4fa-d8ce-44f2-849e-55aea3f2fedc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:56.153819 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6f4fa-d8ce-44f2-849e-55aea3f2fedc service cinder] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:56.159102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0c46e-81a0-4b01-83ee-42ffd412b372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:56.160227 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0c46e-81a0-4b01-83ee-42ffd412b372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:56.160707 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0c46e-81a0-4b01-83ee-42ffd412b372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:56.161056 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0c46e-81a0-4b01-83ee-42ffd412b372 admin admin] PATH_INFO: `/v3/users/3d81d2308c034f28a5f20d41bda8b201` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:56.162402 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0c46e-81a0-4b01-83ee-42ffd412b372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d81d2308c034f28a5f20d41bda8b201)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:56.169182 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0c46e-81a0-4b01-83ee-42ffd412b372 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:56.344439 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c42d5933-aeab-4475-a4f4-5e2e3843cbb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e149c6a86f4491f91eca3bad26336e9'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:56.375713 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-b4b0c46e-81a0-4b01-83ee-42ffd412b372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d81d2308c034f28a5f20d41bda8b201'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:56.417316 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c42d5933-aeab-4475-a4f4-5e2e3843cbb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e149c6a86f4491f91eca3bad26336e9'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:56.424518 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c42d5933-aeab-4475-a4f4-5e2e3843cbb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e149c6a86f4491f91eca3bad26336e9'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:56.425244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c42d5933-aeab-4475-a4f4-5e2e3843cbb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e149c6a86f4491f91eca3bad26336e9'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:56.437894 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-c42d5933-aeab-4475-a4f4-5e2e3843cbb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e149c6a86f4491f91eca3bad26336e9'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:56.444852 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1284/2567] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:18:56 2021] DELETE /identity/v3/users/8e149c6a86f4491f91eca3bad26336e9 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:56.449425 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf434f4-dd4a-491e-bdc0-a66d980eae1b None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:56.450891 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf434f4-dd4a-491e-bdc0-a66d980eae1b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:56.450891 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf434f4-dd4a-491e-bdc0-a66d980eae1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:56.470149 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-ecf434f4-dd4a-491e-bdc0-a66d980eae1b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:56.479822 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-ecf434f4-dd4a-491e-bdc0-a66d980eae1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:56.529886 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-b4b0c46e-81a0-4b01-83ee-42ffd412b372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d81d2308c034f28a5f20d41bda8b201'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:56.536445 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1285/2568] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:18:56.544398 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-b4b0c46e-81a0-4b01-83ee-42ffd412b372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d81d2308c034f28a5f20d41bda8b201'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:56.544398 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-b4b0c46e-81a0-4b01-83ee-42ffd412b372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d81d2308c034f28a5f20d41bda8b201'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:56.551451 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf434f4-dd4a-491e-bdc0-a66d980eae1b None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:56.553700 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-ecf434f4-dd4a-491e-bdc0-a66d980eae1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:56.553829 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-b4b0c46e-81a0-4b01-83ee-42ffd412b372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d81d2308c034f28a5f20d41bda8b201'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:56.561292 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1284/2569] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:18:56 2021] DELETE /identity/v3/users/3d81d2308c034f28a5f20d41bda8b201 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:56.577059 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f0c0b-6d60-47d2-8e3d-072264cfa091 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:56.577572 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f0c0b-6d60-47d2-8e3d-072264cfa091 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:56.577963 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f0c0b-6d60-47d2-8e3d-072264cfa091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:56.595444 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-c58f0c0b-6d60-47d2-8e3d-072264cfa091 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:56.596800 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c58f0c0b-6d60-47d2-8e3d-072264cfa091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:56.611279 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf434f4-dd4a-491e-bdc0-a66d980eae1b None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:56.671375 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1285/2570] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:18:56.675843 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b92f4-49bb-4243-9aec-86f1c92bade4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:56.676600 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b92f4-49bb-4243-9aec-86f1c92bade4 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:56.676909 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b92f4-49bb-4243-9aec-86f1c92bade4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:56.677184 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b92f4-49bb-4243-9aec-86f1c92bade4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:56.684622 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-109b92f4-49bb-4243-9aec-86f1c92bade4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:56.691494 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f0c0b-6d60-47d2-8e3d-072264cfa091 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:56.692941 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c58f0c0b-6d60-47d2-8e3d-072264cfa091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:56.699032 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b92f4-49bb-4243-9aec-86f1c92bade4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:56.701241 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b92f4-49bb-4243-9aec-86f1c92bade4 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:56.705064 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f0c0b-6d60-47d2-8e3d-072264cfa091 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:56.710341 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae73c6-0d03-40fd-89d9-6c13b7b5c246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:56.711009 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae73c6-0d03-40fd-89d9-6c13b7b5c246 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:56.711717 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae73c6-0d03-40fd-89d9-6c13b7b5c246 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:56.712575 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae73c6-0d03-40fd-89d9-6c13b7b5c246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:56.713271 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1286/2571] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:18:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:18:56.727972 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae73c6-0d03-40fd-89d9-6c13b7b5c246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:56.730182 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae73c6-0d03-40fd-89d9-6c13b7b5c246 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:56.747755 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1286/2572] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:18:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:18:57.276811 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b92f4-49bb-4243-9aec-86f1c92bade4 service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:57.277081 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae73c6-0d03-40fd-89d9-6c13b7b5c246 service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:57.278807 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-109b92f4-49bb-4243-9aec-86f1c92bade4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:57.279403 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-98ae73c6-0d03-40fd-89d9-6c13b7b5c246 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:57.294371 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b92f4-49bb-4243-9aec-86f1c92bade4 service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:57.295806 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae73c6-0d03-40fd-89d9-6c13b7b5c246 service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:57.299390 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26117156-540c-4081-bdc4-8a562228ddd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:57.300349 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26117156-540c-4081-bdc4-8a562228ddd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:57.300733 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26117156-540c-4081-bdc4-8a562228ddd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:57.301099 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312503fc-d459-44cc-ada7-dac781da7fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:57.301240 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26117156-540c-4081-bdc4-8a562228ddd8 admin admin] PATH_INFO: `/v3/projects/efbadc9309ca492dbe3a0185cf774115` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:57.301945 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312503fc-d459-44cc-ada7-dac781da7fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:57.302299 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312503fc-d459-44cc-ada7-dac781da7fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:57.302608 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312503fc-d459-44cc-ada7-dac781da7fbc admin admin] PATH_INFO: `/v3/projects/05e1de207c9c458591fb3d9717e5baf9` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:57.302981 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26117156-540c-4081-bdc4-8a562228ddd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efbadc9309ca492dbe3a0185cf774115)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:57.304578 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312503fc-d459-44cc-ada7-dac781da7fbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=05e1de207c9c458591fb3d9717e5baf9)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:57.305322 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26117156-540c-4081-bdc4-8a562228ddd8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:57.306484 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312503fc-d459-44cc-ada7-dac781da7fbc admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:57.445922 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-26117156-540c-4081-bdc4-8a562228ddd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efbadc9309ca492dbe3a0185cf774115', 'request_id': 'req-26117156-540c-4081-bdc4-8a562228ddd8'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:57.452062 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-26117156-540c-4081-bdc4-8a562228ddd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efbadc9309ca492dbe3a0185cf774115', 'request_id': 'req-26117156-540c-4081-bdc4-8a562228ddd8'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:57.457496 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-26117156-540c-4081-bdc4-8a562228ddd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efbadc9309ca492dbe3a0185cf774115', 'request_id': 'req-26117156-540c-4081-bdc4-8a562228ddd8'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:57.475564 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-312503fc-d459-44cc-ada7-dac781da7fbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05e1de207c9c458591fb3d9717e5baf9', 'request_id': 'req-312503fc-d459-44cc-ada7-dac781da7fbc'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:57.481649 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-312503fc-d459-44cc-ada7-dac781da7fbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05e1de207c9c458591fb3d9717e5baf9', 'request_id': 'req-312503fc-d459-44cc-ada7-dac781da7fbc'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:57.486955 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-312503fc-d459-44cc-ada7-dac781da7fbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05e1de207c9c458591fb3d9717e5baf9', 'request_id': 'req-312503fc-d459-44cc-ada7-dac781da7fbc'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:57.538397 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-26117156-540c-4081-bdc4-8a562228ddd8 admin admin] The token cache is being invalidate because project efbadc9309ca492dbe3a0185cf774115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:18:57.549422 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-26117156-540c-4081-bdc4-8a562228ddd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:57.549422 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-26117156-540c-4081-bdc4-8a562228ddd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:57.549422 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1287/2573] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:18:57 2021] DELETE /identity/v3/projects/efbadc9309ca492dbe3a0185cf774115 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:57.600708 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-312503fc-d459-44cc-ada7-dac781da7fbc admin admin] The token cache is being invalidate because project 05e1de207c9c458591fb3d9717e5baf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:18:57.600993 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-312503fc-d459-44cc-ada7-dac781da7fbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:57.601978 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-312503fc-d459-44cc-ada7-dac781da7fbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:57.603679 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1287/2574] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:18:57 2021] DELETE /identity/v3/projects/05e1de207c9c458591fb3d9717e5baf9 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:57.607927 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26117156-540c-4081-bdc4-8a562228ddd8 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:57.610291 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-26117156-540c-4081-bdc4-8a562228ddd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:57.689459 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26117156-540c-4081-bdc4-8a562228ddd8 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:57.748741 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce094575-9320-478a-b499-d5ab12978197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:57.749631 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce094575-9320-478a-b499-d5ab12978197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:57.749899 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce094575-9320-478a-b499-d5ab12978197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:57.750131 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce094575-9320-478a-b499-d5ab12978197 admin admin] PATH_INFO: `/v3/users/b14c38eb84ed4c1cbc43b94f18889dad` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:57.751364 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce094575-9320-478a-b499-d5ab12978197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b14c38eb84ed4c1cbc43b94f18889dad)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:57.753473 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce094575-9320-478a-b499-d5ab12978197 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:57.966982 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ce094575-9320-478a-b499-d5ab12978197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b14c38eb84ed4c1cbc43b94f18889dad'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:58.032310 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ce094575-9320-478a-b499-d5ab12978197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b14c38eb84ed4c1cbc43b94f18889dad'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:58.040087 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ce094575-9320-478a-b499-d5ab12978197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b14c38eb84ed4c1cbc43b94f18889dad'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:58.040746 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ce094575-9320-478a-b499-d5ab12978197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b14c38eb84ed4c1cbc43b94f18889dad'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:58.052110 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-ce094575-9320-478a-b499-d5ab12978197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b14c38eb84ed4c1cbc43b94f18889dad'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:58.058653 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1288/2575] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:18:57 2021] DELETE /identity/v3/users/b14c38eb84ed4c1cbc43b94f18889dad => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:18:58.102641 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312503fc-d459-44cc-ada7-dac781da7fbc admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:58.104216 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-312503fc-d459-44cc-ada7-dac781da7fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:58.160930 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312503fc-d459-44cc-ada7-dac781da7fbc admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:58.208186 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1d542-1419-43c9-971b-d076335d4443 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:58.209290 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1d542-1419-43c9-971b-d076335d4443 service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:58.209587 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1d542-1419-43c9-971b-d076335d4443 service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:58.209871 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1d542-1419-43c9-971b-d076335d4443 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:58.211687 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-2dc1d542-1419-43c9-971b-d076335d4443 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:58.269548 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1d542-1419-43c9-971b-d076335d4443 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:58.271057 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1d542-1419-43c9-971b-d076335d4443 service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:58.280707 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1288/2576] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:18:58 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:18:58.601660 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce094575-9320-478a-b499-d5ab12978197 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:58.603173 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-ce094575-9320-478a-b499-d5ab12978197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:58.676854 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce094575-9320-478a-b499-d5ab12978197 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:58.682712 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b2fe1-5990-44c3-8967-e3de8f2ffb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:58.683927 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b2fe1-5990-44c3-8967-e3de8f2ffb42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:58.684272 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b2fe1-5990-44c3-8967-e3de8f2ffb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:58.684508 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b2fe1-5990-44c3-8967-e3de8f2ffb42 admin admin] PATH_INFO: `/v3/projects/6a5d956d79f54aa0b8251255e243773c` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:58.685723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b2fe1-5990-44c3-8967-e3de8f2ffb42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a5d956d79f54aa0b8251255e243773c)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:58.687650 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b2fe1-5990-44c3-8967-e3de8f2ffb42 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:58.795728 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-440b2fe1-5990-44c3-8967-e3de8f2ffb42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a5d956d79f54aa0b8251255e243773c', 'request_id': 'req-440b2fe1-5990-44c3-8967-e3de8f2ffb42'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:58.801828 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-440b2fe1-5990-44c3-8967-e3de8f2ffb42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a5d956d79f54aa0b8251255e243773c', 'request_id': 'req-440b2fe1-5990-44c3-8967-e3de8f2ffb42'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:58.807286 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-440b2fe1-5990-44c3-8967-e3de8f2ffb42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a5d956d79f54aa0b8251255e243773c', 'request_id': 'req-440b2fe1-5990-44c3-8967-e3de8f2ffb42'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:58.897784 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-440b2fe1-5990-44c3-8967-e3de8f2ffb42 admin admin] The token cache is being invalidate because project 6a5d956d79f54aa0b8251255e243773c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:18:58.897990 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-440b2fe1-5990-44c3-8967-e3de8f2ffb42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:58.898659 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-440b2fe1-5990-44c3-8967-e3de8f2ffb42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:18:58.900259 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1289/2577] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:18:58 2021] DELETE /identity/v3/projects/6a5d956d79f54aa0b8251255e243773c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:18:58.906056 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4192b9-ef6f-40d3-81e3-2005033fb27f None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:58.906342 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4192b9-ef6f-40d3-81e3-2005033fb27f None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:58.906617 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4192b9-ef6f-40d3-81e3-2005033fb27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:58.926838 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-ca4192b9-ef6f-40d3-81e3-2005033fb27f None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:58.930233 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-ca4192b9-ef6f-40d3-81e3-2005033fb27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:59.012079 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1289/2578] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:18:59.021942 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ead6d-ca63-447d-8eca-fd08ad343fce None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:59.022856 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ead6d-ca63-447d-8eca-fd08ad343fce None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:59.023149 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ead6d-ca63-447d-8eca-fd08ad343fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:59.043006 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-3c6ead6d-ca63-447d-8eca-fd08ad343fce None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:59.044538 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-3c6ead6d-ca63-447d-8eca-fd08ad343fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:59.053549 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1290/2579] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:59.058173 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4192b9-ef6f-40d3-81e3-2005033fb27f None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:59.069146 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4192b9-ef6f-40d3-81e3-2005033fb27f None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:59.074235 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800b065-643b-47fe-9c26-b51fd0c9aeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:59.074932 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800b065-643b-47fe-9c26-b51fd0c9aeca admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:59.075240 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800b065-643b-47fe-9c26-b51fd0c9aeca admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:59.075564 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800b065-643b-47fe-9c26-b51fd0c9aeca admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:59.076320 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800b065-643b-47fe-9c26-b51fd0c9aeca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:18:59.076633 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800b065-643b-47fe-9c26-b51fd0c9aeca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:59.078427 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800b065-643b-47fe-9c26-b51fd0c9aeca admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:59.091614 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1290/2580] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:18:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 04:18:59.097282 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ead6d-ca63-447d-8eca-fd08ad343fce None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:59.107786 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ead6d-ca63-447d-8eca-fd08ad343fce None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:59.118244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4efca1-5583-4ade-b85a-ec7952e23995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:59.118924 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4efca1-5583-4ade-b85a-ec7952e23995 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:59.120011 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4efca1-5583-4ade-b85a-ec7952e23995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:59.120011 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4efca1-5583-4ade-b85a-ec7952e23995 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:59.120337 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4efca1-5583-4ade-b85a-ec7952e23995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:59.123272 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4efca1-5583-4ade-b85a-ec7952e23995 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:59.253757 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1291/2581] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:18:59 2021] POST /identity/v3/projects => generated 387 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:59.254982 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800b065-643b-47fe-9c26-b51fd0c9aeca admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:59.266627 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800b065-643b-47fe-9c26-b51fd0c9aeca admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:59.324990 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b513e9-cf31-4606-b1cf-87bf923fd45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:59.325649 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b513e9-cf31-4606-b1cf-87bf923fd45b admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:59.325925 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b513e9-cf31-4606-b1cf-87bf923fd45b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:59.326199 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b513e9-cf31-4606-b1cf-87bf923fd45b admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:59.326896 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b513e9-cf31-4606-b1cf-87bf923fd45b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:59.328818 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b513e9-cf31-4606-b1cf-87bf923fd45b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:59.416016 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1291/2582] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:18:59 2021] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:59.417364 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4efca1-5583-4ade-b85a-ec7952e23995 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:59.427766 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4efca1-5583-4ade-b85a-ec7952e23995 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:59.432759 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672899c-f86b-4e16-bdba-d93a911e839e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:59.434063 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672899c-f86b-4e16-bdba-d93a911e839e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:59.434357 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672899c-f86b-4e16-bdba-d93a911e839e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:59.434827 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672899c-f86b-4e16-bdba-d93a911e839e admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:59.435645 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672899c-f86b-4e16-bdba-d93a911e839e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:59.437633 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672899c-f86b-4e16-bdba-d93a911e839e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:59.450405 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1292/2583] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:59 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:18:59.455544 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b513e9-cf31-4606-b1cf-87bf923fd45b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:59.466304 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b513e9-cf31-4606-b1cf-87bf923fd45b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:59.470946 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413a8e7-f6fc-46d3-90d9-a56508a07064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:59.471639 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413a8e7-f6fc-46d3-90d9-a56508a07064 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:59.481484 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413a8e7-f6fc-46d3-90d9-a56508a07064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:59.481484 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413a8e7-f6fc-46d3-90d9-a56508a07064 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:59.481484 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413a8e7-f6fc-46d3-90d9-a56508a07064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:59.481484 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413a8e7-f6fc-46d3-90d9-a56508a07064 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:59.485120 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1292/2584] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:18:59 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:18:59.489287 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672899c-f86b-4e16-bdba-d93a911e839e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:59.499092 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672899c-f86b-4e16-bdba-d93a911e839e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:59.503996 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d27c4-9e51-4db4-804c-caee66c8eb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:59.505895 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d27c4-9e51-4db4-804c-caee66c8eb93 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:59.506593 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d27c4-9e51-4db4-804c-caee66c8eb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:59.506593 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d27c4-9e51-4db4-804c-caee66c8eb93 admin admin] PATH_INFO: `/v3/projects/ef67d30d1c624f34b9d0f353f561e6d3/users/ce55650df5e84cea8f70638a278fefa2/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:59.522321 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d27c4-9e51-4db4-804c-caee66c8eb93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef67d30d1c624f34b9d0f353f561e6d3, user_id=ce55650df5e84cea8f70638a278fefa2, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:59.525018 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d27c4-9e51-4db4-804c-caee66c8eb93 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:59.615839 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1293/2585] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:18:59 2021] PUT /identity/v3/projects/ef67d30d1c624f34b9d0f353f561e6d3/users/ce55650df5e84cea8f70638a278fefa2/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:18:59.626114 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaeceaa-9e89-4110-9a2b-7fce280e9db2 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:59.626404 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaeceaa-9e89-4110-9a2b-7fce280e9db2 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:59.626709 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaeceaa-9e89-4110-9a2b-7fce280e9db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:59.658996 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-9eaeceaa-9e89-4110-9a2b-7fce280e9db2 None None] MFA Rules not processed for user `ce55650df5e84cea8f70638a278fefa2`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:18:59.661021 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-9eaeceaa-9e89-4110-9a2b-7fce280e9db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:18:59.734994 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1293/2586] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:18:59 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:18:59.739595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d27c4-9e51-4db4-804c-caee66c8eb93 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:59.804567 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d27c4-9e51-4db4-804c-caee66c8eb93 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:18:59.809549 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438d229-711e-462f-8f4a-805c28ba77ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:18:59.810070 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438d229-711e-462f-8f4a-805c28ba77ab admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:18:59.812166 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438d229-711e-462f-8f4a-805c28ba77ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:18:59.812166 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438d229-711e-462f-8f4a-805c28ba77ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:18:59.812166 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438d229-711e-462f-8f4a-805c28ba77ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:18:59.813266 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438d229-711e-462f-8f4a-805c28ba77ab admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:18:59.909265 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1294/2587] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:18:59 2021] POST /identity/v3/projects => generated 389 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:18:59.914267 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaeceaa-9e89-4110-9a2b-7fce280e9db2 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:18:59.924940 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaeceaa-9e89-4110-9a2b-7fce280e9db2 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:00.000852 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fab21-5bf3-42cb-8455-7cb4acdc1a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:00.001610 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fab21-5bf3-42cb-8455-7cb4acdc1a84 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:00.001963 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fab21-5bf3-42cb-8455-7cb4acdc1a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:00.002300 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fab21-5bf3-42cb-8455-7cb4acdc1a84 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:00.003073 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fab21-5bf3-42cb-8455-7cb4acdc1a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:00.006378 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fab21-5bf3-42cb-8455-7cb4acdc1a84 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:00.117328 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1294/2588] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:18:59 2021] POST /identity/v3/users => generated 301 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:19:00.118906 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438d229-711e-462f-8f4a-805c28ba77ab admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:00.131183 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438d229-711e-462f-8f4a-805c28ba77ab admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:00.137392 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e35915-5f73-49f2-80f0-9ff5d55d520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:00.137942 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e35915-5f73-49f2-80f0-9ff5d55d520a admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:00.138224 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e35915-5f73-49f2-80f0-9ff5d55d520a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:00.141276 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e35915-5f73-49f2-80f0-9ff5d55d520a admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:00.141276 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e35915-5f73-49f2-80f0-9ff5d55d520a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:00.143244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e35915-5f73-49f2-80f0-9ff5d55d520a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:00.154368 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1295/2589] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:19:00 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:19:00.158708 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fab21-5bf3-42cb-8455-7cb4acdc1a84 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:00.171985 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fab21-5bf3-42cb-8455-7cb4acdc1a84 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:00.178430 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0d89b-714b-46f4-b7ed-901464e3f1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:00.179539 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0d89b-714b-46f4-b7ed-901464e3f1e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:00.179885 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0d89b-714b-46f4-b7ed-901464e3f1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:00.180363 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0d89b-714b-46f4-b7ed-901464e3f1e9 admin admin] PATH_INFO: `/v3/projects/4c7261a64fc042dd940b35859cb7068a/users/732c1a317837476d8ffcb9d15524e587/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:00.197645 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0d89b-714b-46f4-b7ed-901464e3f1e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c7261a64fc042dd940b35859cb7068a, user_id=732c1a317837476d8ffcb9d15524e587, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:00.200595 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0d89b-714b-46f4-b7ed-901464e3f1e9 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:00.355034 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1295/2590] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:19:00 2021] PUT /identity/v3/projects/4c7261a64fc042dd940b35859cb7068a/users/732c1a317837476d8ffcb9d15524e587/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:00.359013 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e35915-5f73-49f2-80f0-9ff5d55d520a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:00.370418 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e35915-5f73-49f2-80f0-9ff5d55d520a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:00.452368 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a4438-e68a-4f5c-8a0a-c65160ef580c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:00.456220 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a4438-e68a-4f5c-8a0a-c65160ef580c admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:00.457096 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a4438-e68a-4f5c-8a0a-c65160ef580c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:00.457754 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a4438-e68a-4f5c-8a0a-c65160ef580c admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:00.458670 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a4438-e68a-4f5c-8a0a-c65160ef580c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:00.463236 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a4438-e68a-4f5c-8a0a-c65160ef580c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:00.479548 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1296/2591] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:19:00 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:19:00.483437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0d89b-714b-46f4-b7ed-901464e3f1e9 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:00.495099 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0d89b-714b-46f4-b7ed-901464e3f1e9 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:00.504014 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae2862-f024-4de3-aeb5-064d8e24e3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:00.506414 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae2862-f024-4de3-aeb5-064d8e24e3fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:00.506982 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae2862-f024-4de3-aeb5-064d8e24e3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:00.507561 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae2862-f024-4de3-aeb5-064d8e24e3fb admin admin] PATH_INFO: `/v3/projects/4c7261a64fc042dd940b35859cb7068a/users/732c1a317837476d8ffcb9d15524e587/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:00.511973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae2862-f024-4de3-aeb5-064d8e24e3fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c7261a64fc042dd940b35859cb7068a, user_id=732c1a317837476d8ffcb9d15524e587, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:00.515700 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae2862-f024-4de3-aeb5-064d8e24e3fb admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:00.546246 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1296/2592] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:19:00 2021] PUT /identity/v3/projects/4c7261a64fc042dd940b35859cb7068a/users/732c1a317837476d8ffcb9d15524e587/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:19:00.557089 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf60aa4-e768-4883-90c3-d4a2dcba5e4a None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:00.557466 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf60aa4-e768-4883-90c3-d4a2dcba5e4a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:00.557822 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf60aa4-e768-4883-90c3-d4a2dcba5e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:00.594462 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-6cf60aa4-e768-4883-90c3-d4a2dcba5e4a None None] MFA Rules not processed for user `732c1a317837476d8ffcb9d15524e587`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:00.595888 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-6cf60aa4-e768-4883-90c3-d4a2dcba5e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:00.681917 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1297/2593] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:00 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:00.688548 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae2862-f024-4de3-aeb5-064d8e24e3fb admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:00.693108 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-39ae2862-f024-4de3-aeb5-064d8e24e3fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:00.760733 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae2862-f024-4de3-aeb5-064d8e24e3fb admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:00.764632 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3502f8-21a2-455c-8382-0706f15f62c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:00.765206 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3502f8-21a2-455c-8382-0706f15f62c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:00.765493 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3502f8-21a2-455c-8382-0706f15f62c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:00.765840 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3502f8-21a2-455c-8382-0706f15f62c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:00.776232 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3502f8-21a2-455c-8382-0706f15f62c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:00.777733 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3502f8-21a2-455c-8382-0706f15f62c7 service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:00.789192 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1297/2594] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:00 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:19:00.944657 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf60aa4-e768-4883-90c3-d4a2dcba5e4a None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:01.016817 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf60aa4-e768-4883-90c3-d4a2dcba5e4a None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:01.022626 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330479a-9871-4905-8af4-a8a95d369a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:01.023655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330479a-9871-4905-8af4-a8a95d369a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:01.023984 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330479a-9871-4905-8af4-a8a95d369a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:01.024262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330479a-9871-4905-8af4-a8a95d369a6c admin admin] PATH_INFO: `/v3/users/ce55650df5e84cea8f70638a278fefa2` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:01.025496 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330479a-9871-4905-8af4-a8a95d369a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce55650df5e84cea8f70638a278fefa2)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:01.027596 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330479a-9871-4905-8af4-a8a95d369a6c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:01.213789 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-1330479a-9871-4905-8af4-a8a95d369a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce55650df5e84cea8f70638a278fefa2'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:01.308709 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-1330479a-9871-4905-8af4-a8a95d369a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce55650df5e84cea8f70638a278fefa2'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:01.315917 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-1330479a-9871-4905-8af4-a8a95d369a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce55650df5e84cea8f70638a278fefa2'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:01.316545 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-1330479a-9871-4905-8af4-a8a95d369a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce55650df5e84cea8f70638a278fefa2'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:01.328209 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-1330479a-9871-4905-8af4-a8a95d369a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce55650df5e84cea8f70638a278fefa2'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:01.334380 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1298/2595] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:19:00 2021] DELETE /identity/v3/users/ce55650df5e84cea8f70638a278fefa2 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:01.339025 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19836d-fed0-4596-9877-27a75b501aa7 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:01.339347 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19836d-fed0-4596-9877-27a75b501aa7 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:01.339620 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19836d-fed0-4596-9877-27a75b501aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:01.357887 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-7a19836d-fed0-4596-9877-27a75b501aa7 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:01.359083 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-7a19836d-fed0-4596-9877-27a75b501aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:01.418782 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1298/2596] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:19:01.429604 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330479a-9871-4905-8af4-a8a95d369a6c admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:01.431008 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-1330479a-9871-4905-8af4-a8a95d369a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:01.488023 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330479a-9871-4905-8af4-a8a95d369a6c admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:01.493166 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e66fe-5d04-4cda-b9e6-cf03faa327b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:01.493814 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e66fe-5d04-4cda-b9e6-cf03faa327b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:01.494092 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e66fe-5d04-4cda-b9e6-cf03faa327b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:01.494365 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e66fe-5d04-4cda-b9e6-cf03faa327b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:01.503482 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e66fe-5d04-4cda-b9e6-cf03faa327b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:01.504900 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e66fe-5d04-4cda-b9e6-cf03faa327b9 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:01.515558 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1299/2597] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:19:02.096357 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19836d-fed0-4596-9877-27a75b501aa7 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:02.098015 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-7a19836d-fed0-4596-9877-27a75b501aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:02.111930 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19836d-fed0-4596-9877-27a75b501aa7 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:02.117768 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15ad51-3eca-438f-b88d-e6ceec98242c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:02.118980 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15ad51-3eca-438f-b88d-e6ceec98242c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:02.119446 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15ad51-3eca-438f-b88d-e6ceec98242c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:02.119900 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15ad51-3eca-438f-b88d-e6ceec98242c admin admin] PATH_INFO: `/v3/projects/ef67d30d1c624f34b9d0f353f561e6d3` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:02.121402 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15ad51-3eca-438f-b88d-e6ceec98242c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef67d30d1c624f34b9d0f353f561e6d3)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:02.127031 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15ad51-3eca-438f-b88d-e6ceec98242c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:02.330629 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-af15ad51-3eca-438f-b88d-e6ceec98242c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef67d30d1c624f34b9d0f353f561e6d3', 'request_id': 'req-af15ad51-3eca-438f-b88d-e6ceec98242c'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:02.341335 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-af15ad51-3eca-438f-b88d-e6ceec98242c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef67d30d1c624f34b9d0f353f561e6d3', 'request_id': 'req-af15ad51-3eca-438f-b88d-e6ceec98242c'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:02.347497 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-af15ad51-3eca-438f-b88d-e6ceec98242c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef67d30d1c624f34b9d0f353f561e6d3', 'request_id': 'req-af15ad51-3eca-438f-b88d-e6ceec98242c'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:02.497262 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-af15ad51-3eca-438f-b88d-e6ceec98242c admin admin] The token cache is being invalidate because project ef67d30d1c624f34b9d0f353f561e6d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:19:02.497939 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-af15ad51-3eca-438f-b88d-e6ceec98242c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:02.498440 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-af15ad51-3eca-438f-b88d-e6ceec98242c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:02.500158 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1299/2598] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:19:02 2021] DELETE /identity/v3/projects/ef67d30d1c624f34b9d0f353f561e6d3 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:02.503997 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e66fe-5d04-4cda-b9e6-cf03faa327b9 service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:02.514251 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e66fe-5d04-4cda-b9e6-cf03faa327b9 service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:02.570575 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9b363-b34c-4b1f-a5fc-a344176f54a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:02.571416 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9b363-b34c-4b1f-a5fc-a344176f54a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:02.571699 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9b363-b34c-4b1f-a5fc-a344176f54a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:02.571975 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9b363-b34c-4b1f-a5fc-a344176f54a1 admin admin] PATH_INFO: `/v3/users/732c1a317837476d8ffcb9d15524e587` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:02.573175 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9b363-b34c-4b1f-a5fc-a344176f54a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=732c1a317837476d8ffcb9d15524e587)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:02.575100 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9b363-b34c-4b1f-a5fc-a344176f54a1 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:02.853035 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f4e9b363-b34c-4b1f-a5fc-a344176f54a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '732c1a317837476d8ffcb9d15524e587'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:02.930928 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f4e9b363-b34c-4b1f-a5fc-a344176f54a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '732c1a317837476d8ffcb9d15524e587'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:02.938275 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f4e9b363-b34c-4b1f-a5fc-a344176f54a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '732c1a317837476d8ffcb9d15524e587'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:02.938925 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f4e9b363-b34c-4b1f-a5fc-a344176f54a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '732c1a317837476d8ffcb9d15524e587'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:02.951319 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f4e9b363-b34c-4b1f-a5fc-a344176f54a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '732c1a317837476d8ffcb9d15524e587'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:02.957243 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1300/2599] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:19:02 2021] DELETE /identity/v3/users/732c1a317837476d8ffcb9d15524e587 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:19:03.191355 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15ad51-3eca-438f-b88d-e6ceec98242c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:03.192922 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-af15ad51-3eca-438f-b88d-e6ceec98242c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:03.231833 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15ad51-3eca-438f-b88d-e6ceec98242c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:03.294499 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bb1b0-3b01-4f44-9147-b7d919446872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:03.295443 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bb1b0-3b01-4f44-9147-b7d919446872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:03.295737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bb1b0-3b01-4f44-9147-b7d919446872 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:03.296018 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bb1b0-3b01-4f44-9147-b7d919446872 admin admin] PATH_INFO: `/v3/users/10c16bffb25e4a7a84246613a19c6acb` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:03.297668 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bb1b0-3b01-4f44-9147-b7d919446872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c16bffb25e4a7a84246613a19c6acb)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:03.299668 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bb1b0-3b01-4f44-9147-b7d919446872 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:03.395761 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9b363-b34c-4b1f-a5fc-a344176f54a1 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:03.397783 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-f4e9b363-b34c-4b1f-a5fc-a344176f54a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:03.419763 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9b363-b34c-4b1f-a5fc-a344176f54a1 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:03.425458 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be3dc8-82a2-4e74-a403-2e0fbd77ed5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:03.426545 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be3dc8-82a2-4e74-a403-2e0fbd77ed5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:03.426903 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be3dc8-82a2-4e74-a403-2e0fbd77ed5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:03.427299 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be3dc8-82a2-4e74-a403-2e0fbd77ed5e admin admin] PATH_INFO: `/v3/projects/4c7261a64fc042dd940b35859cb7068a` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:03.429988 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be3dc8-82a2-4e74-a403-2e0fbd77ed5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c7261a64fc042dd940b35859cb7068a)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:03.432062 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be3dc8-82a2-4e74-a403-2e0fbd77ed5e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:03.533256 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-e53bb1b0-3b01-4f44-9147-b7d919446872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c16bffb25e4a7a84246613a19c6acb'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:03.588142 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-01be3dc8-82a2-4e74-a403-2e0fbd77ed5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c7261a64fc042dd940b35859cb7068a', 'request_id': 'req-01be3dc8-82a2-4e74-a403-2e0fbd77ed5e'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:03.594758 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-01be3dc8-82a2-4e74-a403-2e0fbd77ed5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c7261a64fc042dd940b35859cb7068a', 'request_id': 'req-01be3dc8-82a2-4e74-a403-2e0fbd77ed5e'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:03.601104 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-01be3dc8-82a2-4e74-a403-2e0fbd77ed5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c7261a64fc042dd940b35859cb7068a', 'request_id': 'req-01be3dc8-82a2-4e74-a403-2e0fbd77ed5e'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:03.663674 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-e53bb1b0-3b01-4f44-9147-b7d919446872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c16bffb25e4a7a84246613a19c6acb'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:03.671966 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-e53bb1b0-3b01-4f44-9147-b7d919446872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c16bffb25e4a7a84246613a19c6acb'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:03.672651 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-e53bb1b0-3b01-4f44-9147-b7d919446872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c16bffb25e4a7a84246613a19c6acb'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:03.685309 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-e53bb1b0-3b01-4f44-9147-b7d919446872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c16bffb25e4a7a84246613a19c6acb'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:03.691311 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1300/2600] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:19:03 2021] DELETE /identity/v3/users/10c16bffb25e4a7a84246613a19c6acb => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:03.695833 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3103ace-e6b2-4491-9099-60b406f81814 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:03.696121 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3103ace-e6b2-4491-9099-60b406f81814 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:03.696399 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3103ace-e6b2-4491-9099-60b406f81814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:03.715604 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-d3103ace-e6b2-4491-9099-60b406f81814 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:03.716818 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-d3103ace-e6b2-4491-9099-60b406f81814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:03.776160 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1301/2601] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:19:03.785899 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3103ace-e6b2-4491-9099-60b406f81814 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:03.787281 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-d3103ace-e6b2-4491-9099-60b406f81814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:03.788349 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-01be3dc8-82a2-4e74-a403-2e0fbd77ed5e admin admin] The token cache is being invalidate because project 4c7261a64fc042dd940b35859cb7068a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:19:03.788644 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-01be3dc8-82a2-4e74-a403-2e0fbd77ed5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:03.789261 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-01be3dc8-82a2-4e74-a403-2e0fbd77ed5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:03.795203 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1301/2602] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:19:03 2021] DELETE /identity/v3/projects/4c7261a64fc042dd940b35859cb7068a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:03.796741 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518deef-5037-4624-8003-023093ee9184 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:03.797035 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518deef-5037-4624-8003-023093ee9184 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:03.797318 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518deef-5037-4624-8003-023093ee9184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:03.816153 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-c518deef-5037-4624-8003-023093ee9184 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:03.817364 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-c518deef-5037-4624-8003-023093ee9184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:03.825937 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1302/2603] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:19:03.834984 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e078343-2e1a-4e5f-8c7f-4024dee69e2c None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:03.835306 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e078343-2e1a-4e5f-8c7f-4024dee69e2c None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:03.835586 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e078343-2e1a-4e5f-8c7f-4024dee69e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:03.845129 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3103ace-e6b2-4491-9099-60b406f81814 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:03.848871 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63d4b4-9fbd-4eec-ad71-2653e2bcaf6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:03.849611 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63d4b4-9fbd-4eec-ad71-2653e2bcaf6c service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:03.849964 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63d4b4-9fbd-4eec-ad71-2653e2bcaf6c service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:03.850274 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63d4b4-9fbd-4eec-ad71-2653e2bcaf6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:03.852123 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-1d63d4b4-9fbd-4eec-ad71-2653e2bcaf6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:03.853787 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-1e078343-2e1a-4e5f-8c7f-4024dee69e2c None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:03.855340 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-1e078343-2e1a-4e5f-8c7f-4024dee69e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:03.864548 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63d4b4-9fbd-4eec-ad71-2653e2bcaf6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:03.869244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1303/2604] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:03.869402 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63d4b4-9fbd-4eec-ad71-2653e2bcaf6c service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:03.870678 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e078343-2e1a-4e5f-8c7f-4024dee69e2c None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:03.877144 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1302/2605] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:19:03.879978 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e078343-2e1a-4e5f-8c7f-4024dee69e2c None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:03.885670 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89d997-670d-4fff-b856-65b69cacec0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:03.886412 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89d997-670d-4fff-b856-65b69cacec0d admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:03.886695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89d997-670d-4fff-b856-65b69cacec0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:03.886973 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89d997-670d-4fff-b856-65b69cacec0d admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:03.887746 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89d997-670d-4fff-b856-65b69cacec0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:19:03.888052 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89d997-670d-4fff-b856-65b69cacec0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:03.889628 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89d997-670d-4fff-b856-65b69cacec0d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:03.901400 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1304/2606] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:19:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:19:03.905977 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63d4b4-9fbd-4eec-ad71-2653e2bcaf6c service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:03.916359 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63d4b4-9fbd-4eec-ad71-2653e2bcaf6c service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:03.921272 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f88354-5ad1-4ce1-b71f-6eca6084e6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:03.921926 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f88354-5ad1-4ce1-b71f-6eca6084e6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:03.922344 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f88354-5ad1-4ce1-b71f-6eca6084e6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:03.922630 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f88354-5ad1-4ce1-b71f-6eca6084e6b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:03.923367 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f88354-5ad1-4ce1-b71f-6eca6084e6b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:03.925261 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f88354-5ad1-4ce1-b71f-6eca6084e6b7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:04.011178 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1303/2607] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:19:03 2021] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:19:04.015158 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89d997-670d-4fff-b856-65b69cacec0d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:04.025134 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89d997-670d-4fff-b856-65b69cacec0d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:04.080142 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6d83d-f038-4618-b9fc-757d698a10a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:04.080804 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6d83d-f038-4618-b9fc-757d698a10a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:04.081087 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6d83d-f038-4618-b9fc-757d698a10a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:04.081356 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6d83d-f038-4618-b9fc-757d698a10a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:04.082059 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6d83d-f038-4618-b9fc-757d698a10a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:04.084033 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6d83d-f038-4618-b9fc-757d698a10a5 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:04.185094 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1305/2608] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:19:04 2021] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:19:04.186316 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f88354-5ad1-4ce1-b71f-6eca6084e6b7 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:04.197099 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f88354-5ad1-4ce1-b71f-6eca6084e6b7 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:04.202182 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c29b0-99f7-4a46-a70f-fdab171c242e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:04.202891 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c29b0-99f7-4a46-a70f-fdab171c242e admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:04.203177 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c29b0-99f7-4a46-a70f-fdab171c242e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:04.203489 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c29b0-99f7-4a46-a70f-fdab171c242e admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:04.204225 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c29b0-99f7-4a46-a70f-fdab171c242e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:04.205813 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c29b0-99f7-4a46-a70f-fdab171c242e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:04.217123 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1304/2609] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:19:04 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:19:04.220978 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6d83d-f038-4618-b9fc-757d698a10a5 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:04.232371 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6d83d-f038-4618-b9fc-757d698a10a5 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:04.237131 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9be8f-6de4-41d8-8f0b-f64b30d0a36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:04.237737 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9be8f-6de4-41d8-8f0b-f64b30d0a36b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:04.238018 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9be8f-6de4-41d8-8f0b-f64b30d0a36b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:04.238299 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9be8f-6de4-41d8-8f0b-f64b30d0a36b admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:04.239033 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9be8f-6de4-41d8-8f0b-f64b30d0a36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:04.241680 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9be8f-6de4-41d8-8f0b-f64b30d0a36b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:04.251980 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1306/2610] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:19:04 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:19:04.256886 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c29b0-99f7-4a46-a70f-fdab171c242e admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:04.267630 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c29b0-99f7-4a46-a70f-fdab171c242e admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:04.273333 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb2525-8e2f-4546-889d-75c5c0fa37eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:04.274212 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb2525-8e2f-4546-889d-75c5c0fa37eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:04.274487 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb2525-8e2f-4546-889d-75c5c0fa37eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:04.274756 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb2525-8e2f-4546-889d-75c5c0fa37eb admin admin] PATH_INFO: `/v3/projects/59f0eaa9e21b4b84be697137d19b4723/users/4ac75d0c54204a2693b31f37a866e41a/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:04.289622 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb2525-8e2f-4546-889d-75c5c0fa37eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=59f0eaa9e21b4b84be697137d19b4723, user_id=4ac75d0c54204a2693b31f37a866e41a, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:04.292342 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb2525-8e2f-4546-889d-75c5c0fa37eb admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:04.344132 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9be8f-6de4-41d8-8f0b-f64b30d0a36b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:04.345922 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-80e9be8f-6de4-41d8-8f0b-f64b30d0a36b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:04.361177 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9be8f-6de4-41d8-8f0b-f64b30d0a36b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:04.371927 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fcc842-443d-4ec7-b7c8-a8b447258307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:04.372795 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcc842-443d-4ec7-b7c8-a8b447258307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:04.373080 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcc842-443d-4ec7-b7c8-a8b447258307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:04.373352 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcc842-443d-4ec7-b7c8-a8b447258307 admin admin] PATH_INFO: `/v3/projects/4d90e88077114e3bae58432c56aac5f5` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:04.374792 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fcc842-443d-4ec7-b7c8-a8b447258307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d90e88077114e3bae58432c56aac5f5)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:04.379908 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fcc842-443d-4ec7-b7c8-a8b447258307 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:04.380003 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1305/2611] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:19:04 2021] PUT /identity/v3/projects/59f0eaa9e21b4b84be697137d19b4723/users/4ac75d0c54204a2693b31f37a866e41a/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:04.389788 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ba997-5c73-4231-8827-51d3fb839342 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:04.390438 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ba997-5c73-4231-8827-51d3fb839342 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:04.390842 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ba997-5c73-4231-8827-51d3fb839342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:04.422235 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-0d5ba997-5c73-4231-8827-51d3fb839342 None None] MFA Rules not processed for user `4ac75d0c54204a2693b31f37a866e41a`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:04.423470 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-0d5ba997-5c73-4231-8827-51d3fb839342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:04.493060 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1306/2612] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:04 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:19:04.497572 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ba997-5c73-4231-8827-51d3fb839342 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:04.542141 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-25fcc842-443d-4ec7-b7c8-a8b447258307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d90e88077114e3bae58432c56aac5f5', 'request_id': 'req-25fcc842-443d-4ec7-b7c8-a8b447258307'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:04.548860 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-25fcc842-443d-4ec7-b7c8-a8b447258307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d90e88077114e3bae58432c56aac5f5', 'request_id': 'req-25fcc842-443d-4ec7-b7c8-a8b447258307'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:04.556092 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-25fcc842-443d-4ec7-b7c8-a8b447258307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d90e88077114e3bae58432c56aac5f5', 'request_id': 'req-25fcc842-443d-4ec7-b7c8-a8b447258307'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:04.559656 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ba997-5c73-4231-8827-51d3fb839342 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:04.615822 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d84d9-a6f9-43f2-87c5-5813f6b18e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:04.616661 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d84d9-a6f9-43f2-87c5-5813f6b18e7a admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:04.616950 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d84d9-a6f9-43f2-87c5-5813f6b18e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:04.617226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d84d9-a6f9-43f2-87c5-5813f6b18e7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:04.617951 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d84d9-a6f9-43f2-87c5-5813f6b18e7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:04.619950 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d84d9-a6f9-43f2-87c5-5813f6b18e7a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:04.730814 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-25fcc842-443d-4ec7-b7c8-a8b447258307 admin admin] The token cache is being invalidate because project 4d90e88077114e3bae58432c56aac5f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:19:04.731393 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-25fcc842-443d-4ec7-b7c8-a8b447258307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:04.731991 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-25fcc842-443d-4ec7-b7c8-a8b447258307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:04.732845 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1307/2613] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:19:04 2021] POST /identity/v3/projects => generated 385 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:19:04.736565 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1307/2614] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:19:04 2021] DELETE /identity/v3/projects/4d90e88077114e3bae58432c56aac5f5 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:19:04.736726 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d84d9-a6f9-43f2-87c5-5813f6b18e7a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:04.737882 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fcc842-443d-4ec7-b7c8-a8b447258307 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:04.738368 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-416d84d9-a6f9-43f2-87c5-5813f6b18e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:04.739296 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-25fcc842-443d-4ec7-b7c8-a8b447258307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:04.753955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fcc842-443d-4ec7-b7c8-a8b447258307 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:04.810190 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d84d9-a6f9-43f2-87c5-5813f6b18e7a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:04.814963 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfba13-2b0f-4181-821b-8d2f3d3c667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:04.815232 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba9958-3b8d-4d80-9daa-1130f0758ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:04.815750 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba9958-3b8d-4d80-9daa-1130f0758ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:04.815862 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfba13-2b0f-4181-821b-8d2f3d3c667b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:04.816025 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba9958-3b8d-4d80-9daa-1130f0758ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:04.816126 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfba13-2b0f-4181-821b-8d2f3d3c667b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:04.816307 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba9958-3b8d-4d80-9daa-1130f0758ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:04.816405 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfba13-2b0f-4181-821b-8d2f3d3c667b admin admin] PATH_INFO: `/v3/users/fe1bb386793f46a39901f619e1571566` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:04.816994 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba9958-3b8d-4d80-9daa-1130f0758ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:04.817594 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddfba13-2b0f-4181-821b-8d2f3d3c667b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe1bb386793f46a39901f619e1571566)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:04.819873 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba9958-3b8d-4d80-9daa-1130f0758ec3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:04.820079 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddfba13-2b0f-4181-821b-8d2f3d3c667b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:04.900272 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1308/2615] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:19:04 2021] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:19:04.901344 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba9958-3b8d-4d80-9daa-1130f0758ec3 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:04.910767 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba9958-3b8d-4d80-9daa-1130f0758ec3 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:04.916411 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52035704-e01c-4d6e-ab52-b1fe286cc268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:04.917059 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52035704-e01c-4d6e-ab52-b1fe286cc268 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:04.917343 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52035704-e01c-4d6e-ab52-b1fe286cc268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:04.917615 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52035704-e01c-4d6e-ab52-b1fe286cc268 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:04.918347 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52035704-e01c-4d6e-ab52-b1fe286cc268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:04.920083 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52035704-e01c-4d6e-ab52-b1fe286cc268 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:04.931066 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1309/2616] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:19:04 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:19:04.935142 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52035704-e01c-4d6e-ab52-b1fe286cc268 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:04.944968 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52035704-e01c-4d6e-ab52-b1fe286cc268 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:04.949619 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888667e0-a935-4558-bd7c-4fb3e52a6400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:04.950478 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888667e0-a935-4558-bd7c-4fb3e52a6400 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:04.950757 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888667e0-a935-4558-bd7c-4fb3e52a6400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:04.951032 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888667e0-a935-4558-bd7c-4fb3e52a6400 admin admin] PATH_INFO: `/v3/projects/af44f57bb0184827a99097c26e8a50c8/users/d802691b6a7745a69e4a1fc9681a1f92/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:04.965889 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888667e0-a935-4558-bd7c-4fb3e52a6400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af44f57bb0184827a99097c26e8a50c8, user_id=d802691b6a7745a69e4a1fc9681a1f92, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:04.968574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888667e0-a935-4558-bd7c-4fb3e52a6400 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:05.022470 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2ddfba13-2b0f-4181-821b-8d2f3d3c667b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe1bb386793f46a39901f619e1571566'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:05.034759 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1310/2617] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:19:04 2021] PUT /identity/v3/projects/af44f57bb0184827a99097c26e8a50c8/users/d802691b6a7745a69e4a1fc9681a1f92/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:05.039506 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888667e0-a935-4558-bd7c-4fb3e52a6400 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:05.085765 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2ddfba13-2b0f-4181-821b-8d2f3d3c667b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe1bb386793f46a39901f619e1571566'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:05.093104 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2ddfba13-2b0f-4181-821b-8d2f3d3c667b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe1bb386793f46a39901f619e1571566'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:05.093750 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2ddfba13-2b0f-4181-821b-8d2f3d3c667b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe1bb386793f46a39901f619e1571566'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:05.098300 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888667e0-a935-4558-bd7c-4fb3e52a6400 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:05.103739 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628ecee-3e03-4b42-be48-1f14b8a67070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:05.104402 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628ecee-3e03-4b42-be48-1f14b8a67070 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:05.104716 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628ecee-3e03-4b42-be48-1f14b8a67070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:05.104996 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628ecee-3e03-4b42-be48-1f14b8a67070 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:05.105739 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628ecee-3e03-4b42-be48-1f14b8a67070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:05.106341 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2ddfba13-2b0f-4181-821b-8d2f3d3c667b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe1bb386793f46a39901f619e1571566'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:05.112356 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1308/2618] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:19:04 2021] DELETE /identity/v3/users/fe1bb386793f46a39901f619e1571566 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:05.119278 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628ecee-3e03-4b42-be48-1f14b8a67070 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:05.126487 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1311/2619] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:19:05 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:19:05.130819 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfba13-2b0f-4181-821b-8d2f3d3c667b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:05.132524 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-2ddfba13-2b0f-4181-821b-8d2f3d3c667b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:05.213721 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfba13-2b0f-4181-821b-8d2f3d3c667b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:05.218664 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701a62d-4afe-436d-991f-3ca39f97ca74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:05.219579 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701a62d-4afe-436d-991f-3ca39f97ca74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:05.219862 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701a62d-4afe-436d-991f-3ca39f97ca74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:05.220134 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701a62d-4afe-436d-991f-3ca39f97ca74 admin admin] PATH_INFO: `/v3/projects/af44f57bb0184827a99097c26e8a50c8/users/d802691b6a7745a69e4a1fc9681a1f92/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:05.222123 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701a62d-4afe-436d-991f-3ca39f97ca74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af44f57bb0184827a99097c26e8a50c8, user_id=d802691b6a7745a69e4a1fc9681a1f92, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:05.225462 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701a62d-4afe-436d-991f-3ca39f97ca74 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:05.235837 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1309/2620] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:19:05 2021] PUT /identity/v3/projects/af44f57bb0184827a99097c26e8a50c8/users/d802691b6a7745a69e4a1fc9681a1f92/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:05.247075 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46384e15-8641-47f9-904a-c6077d41a46f None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:05.247470 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46384e15-8641-47f9-904a-c6077d41a46f None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:05.247774 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46384e15-8641-47f9-904a-c6077d41a46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:05.289457 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-46384e15-8641-47f9-904a-c6077d41a46f None None] MFA Rules not processed for user `d802691b6a7745a69e4a1fc9681a1f92`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:05.289457 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-46384e15-8641-47f9-904a-c6077d41a46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:05.346610 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1312/2621] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:05 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:05.365455 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701a62d-4afe-436d-991f-3ca39f97ca74 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:05.367332 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-0701a62d-4afe-436d-991f-3ca39f97ca74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:05.425672 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701a62d-4afe-436d-991f-3ca39f97ca74 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:05.430070 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51914bb6-3757-44a8-ae49-8bd5360e4e56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:05.430713 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51914bb6-3757-44a8-ae49-8bd5360e4e56 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:05.430999 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51914bb6-3757-44a8-ae49-8bd5360e4e56 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:05.431307 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51914bb6-3757-44a8-ae49-8bd5360e4e56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:05.440391 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51914bb6-3757-44a8-ae49-8bd5360e4e56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:05.441822 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51914bb6-3757-44a8-ae49-8bd5360e4e56 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:05.454412 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1310/2622] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:05 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:19:05.765529 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46384e15-8641-47f9-904a-c6077d41a46f None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:05.766959 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-46384e15-8641-47f9-904a-c6077d41a46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:05.852147 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46384e15-8641-47f9-904a-c6077d41a46f None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:05.857396 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f433958-f385-4314-b0f8-780217b5b584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:05.858255 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f433958-f385-4314-b0f8-780217b5b584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:05.858542 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f433958-f385-4314-b0f8-780217b5b584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:05.858816 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f433958-f385-4314-b0f8-780217b5b584 admin admin] PATH_INFO: `/v3/projects/cc514336875048e0bc8007c9aa1bcd29` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:05.860061 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f433958-f385-4314-b0f8-780217b5b584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc514336875048e0bc8007c9aa1bcd29)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:05.862257 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f433958-f385-4314-b0f8-780217b5b584 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:05.973629 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d6d9e-b0f6-409f-86e4-5a84d1b6b9f9 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:05.974702 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d6d9e-b0f6-409f-86e4-5a84d1b6b9f9 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:05.974818 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d6d9e-b0f6-409f-86e4-5a84d1b6b9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:05.992805 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-4d9d6d9e-b0f6-409f-86e4-5a84d1b6b9f9 None None] MFA Rules not processed for user `1009c9c7798f48f6ad891766711d0c0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:05.994001 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-4d9d6d9e-b0f6-409f-86e4-5a84d1b6b9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:06.053079 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1311/2623] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:05 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:19:06.053243 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0f433958-f385-4314-b0f8-780217b5b584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc514336875048e0bc8007c9aa1bcd29', 'request_id': 'req-0f433958-f385-4314-b0f8-780217b5b584'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:06.057634 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0f433958-f385-4314-b0f8-780217b5b584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc514336875048e0bc8007c9aa1bcd29', 'request_id': 'req-0f433958-f385-4314-b0f8-780217b5b584'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:06.068169 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0f433958-f385-4314-b0f8-780217b5b584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc514336875048e0bc8007c9aa1bcd29', 'request_id': 'req-0f433958-f385-4314-b0f8-780217b5b584'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:06.211376 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0f433958-f385-4314-b0f8-780217b5b584 admin admin] The token cache is being invalidate because project cc514336875048e0bc8007c9aa1bcd29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:19:06.219048 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0f433958-f385-4314-b0f8-780217b5b584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:06.219048 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0f433958-f385-4314-b0f8-780217b5b584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:06.219048 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1313/2624] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:19:05 2021] DELETE /identity/v3/projects/cc514336875048e0bc8007c9aa1bcd29 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:06.219359 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d6d9e-b0f6-409f-86e4-5a84d1b6b9f9 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:06.229410 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d6d9e-b0f6-409f-86e4-5a84d1b6b9f9 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:06.288746 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458391d6-425f-427a-908d-613815f9f18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:06.289631 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458391d6-425f-427a-908d-613815f9f18b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:06.290031 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458391d6-425f-427a-908d-613815f9f18b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:06.290309 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458391d6-425f-427a-908d-613815f9f18b admin admin] PATH_INFO: `/v3/users/a32196c7d59e426db8d6a042ce028e70` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:06.291585 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458391d6-425f-427a-908d-613815f9f18b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a32196c7d59e426db8d6a042ce028e70)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:06.293474 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458391d6-425f-427a-908d-613815f9f18b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:06.644243 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-458391d6-425f-427a-908d-613815f9f18b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a32196c7d59e426db8d6a042ce028e70'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:06.794510 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-458391d6-425f-427a-908d-613815f9f18b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a32196c7d59e426db8d6a042ce028e70'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:06.803797 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-458391d6-425f-427a-908d-613815f9f18b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a32196c7d59e426db8d6a042ce028e70'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:06.804589 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-458391d6-425f-427a-908d-613815f9f18b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a32196c7d59e426db8d6a042ce028e70'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:06.817224 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-458391d6-425f-427a-908d-613815f9f18b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a32196c7d59e426db8d6a042ce028e70'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:06.826630 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1312/2625] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:19:06 2021] DELETE /identity/v3/users/a32196c7d59e426db8d6a042ce028e70 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:06.931084 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f433958-f385-4314-b0f8-780217b5b584 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:06.932696 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-0f433958-f385-4314-b0f8-780217b5b584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:06.949395 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f433958-f385-4314-b0f8-780217b5b584 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:07.015925 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf742d-0b40-4318-a469-5710b45a0c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:07.016945 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf742d-0b40-4318-a469-5710b45a0c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:07.017241 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf742d-0b40-4318-a469-5710b45a0c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:07.017512 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf742d-0b40-4318-a469-5710b45a0c07 admin admin] PATH_INFO: `/v3/users/4ac75d0c54204a2693b31f37a866e41a` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:07.018712 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf742d-0b40-4318-a469-5710b45a0c07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac75d0c54204a2693b31f37a866e41a)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:07.020697 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf742d-0b40-4318-a469-5710b45a0c07 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:07.230777 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-dfaf742d-0b40-4318-a469-5710b45a0c07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac75d0c54204a2693b31f37a866e41a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:07.281679 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458391d6-425f-427a-908d-613815f9f18b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:07.283202 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-458391d6-425f-427a-908d-613815f9f18b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:07.296921 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458391d6-425f-427a-908d-613815f9f18b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:07.301548 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97b518-0898-4566-b63c-78d0a15b6cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:07.303318 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97b518-0898-4566-b63c-78d0a15b6cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:07.303604 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97b518-0898-4566-b63c-78d0a15b6cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:07.303880 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97b518-0898-4566-b63c-78d0a15b6cdb admin admin] PATH_INFO: `/v3/projects/51a4bbb39c8448b08be3a445019f7742` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:07.305097 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97b518-0898-4566-b63c-78d0a15b6cdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=51a4bbb39c8448b08be3a445019f7742)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:07.307366 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97b518-0898-4566-b63c-78d0a15b6cdb admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:07.309906 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-dfaf742d-0b40-4318-a469-5710b45a0c07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac75d0c54204a2693b31f37a866e41a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:07.317617 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-dfaf742d-0b40-4318-a469-5710b45a0c07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac75d0c54204a2693b31f37a866e41a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:07.318645 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-dfaf742d-0b40-4318-a469-5710b45a0c07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac75d0c54204a2693b31f37a866e41a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:07.332166 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-dfaf742d-0b40-4318-a469-5710b45a0c07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac75d0c54204a2693b31f37a866e41a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:07.338401 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1314/2626] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:19:06 2021] DELETE /identity/v3/users/4ac75d0c54204a2693b31f37a866e41a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:07.342750 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3fa01-d0e6-4643-bc82-ea82f3cfe56a None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:07.346679 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3fa01-d0e6-4643-bc82-ea82f3cfe56a None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:07.346679 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3fa01-d0e6-4643-bc82-ea82f3cfe56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:07.360577 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-2da3fa01-d0e6-4643-bc82-ea82f3cfe56a None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:07.361823 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-2da3fa01-d0e6-4643-bc82-ea82f3cfe56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:07.419907 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1315/2627] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:19:07.430631 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3fa01-d0e6-4643-bc82-ea82f3cfe56a None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:07.432070 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-2da3fa01-d0e6-4643-bc82-ea82f3cfe56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:07.440709 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-8d97b518-0898-4566-b63c-78d0a15b6cdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51a4bbb39c8448b08be3a445019f7742', 'request_id': 'req-8d97b518-0898-4566-b63c-78d0a15b6cdb'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:07.447069 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-8d97b518-0898-4566-b63c-78d0a15b6cdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51a4bbb39c8448b08be3a445019f7742', 'request_id': 'req-8d97b518-0898-4566-b63c-78d0a15b6cdb'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:07.452849 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-8d97b518-0898-4566-b63c-78d0a15b6cdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51a4bbb39c8448b08be3a445019f7742', 'request_id': 'req-8d97b518-0898-4566-b63c-78d0a15b6cdb'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:07.487710 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3fa01-d0e6-4643-bc82-ea82f3cfe56a None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:07.535742 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c93d28-43c2-4c5a-84ed-0e53d746e55e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:07.536382 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c93d28-43c2-4c5a-84ed-0e53d746e55e service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:07.538011 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c93d28-43c2-4c5a-84ed-0e53d746e55e service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:07.538294 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c93d28-43c2-4c5a-84ed-0e53d746e55e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:07.570491 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-8d97b518-0898-4566-b63c-78d0a15b6cdb admin admin] The token cache is being invalidate because project 51a4bbb39c8448b08be3a445019f7742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:19:07.570789 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-8d97b518-0898-4566-b63c-78d0a15b6cdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:07.571442 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-8d97b518-0898-4566-b63c-78d0a15b6cdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:07.573068 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1313/2628] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:19:07 2021] DELETE /identity/v3/projects/51a4bbb39c8448b08be3a445019f7742 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:19:07.579846 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93f1c8-39bc-4f8a-9527-95dc3f2add80 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:07.580181 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93f1c8-39bc-4f8a-9527-95dc3f2add80 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:07.580459 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93f1c8-39bc-4f8a-9527-95dc3f2add80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:07.600360 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c93d28-43c2-4c5a-84ed-0e53d746e55e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:07.601790 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c93d28-43c2-4c5a-84ed-0e53d746e55e service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:07.609895 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-9d93f1c8-39bc-4f8a-9527-95dc3f2add80 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:07.611108 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-9d93f1c8-39bc-4f8a-9527-95dc3f2add80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:07.611702 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1316/2629] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:19:07.620223 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1314/2630] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:07.628194 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159ff8e-e230-4be6-835e-328f186c332d None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:07.628492 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159ff8e-e230-4be6-835e-328f186c332d None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:07.628764 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159ff8e-e230-4be6-835e-328f186c332d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:07.647750 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-2159ff8e-e230-4be6-835e-328f186c332d None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:07.648972 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-2159ff8e-e230-4be6-835e-328f186c332d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:07.657098 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1317/2631] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:07.661385 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93f1c8-39bc-4f8a-9527-95dc3f2add80 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:07.678506 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93f1c8-39bc-4f8a-9527-95dc3f2add80 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:07.679495 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1cdfa-1fd8-434e-b27f-279fee9b7c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:07.680208 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1cdfa-1fd8-434e-b27f-279fee9b7c85 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:07.680497 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1cdfa-1fd8-434e-b27f-279fee9b7c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:07.680795 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1cdfa-1fd8-434e-b27f-279fee9b7c85 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:07.681534 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1cdfa-1fd8-434e-b27f-279fee9b7c85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:19:07.681839 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1cdfa-1fd8-434e-b27f-279fee9b7c85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:07.683512 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1cdfa-1fd8-434e-b27f-279fee9b7c85 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:07.699082 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1315/2632] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:19:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 04:19:07.700226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159ff8e-e230-4be6-835e-328f186c332d None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:07.710606 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159ff8e-e230-4be6-835e-328f186c332d None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:07.715096 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85f25d-85cd-418a-89f7-438ed5b52d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:07.715766 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85f25d-85cd-418a-89f7-438ed5b52d01 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:07.716047 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85f25d-85cd-418a-89f7-438ed5b52d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:07.716322 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85f25d-85cd-418a-89f7-438ed5b52d01 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:07.717022 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85f25d-85cd-418a-89f7-438ed5b52d01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:07.718885 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85f25d-85cd-418a-89f7-438ed5b52d01 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:07.928620 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1318/2633] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:19:07 2021] POST /identity/v3/projects => generated 383 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:19:07.931248 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1cdfa-1fd8-434e-b27f-279fee9b7c85 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:07.941731 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1cdfa-1fd8-434e-b27f-279fee9b7c85 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:08.003088 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007ffe3-6bce-4b29-89e6-cef7e58fa3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:08.003838 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007ffe3-6bce-4b29-89e6-cef7e58fa3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:08.006772 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007ffe3-6bce-4b29-89e6-cef7e58fa3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:08.006772 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007ffe3-6bce-4b29-89e6-cef7e58fa3a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:08.006772 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007ffe3-6bce-4b29-89e6-cef7e58fa3a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:08.007795 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007ffe3-6bce-4b29-89e6-cef7e58fa3a9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:08.091815 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1316/2634] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:19:07 2021] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:19:08.095882 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85f25d-85cd-418a-89f7-438ed5b52d01 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:08.106433 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85f25d-85cd-418a-89f7-438ed5b52d01 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:08.110967 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027d27c-56e5-492b-8c12-1a688e39403b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:08.111657 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027d27c-56e5-492b-8c12-1a688e39403b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:08.111973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027d27c-56e5-492b-8c12-1a688e39403b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:08.112247 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027d27c-56e5-492b-8c12-1a688e39403b admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:08.115764 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027d27c-56e5-492b-8c12-1a688e39403b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:08.115764 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027d27c-56e5-492b-8c12-1a688e39403b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:08.125025 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1319/2635] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:19:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:19:08.129067 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007ffe3-6bce-4b29-89e6-cef7e58fa3a9 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:08.139389 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007ffe3-6bce-4b29-89e6-cef7e58fa3a9 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:08.142701 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027d27c-56e5-492b-8c12-1a688e39403b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:08.144401 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065b06e-593f-4400-9dd0-44149a9d2e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:08.144648 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-d027d27c-56e5-492b-8c12-1a688e39403b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:08.145069 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065b06e-593f-4400-9dd0-44149a9d2e63 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:08.145411 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065b06e-593f-4400-9dd0-44149a9d2e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:08.145693 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065b06e-593f-4400-9dd0-44149a9d2e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:08.146586 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065b06e-593f-4400-9dd0-44149a9d2e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:08.148308 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065b06e-593f-4400-9dd0-44149a9d2e63 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:08.162628 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027d27c-56e5-492b-8c12-1a688e39403b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:08.166259 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1317/2636] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:19:08 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:19:08.171052 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a64603-95d2-4f29-a1c1-5e48b299ca2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:08.171953 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a64603-95d2-4f29-a1c1-5e48b299ca2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:08.172249 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a64603-95d2-4f29-a1c1-5e48b299ca2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:08.172577 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a64603-95d2-4f29-a1c1-5e48b299ca2b admin admin] PATH_INFO: `/v3/projects/59f0eaa9e21b4b84be697137d19b4723` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:08.173900 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a64603-95d2-4f29-a1c1-5e48b299ca2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=59f0eaa9e21b4b84be697137d19b4723)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:08.175765 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a64603-95d2-4f29-a1c1-5e48b299ca2b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:08.178346 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065b06e-593f-4400-9dd0-44149a9d2e63 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:08.188451 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065b06e-593f-4400-9dd0-44149a9d2e63 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:08.194085 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e1289-0a89-417d-98ef-99c46b10c88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:08.194998 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e1289-0a89-417d-98ef-99c46b10c88d admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:08.195322 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e1289-0a89-417d-98ef-99c46b10c88d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:08.195604 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e1289-0a89-417d-98ef-99c46b10c88d admin admin] PATH_INFO: `/v3/projects/cf0e488d4ada407b8178166769b1c423/users/1be13de272154962bf19a9f289e4d37b/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:08.211416 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e1289-0a89-417d-98ef-99c46b10c88d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0e488d4ada407b8178166769b1c423, user_id=1be13de272154962bf19a9f289e4d37b, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:08.214132 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e1289-0a89-417d-98ef-99c46b10c88d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:08.312445 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1318/2637] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:19:08 2021] PUT /identity/v3/projects/cf0e488d4ada407b8178166769b1c423/users/1be13de272154962bf19a9f289e4d37b/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:08.324259 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889ba59-43c3-459d-946f-7a0d20ee75a8 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:08.324551 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889ba59-43c3-459d-946f-7a0d20ee75a8 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:08.324832 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889ba59-43c3-459d-946f-7a0d20ee75a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:08.329936 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-60a64603-95d2-4f29-a1c1-5e48b299ca2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59f0eaa9e21b4b84be697137d19b4723', 'request_id': 'req-60a64603-95d2-4f29-a1c1-5e48b299ca2b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:08.338181 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-60a64603-95d2-4f29-a1c1-5e48b299ca2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59f0eaa9e21b4b84be697137d19b4723', 'request_id': 'req-60a64603-95d2-4f29-a1c1-5e48b299ca2b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:08.343604 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-60a64603-95d2-4f29-a1c1-5e48b299ca2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59f0eaa9e21b4b84be697137d19b4723', 'request_id': 'req-60a64603-95d2-4f29-a1c1-5e48b299ca2b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:08.350669 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-0889ba59-43c3-459d-946f-7a0d20ee75a8 None None] MFA Rules not processed for user `1be13de272154962bf19a9f289e4d37b`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:08.351938 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-0889ba59-43c3-459d-946f-7a0d20ee75a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:08.412921 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1319/2638] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:08 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:19:08.417334 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889ba59-43c3-459d-946f-7a0d20ee75a8 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:08.425655 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-60a64603-95d2-4f29-a1c1-5e48b299ca2b admin admin] The token cache is being invalidate because project 59f0eaa9e21b4b84be697137d19b4723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:19:08.425942 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-60a64603-95d2-4f29-a1c1-5e48b299ca2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:08.426654 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-60a64603-95d2-4f29-a1c1-5e48b299ca2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:08.431313 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1320/2639] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:19:08 2021] DELETE /identity/v3/projects/59f0eaa9e21b4b84be697137d19b4723 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:08.433976 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a64603-95d2-4f29-a1c1-5e48b299ca2b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:08.435379 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-60a64603-95d2-4f29-a1c1-5e48b299ca2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:08.482529 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889ba59-43c3-459d-946f-7a0d20ee75a8 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:08.487058 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a180151-9fb9-465d-996b-10043980ac3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:08.487742 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a180151-9fb9-465d-996b-10043980ac3f admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:08.488024 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a180151-9fb9-465d-996b-10043980ac3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:08.492413 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a180151-9fb9-465d-996b-10043980ac3f admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:08.492413 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a180151-9fb9-465d-996b-10043980ac3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:08.492413 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a180151-9fb9-465d-996b-10043980ac3f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:08.501044 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a64603-95d2-4f29-a1c1-5e48b299ca2b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:08.505947 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1adcb-2cdd-4279-b799-472029596c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:08.506808 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1adcb-2cdd-4279-b799-472029596c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:08.507094 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1adcb-2cdd-4279-b799-472029596c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:08.507407 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1adcb-2cdd-4279-b799-472029596c11 admin admin] PATH_INFO: `/v3/users/d802691b6a7745a69e4a1fc9681a1f92` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:08.508649 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1adcb-2cdd-4279-b799-472029596c11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d802691b6a7745a69e4a1fc9681a1f92)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:08.510550 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1adcb-2cdd-4279-b799-472029596c11 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:08.611114 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1320/2640] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:19:08 2021] POST /identity/v3/projects => generated 383 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:19:08.616504 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a180151-9fb9-465d-996b-10043980ac3f admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:08.618109 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-6a180151-9fb9-465d-996b-10043980ac3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:08.685071 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a180151-9fb9-465d-996b-10043980ac3f admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:08.689761 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e67de-7f00-41ed-a5e0-2cc83205554b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:08.690416 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e67de-7f00-41ed-a5e0-2cc83205554b admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:08.690698 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e67de-7f00-41ed-a5e0-2cc83205554b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:08.690970 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e67de-7f00-41ed-a5e0-2cc83205554b admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:08.691733 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e67de-7f00-41ed-a5e0-2cc83205554b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:08.694505 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e67de-7f00-41ed-a5e0-2cc83205554b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:08.783333 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-3ef1adcb-2cdd-4279-b799-472029596c11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd802691b6a7745a69e4a1fc9681a1f92'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:08.828722 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1321/2641] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:19:08 2021] POST /identity/v3/users => generated 298 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:19:08.832611 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e67de-7f00-41ed-a5e0-2cc83205554b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:08.843332 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e67de-7f00-41ed-a5e0-2cc83205554b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:08.847988 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd265c-e3fe-448a-951f-0261642ee59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:08.848616 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd265c-e3fe-448a-951f-0261642ee59a admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:08.848898 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd265c-e3fe-448a-951f-0261642ee59a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:08.849314 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd265c-e3fe-448a-951f-0261642ee59a admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:08.850087 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd265c-e3fe-448a-951f-0261642ee59a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:08.851683 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd265c-e3fe-448a-951f-0261642ee59a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:08.861356 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1322/2642] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:19:08 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:19:08.865392 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd265c-e3fe-448a-951f-0261642ee59a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:08.868582 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-3ef1adcb-2cdd-4279-b799-472029596c11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd802691b6a7745a69e4a1fc9681a1f92'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:08.874865 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd265c-e3fe-448a-951f-0261642ee59a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:08.875775 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-3ef1adcb-2cdd-4279-b799-472029596c11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd802691b6a7745a69e4a1fc9681a1f92'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:08.876416 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-3ef1adcb-2cdd-4279-b799-472029596c11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd802691b6a7745a69e4a1fc9681a1f92'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:08.880242 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a6193-999c-48aa-b9ad-5be20a549ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:08.882186 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a6193-999c-48aa-b9ad-5be20a549ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:08.882474 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a6193-999c-48aa-b9ad-5be20a549ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:08.882756 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a6193-999c-48aa-b9ad-5be20a549ec3 admin admin] PATH_INFO: `/v3/projects/047fbd6dca384c59833cb7e4d2103311/users/b06fe49e28ed4a36b04cdadfe5e1fceb/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:08.889047 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-3ef1adcb-2cdd-4279-b799-472029596c11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd802691b6a7745a69e4a1fc9681a1f92'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:08.894790 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1321/2643] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:19:08 2021] DELETE /identity/v3/users/d802691b6a7745a69e4a1fc9681a1f92 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:19:08.899368 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a6193-999c-48aa-b9ad-5be20a549ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=047fbd6dca384c59833cb7e4d2103311, user_id=b06fe49e28ed4a36b04cdadfe5e1fceb, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:08.901992 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a6193-999c-48aa-b9ad-5be20a549ec3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:08.978301 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1323/2644] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:19:08 2021] PUT /identity/v3/projects/047fbd6dca384c59833cb7e4d2103311/users/b06fe49e28ed4a36b04cdadfe5e1fceb/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:19:08.982531 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1adcb-2cdd-4279-b799-472029596c11 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:08.984057 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-3ef1adcb-2cdd-4279-b799-472029596c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:09.051397 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1adcb-2cdd-4279-b799-472029596c11 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:09.120256 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73114778-931a-4edc-b665-c0f7cd9bdbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:09.120927 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73114778-931a-4edc-b665-c0f7cd9bdbff admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:09.121359 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73114778-931a-4edc-b665-c0f7cd9bdbff admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:09.121691 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73114778-931a-4edc-b665-c0f7cd9bdbff admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:09.122693 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73114778-931a-4edc-b665-c0f7cd9bdbff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:09.124341 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73114778-931a-4edc-b665-c0f7cd9bdbff admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:09.135407 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1322/2645] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:19:08 2021] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:19:09.139596 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a6193-999c-48aa-b9ad-5be20a549ec3 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:09.150168 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a6193-999c-48aa-b9ad-5be20a549ec3 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:09.154821 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52763092-5379-4bbb-8c7b-250a87b273b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:09.155765 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52763092-5379-4bbb-8c7b-250a87b273b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:09.156047 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52763092-5379-4bbb-8c7b-250a87b273b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:09.156318 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52763092-5379-4bbb-8c7b-250a87b273b1 admin admin] PATH_INFO: `/v3/projects/047fbd6dca384c59833cb7e4d2103311/users/b06fe49e28ed4a36b04cdadfe5e1fceb/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:09.158279 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52763092-5379-4bbb-8c7b-250a87b273b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=047fbd6dca384c59833cb7e4d2103311, user_id=b06fe49e28ed4a36b04cdadfe5e1fceb, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:09.160913 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52763092-5379-4bbb-8c7b-250a87b273b1 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:09.179830 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1324/2646] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:19:09 2021] PUT /identity/v3/projects/047fbd6dca384c59833cb7e4d2103311/users/b06fe49e28ed4a36b04cdadfe5e1fceb/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:09.194999 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327589ce-af7c-4ae6-80ba-2f86005e99f6 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:09.194999 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327589ce-af7c-4ae6-80ba-2f86005e99f6 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:09.194999 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327589ce-af7c-4ae6-80ba-2f86005e99f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:09.216243 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-327589ce-af7c-4ae6-80ba-2f86005e99f6 None None] MFA Rules not processed for user `b06fe49e28ed4a36b04cdadfe5e1fceb`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:09.217522 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-327589ce-af7c-4ae6-80ba-2f86005e99f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:09.294536 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1323/2647] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:09 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:19:09.305302 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52763092-5379-4bbb-8c7b-250a87b273b1 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:09.307586 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-52763092-5379-4bbb-8c7b-250a87b273b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:09.359015 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327589ce-af7c-4ae6-80ba-2f86005e99f6 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:09.360917 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-327589ce-af7c-4ae6-80ba-2f86005e99f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:09.369644 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52763092-5379-4bbb-8c7b-250a87b273b1 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:09.373397 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2de6fb-1050-4038-ba07-8f837cf7a320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:09.374360 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2de6fb-1050-4038-ba07-8f837cf7a320 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:09.374360 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2de6fb-1050-4038-ba07-8f837cf7a320 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:09.374604 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2de6fb-1050-4038-ba07-8f837cf7a320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:09.386612 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2de6fb-1050-4038-ba07-8f837cf7a320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:09.387355 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2de6fb-1050-4038-ba07-8f837cf7a320 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:09.413579 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1325/2648] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:09 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:19:09.462929 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327589ce-af7c-4ae6-80ba-2f86005e99f6 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:09.469295 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2bae5-0ade-4049-b0fa-b91d2be20899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:09.476078 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2bae5-0ade-4049-b0fa-b91d2be20899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:09.476078 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2bae5-0ade-4049-b0fa-b91d2be20899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:09.476078 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2bae5-0ade-4049-b0fa-b91d2be20899 admin admin] PATH_INFO: `/v3/projects/af44f57bb0184827a99097c26e8a50c8` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:09.476078 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2bae5-0ade-4049-b0fa-b91d2be20899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af44f57bb0184827a99097c26e8a50c8)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:09.476078 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2bae5-0ade-4049-b0fa-b91d2be20899 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:09.510687 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2de6fb-1050-4038-ba07-8f837cf7a320 service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:09.519524 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2de6fb-1050-4038-ba07-8f837cf7a320 service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:09.524419 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de29c8-4999-4017-a622-7f62c04d7333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:09.525064 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de29c8-4999-4017-a622-7f62c04d7333 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:09.527664 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de29c8-4999-4017-a622-7f62c04d7333 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:09.527664 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de29c8-4999-4017-a622-7f62c04d7333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:09.527664 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-03de29c8-4999-4017-a622-7f62c04d7333 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:09.590970 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de29c8-4999-4017-a622-7f62c04d7333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:09.592415 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de29c8-4999-4017-a622-7f62c04d7333 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:09.601809 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1326/2649] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:09 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:19:09.665194 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-37c2bae5-0ade-4049-b0fa-b91d2be20899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af44f57bb0184827a99097c26e8a50c8', 'request_id': 'req-37c2bae5-0ade-4049-b0fa-b91d2be20899'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:09.672332 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-37c2bae5-0ade-4049-b0fa-b91d2be20899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af44f57bb0184827a99097c26e8a50c8', 'request_id': 'req-37c2bae5-0ade-4049-b0fa-b91d2be20899'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:09.678780 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-37c2bae5-0ade-4049-b0fa-b91d2be20899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af44f57bb0184827a99097c26e8a50c8', 'request_id': 'req-37c2bae5-0ade-4049-b0fa-b91d2be20899'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:09.805981 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-37c2bae5-0ade-4049-b0fa-b91d2be20899 admin admin] The token cache is being invalidate because project af44f57bb0184827a99097c26e8a50c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:19:09.806272 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-37c2bae5-0ade-4049-b0fa-b91d2be20899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:09.806914 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-37c2bae5-0ade-4049-b0fa-b91d2be20899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:09.808472 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1324/2650] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:19:09 2021] DELETE /identity/v3/projects/af44f57bb0184827a99097c26e8a50c8 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:19:09.814534 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95cdcd-ee44-4a73-ab1c-deaa613db32c None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:09.814832 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95cdcd-ee44-4a73-ab1c-deaa613db32c None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:09.815139 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95cdcd-ee44-4a73-ab1c-deaa613db32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:09.835650 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-cb95cdcd-ee44-4a73-ab1c-deaa613db32c None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:09.837002 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-cb95cdcd-ee44-4a73-ab1c-deaa613db32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:09.897163 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1327/2651] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:09.904737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad66a0-b636-4e31-9815-b7dbb2083747 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:09.905034 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad66a0-b636-4e31-9815-b7dbb2083747 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:09.905318 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad66a0-b636-4e31-9815-b7dbb2083747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:09.925305 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-68ad66a0-b636-4e31-9815-b7dbb2083747 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:09.926698 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-68ad66a0-b636-4e31-9815-b7dbb2083747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:09.937456 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1325/2652] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:09.941319 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95cdcd-ee44-4a73-ab1c-deaa613db32c None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:09.951522 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95cdcd-ee44-4a73-ab1c-deaa613db32c None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:09.956186 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92468d-0901-4169-91ae-e6e7ade4d728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:09.957110 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92468d-0901-4169-91ae-e6e7ade4d728 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:09.957411 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92468d-0901-4169-91ae-e6e7ade4d728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:09.957732 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92468d-0901-4169-91ae-e6e7ade4d728 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:09.959430 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92468d-0901-4169-91ae-e6e7ade4d728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:19:09.959743 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92468d-0901-4169-91ae-e6e7ade4d728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:09.961554 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92468d-0901-4169-91ae-e6e7ade4d728 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:09.977610 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1328/2653] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:19:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 04:19:09.978901 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad66a0-b636-4e31-9815-b7dbb2083747 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:09.988303 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad66a0-b636-4e31-9815-b7dbb2083747 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:09.993223 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fcfa8-45c2-45ae-8581-26e4270eaab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:09.993874 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fcfa8-45c2-45ae-8581-26e4270eaab3 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:09.994155 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fcfa8-45c2-45ae-8581-26e4270eaab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:09.994433 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fcfa8-45c2-45ae-8581-26e4270eaab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:09.995172 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fcfa8-45c2-45ae-8581-26e4270eaab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:09.997119 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fcfa8-45c2-45ae-8581-26e4270eaab3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:10.118944 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1326/2654] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:19:09 2021] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:19:10.120388 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92468d-0901-4169-91ae-e6e7ade4d728 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:10.130406 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92468d-0901-4169-91ae-e6e7ade4d728 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:10.185609 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f759af-c601-4a2b-8e5b-99ca6f12316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:10.186201 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f759af-c601-4a2b-8e5b-99ca6f12316c admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:10.186483 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f759af-c601-4a2b-8e5b-99ca6f12316c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:10.186758 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f759af-c601-4a2b-8e5b-99ca6f12316c admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:10.187494 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f759af-c601-4a2b-8e5b-99ca6f12316c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:10.189375 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f759af-c601-4a2b-8e5b-99ca6f12316c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:10.351650 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1329/2655] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:19:10 2021] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:19:10.357700 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fcfa8-45c2-45ae-8581-26e4270eaab3 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:10.375290 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fcfa8-45c2-45ae-8581-26e4270eaab3 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:10.382438 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc7367-2bf7-4fae-ae81-71c69c014ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:10.383545 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc7367-2bf7-4fae-ae81-71c69c014ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:10.384050 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc7367-2bf7-4fae-ae81-71c69c014ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:10.384553 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc7367-2bf7-4fae-ae81-71c69c014ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:10.386533 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc7367-2bf7-4fae-ae81-71c69c014ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:10.389967 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc7367-2bf7-4fae-ae81-71c69c014ab9 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:10.405569 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1327/2656] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:19:10 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:19:10.409588 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f759af-c601-4a2b-8e5b-99ca6f12316c admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:10.425020 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f759af-c601-4a2b-8e5b-99ca6f12316c admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:10.433799 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe09e0-5aef-439c-808a-0a31dfc8319e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:10.434807 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe09e0-5aef-439c-808a-0a31dfc8319e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:10.435300 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe09e0-5aef-439c-808a-0a31dfc8319e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:10.441136 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe09e0-5aef-439c-808a-0a31dfc8319e admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:10.442473 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe09e0-5aef-439c-808a-0a31dfc8319e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:10.445176 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe09e0-5aef-439c-808a-0a31dfc8319e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:10.463399 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1330/2657] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:19:10 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:19:10.463535 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc7367-2bf7-4fae-ae81-71c69c014ab9 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:10.473142 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc7367-2bf7-4fae-ae81-71c69c014ab9 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:10.478110 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fe5dd-2be8-4a7c-b77e-bcf6fb00c3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:10.479071 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fe5dd-2be8-4a7c-b77e-bcf6fb00c3fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:10.479449 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fe5dd-2be8-4a7c-b77e-bcf6fb00c3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:10.479728 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fe5dd-2be8-4a7c-b77e-bcf6fb00c3fd admin admin] PATH_INFO: `/v3/projects/940930d55f194047afc6ddd00459aff9/users/0b76b3fa480d45a0a39568b9719daf75/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:10.495988 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40fe5dd-2be8-4a7c-b77e-bcf6fb00c3fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=940930d55f194047afc6ddd00459aff9, user_id=0b76b3fa480d45a0a39568b9719daf75, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:10.498614 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40fe5dd-2be8-4a7c-b77e-bcf6fb00c3fd admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:10.594474 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1328/2658] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:19:10 2021] PUT /identity/v3/projects/940930d55f194047afc6ddd00459aff9/users/0b76b3fa480d45a0a39568b9719daf75/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:10.606611 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d418e9-6bec-4ddd-abe3-64b9161dfff1 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:10.606902 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d418e9-6bec-4ddd-abe3-64b9161dfff1 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:10.607181 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d418e9-6bec-4ddd-abe3-64b9161dfff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:10.640122 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-f0d418e9-6bec-4ddd-abe3-64b9161dfff1 None None] MFA Rules not processed for user `0b76b3fa480d45a0a39568b9719daf75`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:10.641385 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-f0d418e9-6bec-4ddd-abe3-64b9161dfff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:10.715955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1331/2659] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:10 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:19:10.720310 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fe5dd-2be8-4a7c-b77e-bcf6fb00c3fd admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:10.783870 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fe5dd-2be8-4a7c-b77e-bcf6fb00c3fd admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:10.789521 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0402c95-f736-4a55-9a84-737ee1f131da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:10.790172 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0402c95-f736-4a55-9a84-737ee1f131da admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:10.790449 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0402c95-f736-4a55-9a84-737ee1f131da admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:10.790721 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0402c95-f736-4a55-9a84-737ee1f131da admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:10.791466 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0402c95-f736-4a55-9a84-737ee1f131da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:10.793360 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0402c95-f736-4a55-9a84-737ee1f131da admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:10.873710 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1329/2660] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:19:10 2021] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:19:10.877520 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d418e9-6bec-4ddd-abe3-64b9161dfff1 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:10.888170 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d418e9-6bec-4ddd-abe3-64b9161dfff1 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:10.942236 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3df52a-9d32-422b-a2d2-079c8d37aa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:10.943450 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3df52a-9d32-422b-a2d2-079c8d37aa12 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:10.943723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3df52a-9d32-422b-a2d2-079c8d37aa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:10.943998 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3df52a-9d32-422b-a2d2-079c8d37aa12 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:10.944700 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3df52a-9d32-422b-a2d2-079c8d37aa12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:10.946576 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3df52a-9d32-422b-a2d2-079c8d37aa12 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:11.051621 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1332/2661] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:19:10 2021] POST /identity/v3/users => generated 299 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:19:11.055737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0402c95-f736-4a55-9a84-737ee1f131da admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:11.067108 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0402c95-f736-4a55-9a84-737ee1f131da admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:11.073044 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425d9db-16d3-409e-bb5a-78e893d4f282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:11.073777 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425d9db-16d3-409e-bb5a-78e893d4f282 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:11.074068 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425d9db-16d3-409e-bb5a-78e893d4f282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:11.074351 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425d9db-16d3-409e-bb5a-78e893d4f282 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:11.075109 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425d9db-16d3-409e-bb5a-78e893d4f282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:11.076839 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425d9db-16d3-409e-bb5a-78e893d4f282 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:11.089760 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1330/2662] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:19:11 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:19:11.094119 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3df52a-9d32-422b-a2d2-079c8d37aa12 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:11.107013 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3df52a-9d32-422b-a2d2-079c8d37aa12 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:11.116453 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c6841-8953-410d-8bb8-2c73dc2d726d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:11.117382 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c6841-8953-410d-8bb8-2c73dc2d726d admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:11.117667 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c6841-8953-410d-8bb8-2c73dc2d726d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:11.117938 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c6841-8953-410d-8bb8-2c73dc2d726d admin admin] PATH_INFO: `/v3/projects/c152e2f9770843b1bad13de72a73572c/users/e401955ea16a486e895bfa656e948af6/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:11.135182 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c6841-8953-410d-8bb8-2c73dc2d726d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c152e2f9770843b1bad13de72a73572c, user_id=e401955ea16a486e895bfa656e948af6, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:11.138075 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c6841-8953-410d-8bb8-2c73dc2d726d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:11.251744 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1333/2663] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:19:11 2021] PUT /identity/v3/projects/c152e2f9770843b1bad13de72a73572c/users/e401955ea16a486e895bfa656e948af6/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:19:11.255736 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425d9db-16d3-409e-bb5a-78e893d4f282 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:11.266353 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425d9db-16d3-409e-bb5a-78e893d4f282 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:11.351571 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09bd84-b824-487c-8a5d-2fa5520ec3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:11.352264 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09bd84-b824-487c-8a5d-2fa5520ec3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:11.352550 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09bd84-b824-487c-8a5d-2fa5520ec3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:11.352825 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09bd84-b824-487c-8a5d-2fa5520ec3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:11.353611 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09bd84-b824-487c-8a5d-2fa5520ec3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:11.355241 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09bd84-b824-487c-8a5d-2fa5520ec3f0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:11.370614 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1331/2664] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:19:11 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:19:11.374414 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c6841-8953-410d-8bb8-2c73dc2d726d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:11.395284 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c6841-8953-410d-8bb8-2c73dc2d726d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:11.401105 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868b7ea-a564-4f44-84bd-fa18f3bfd234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:11.402241 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868b7ea-a564-4f44-84bd-fa18f3bfd234 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:11.402718 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868b7ea-a564-4f44-84bd-fa18f3bfd234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:11.403201 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868b7ea-a564-4f44-84bd-fa18f3bfd234 admin admin] PATH_INFO: `/v3/projects/c152e2f9770843b1bad13de72a73572c/users/e401955ea16a486e895bfa656e948af6/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:11.405923 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868b7ea-a564-4f44-84bd-fa18f3bfd234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c152e2f9770843b1bad13de72a73572c, user_id=e401955ea16a486e895bfa656e948af6, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:11.409065 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868b7ea-a564-4f44-84bd-fa18f3bfd234 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:11.422391 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1334/2665] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:19:11 2021] PUT /identity/v3/projects/c152e2f9770843b1bad13de72a73572c/users/e401955ea16a486e895bfa656e948af6/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:11.434153 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb7a9b-7c3e-47f7-99ca-d3ac738ade57 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:11.434502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb7a9b-7c3e-47f7-99ca-d3ac738ade57 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:11.434717 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb7a9b-7c3e-47f7-99ca-d3ac738ade57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:11.483144 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-3ceb7a9b-7c3e-47f7-99ca-d3ac738ade57 None None] MFA Rules not processed for user `e401955ea16a486e895bfa656e948af6`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:11.486327 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-3ceb7a9b-7c3e-47f7-99ca-d3ac738ade57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:11.579231 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1332/2666] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:11 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:11.589501 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868b7ea-a564-4f44-84bd-fa18f3bfd234 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:11.591360 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-4868b7ea-a564-4f44-84bd-fa18f3bfd234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:11.657368 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868b7ea-a564-4f44-84bd-fa18f3bfd234 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:11.661296 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40078d-80bf-478c-9d58-0120956636c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:11.663174 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40078d-80bf-478c-9d58-0120956636c8 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:11.663719 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40078d-80bf-478c-9d58-0120956636c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:11.664075 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40078d-80bf-478c-9d58-0120956636c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:11.728898 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40078d-80bf-478c-9d58-0120956636c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:11.730618 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40078d-80bf-478c-9d58-0120956636c8 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:11.740968 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1335/2667] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:11 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:19:12.830515 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb7a9b-7c3e-47f7-99ca-d3ac738ade57 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:12.831915 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-3ceb7a9b-7c3e-47f7-99ca-d3ac738ade57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:12.895241 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb7a9b-7c3e-47f7-99ca-d3ac738ade57 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:12.900024 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60608bec-7528-417f-87ed-0ad8acf113de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:12.900882 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60608bec-7528-417f-87ed-0ad8acf113de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:12.901162 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60608bec-7528-417f-87ed-0ad8acf113de admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:12.901437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60608bec-7528-417f-87ed-0ad8acf113de admin admin] PATH_INFO: `/v3/users/1be13de272154962bf19a9f289e4d37b` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:12.902637 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60608bec-7528-417f-87ed-0ad8acf113de admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be13de272154962bf19a9f289e4d37b)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:12.904730 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60608bec-7528-417f-87ed-0ad8acf113de admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:13.201167 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-60608bec-7528-417f-87ed-0ad8acf113de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be13de272154962bf19a9f289e4d37b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:13.290936 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-60608bec-7528-417f-87ed-0ad8acf113de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be13de272154962bf19a9f289e4d37b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:13.298442 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-60608bec-7528-417f-87ed-0ad8acf113de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be13de272154962bf19a9f289e4d37b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:13.299077 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-60608bec-7528-417f-87ed-0ad8acf113de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be13de272154962bf19a9f289e4d37b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:13.311256 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-60608bec-7528-417f-87ed-0ad8acf113de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be13de272154962bf19a9f289e4d37b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:13.316993 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1333/2668] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:19:12 2021] DELETE /identity/v3/users/1be13de272154962bf19a9f289e4d37b => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:13.321630 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c65b1-82e7-4a68-9d3e-360c815e668e None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:13.322090 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c65b1-82e7-4a68-9d3e-360c815e668e None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:13.322182 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c65b1-82e7-4a68-9d3e-360c815e668e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:13.339962 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-798c65b1-82e7-4a68-9d3e-360c815e668e None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:13.341166 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-798c65b1-82e7-4a68-9d3e-360c815e668e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:13.399398 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1336/2669] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:13.409109 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60608bec-7528-417f-87ed-0ad8acf113de admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:13.410477 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-60608bec-7528-417f-87ed-0ad8acf113de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:13.466720 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60608bec-7528-417f-87ed-0ad8acf113de admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:13.470320 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ea920-d182-4be8-a398-d07a122b1a8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:13.470950 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ea920-d182-4be8-a398-d07a122b1a8d service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:13.471253 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ea920-d182-4be8-a398-d07a122b1a8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:13.471527 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ea920-d182-4be8-a398-d07a122b1a8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:13.481050 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ea920-d182-4be8-a398-d07a122b1a8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:13.482458 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ea920-d182-4be8-a398-d07a122b1a8d service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:13.492141 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1334/2670] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:19:13.909644 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c65b1-82e7-4a68-9d3e-360c815e668e None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:13.911070 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-798c65b1-82e7-4a68-9d3e-360c815e668e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:13.926478 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c65b1-82e7-4a68-9d3e-360c815e668e None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:13.932843 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eecf84-f0c9-4b99-9eea-a0bdc74667e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:13.939159 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eecf84-f0c9-4b99-9eea-a0bdc74667e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:13.939159 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eecf84-f0c9-4b99-9eea-a0bdc74667e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:13.939159 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eecf84-f0c9-4b99-9eea-a0bdc74667e6 admin admin] PATH_INFO: `/v3/projects/cf0e488d4ada407b8178166769b1c423` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:13.939159 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eecf84-f0c9-4b99-9eea-a0bdc74667e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf0e488d4ada407b8178166769b1c423)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:13.939159 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eecf84-f0c9-4b99-9eea-a0bdc74667e6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:14.054149 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-b9eecf84-f0c9-4b99-9eea-a0bdc74667e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf0e488d4ada407b8178166769b1c423', 'request_id': 'req-b9eecf84-f0c9-4b99-9eea-a0bdc74667e6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:14.060125 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-b9eecf84-f0c9-4b99-9eea-a0bdc74667e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf0e488d4ada407b8178166769b1c423', 'request_id': 'req-b9eecf84-f0c9-4b99-9eea-a0bdc74667e6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:14.065302 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-b9eecf84-f0c9-4b99-9eea-a0bdc74667e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf0e488d4ada407b8178166769b1c423', 'request_id': 'req-b9eecf84-f0c9-4b99-9eea-a0bdc74667e6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:14.168259 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-b9eecf84-f0c9-4b99-9eea-a0bdc74667e6 admin admin] The token cache is being invalidate because project cf0e488d4ada407b8178166769b1c423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:19:14.168259 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-b9eecf84-f0c9-4b99-9eea-a0bdc74667e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:14.168259 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-b9eecf84-f0c9-4b99-9eea-a0bdc74667e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:14.168259 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1337/2671] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:19:13 2021] DELETE /identity/v3/projects/cf0e488d4ada407b8178166769b1c423 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:14.171439 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ea920-d182-4be8-a398-d07a122b1a8d service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:14.180954 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ea920-d182-4be8-a398-d07a122b1a8d service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:14.237168 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cc03c-c89e-463b-ae42-d89cbaa225ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:14.238023 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cc03c-c89e-463b-ae42-d89cbaa225ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:14.238302 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cc03c-c89e-463b-ae42-d89cbaa225ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:14.238579 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cc03c-c89e-463b-ae42-d89cbaa225ac admin admin] PATH_INFO: `/v3/users/b06fe49e28ed4a36b04cdadfe5e1fceb` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:14.240227 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144cc03c-c89e-463b-ae42-d89cbaa225ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=b06fe49e28ed4a36b04cdadfe5e1fceb)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:14.242153 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144cc03c-c89e-463b-ae42-d89cbaa225ac admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:14.479444 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-144cc03c-c89e-463b-ae42-d89cbaa225ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b06fe49e28ed4a36b04cdadfe5e1fceb'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:14.582319 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-144cc03c-c89e-463b-ae42-d89cbaa225ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b06fe49e28ed4a36b04cdadfe5e1fceb'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:14.589543 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-144cc03c-c89e-463b-ae42-d89cbaa225ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b06fe49e28ed4a36b04cdadfe5e1fceb'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:14.590183 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-144cc03c-c89e-463b-ae42-d89cbaa225ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b06fe49e28ed4a36b04cdadfe5e1fceb'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:14.601876 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-144cc03c-c89e-463b-ae42-d89cbaa225ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b06fe49e28ed4a36b04cdadfe5e1fceb'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:14.607600 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1335/2672] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:19:14 2021] DELETE /identity/v3/users/b06fe49e28ed4a36b04cdadfe5e1fceb => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:15.018168 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eecf84-f0c9-4b99-9eea-a0bdc74667e6 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:15.022155 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-b9eecf84-f0c9-4b99-9eea-a0bdc74667e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:15.036121 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eecf84-f0c9-4b99-9eea-a0bdc74667e6 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:15.093004 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219781b-7063-48d7-aee6-e78dd8c50cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:15.093848 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219781b-7063-48d7-aee6-e78dd8c50cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:15.094129 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219781b-7063-48d7-aee6-e78dd8c50cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:15.094402 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219781b-7063-48d7-aee6-e78dd8c50cfb admin admin] PATH_INFO: `/v3/projects/047fbd6dca384c59833cb7e4d2103311` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:15.095618 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219781b-7063-48d7-aee6-e78dd8c50cfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=047fbd6dca384c59833cb7e4d2103311)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:15.097486 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219781b-7063-48d7-aee6-e78dd8c50cfb admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:15.197512 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a219781b-7063-48d7-aee6-e78dd8c50cfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '047fbd6dca384c59833cb7e4d2103311', 'request_id': 'req-a219781b-7063-48d7-aee6-e78dd8c50cfb'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:15.203591 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a219781b-7063-48d7-aee6-e78dd8c50cfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '047fbd6dca384c59833cb7e4d2103311', 'request_id': 'req-a219781b-7063-48d7-aee6-e78dd8c50cfb'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:15.208958 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a219781b-7063-48d7-aee6-e78dd8c50cfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '047fbd6dca384c59833cb7e4d2103311', 'request_id': 'req-a219781b-7063-48d7-aee6-e78dd8c50cfb'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:15.305965 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a219781b-7063-48d7-aee6-e78dd8c50cfb admin admin] The token cache is being invalidate because project 047fbd6dca384c59833cb7e4d2103311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:19:15.306166 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a219781b-7063-48d7-aee6-e78dd8c50cfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:15.306794 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a219781b-7063-48d7-aee6-e78dd8c50cfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:15.308371 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1338/2673] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:19:15 2021] DELETE /identity/v3/projects/047fbd6dca384c59833cb7e4d2103311 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:15.314032 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38a6d4-1f99-4a23-a45a-fb001c153986 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:15.314500 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38a6d4-1f99-4a23-a45a-fb001c153986 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:15.314592 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38a6d4-1f99-4a23-a45a-fb001c153986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:15.333028 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-5a38a6d4-1f99-4a23-a45a-fb001c153986 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:15.334400 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-5a38a6d4-1f99-4a23-a45a-fb001c153986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:15.393461 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1336/2674] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:15.402229 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb25d8-52eb-422c-a43c-1fedcd59fa47 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:15.402523 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb25d8-52eb-422c-a43c-1fedcd59fa47 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:15.403244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb25d8-52eb-422c-a43c-1fedcd59fa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:15.425500 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-4bfb25d8-52eb-422c-a43c-1fedcd59fa47 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:15.426841 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-4bfb25d8-52eb-422c-a43c-1fedcd59fa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:15.437283 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1339/2675] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:15.441706 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38a6d4-1f99-4a23-a45a-fb001c153986 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:15.454777 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38a6d4-1f99-4a23-a45a-fb001c153986 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:15.461099 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27603010-c9b2-4b24-9990-dd35d824ea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:15.462286 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27603010-c9b2-4b24-9990-dd35d824ea3d admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:15.462582 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27603010-c9b2-4b24-9990-dd35d824ea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:15.462927 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27603010-c9b2-4b24-9990-dd35d824ea3d admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:15.463915 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27603010-c9b2-4b24-9990-dd35d824ea3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:19:15.464234 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27603010-c9b2-4b24-9990-dd35d824ea3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:15.465871 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27603010-c9b2-4b24-9990-dd35d824ea3d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:15.481900 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1337/2676] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:19:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:19:15.486820 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb25d8-52eb-422c-a43c-1fedcd59fa47 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:15.500972 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb25d8-52eb-422c-a43c-1fedcd59fa47 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:15.501404 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3c0b3-1887-4608-81b1-775751acf782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:15.502086 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3c0b3-1887-4608-81b1-775751acf782 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:15.502380 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3c0b3-1887-4608-81b1-775751acf782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:15.502659 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3c0b3-1887-4608-81b1-775751acf782 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:15.503453 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3c0b3-1887-4608-81b1-775751acf782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:15.506137 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3c0b3-1887-4608-81b1-775751acf782 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:15.627252 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1340/2677] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:19:15 2021] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:19:15.628500 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27603010-c9b2-4b24-9990-dd35d824ea3d admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:15.639133 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27603010-c9b2-4b24-9990-dd35d824ea3d admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:15.702708 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700cf8d-6a1c-449a-9b82-e173a0f024f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:15.703526 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700cf8d-6a1c-449a-9b82-e173a0f024f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:15.703808 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700cf8d-6a1c-449a-9b82-e173a0f024f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:15.704084 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700cf8d-6a1c-449a-9b82-e173a0f024f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:15.704802 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700cf8d-6a1c-449a-9b82-e173a0f024f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:15.706760 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700cf8d-6a1c-449a-9b82-e173a0f024f1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:15.818794 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1338/2678] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:19:15 2021] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:19:15.819915 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3c0b3-1887-4608-81b1-775751acf782 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:15.830296 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3c0b3-1887-4608-81b1-775751acf782 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:15.835049 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0cdb9-ac34-4a9c-ae27-b02025ca61ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:15.835739 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0cdb9-ac34-4a9c-ae27-b02025ca61ac admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:15.836060 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0cdb9-ac34-4a9c-ae27-b02025ca61ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:15.836338 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0cdb9-ac34-4a9c-ae27-b02025ca61ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:15.837073 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0cdb9-ac34-4a9c-ae27-b02025ca61ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:15.838642 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0cdb9-ac34-4a9c-ae27-b02025ca61ac admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:15.849046 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1341/2679] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:19:15 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:19:15.859544 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700cf8d-6a1c-449a-9b82-e173a0f024f1 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:15.869942 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700cf8d-6a1c-449a-9b82-e173a0f024f1 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:15.874497 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1dfe3-0f8b-482c-bfb0-5efbc17fc17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:15.875131 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1dfe3-0f8b-482c-bfb0-5efbc17fc17b admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:15.875439 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1dfe3-0f8b-482c-bfb0-5efbc17fc17b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:15.875710 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1dfe3-0f8b-482c-bfb0-5efbc17fc17b admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:15.876514 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1dfe3-0f8b-482c-bfb0-5efbc17fc17b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:15.878085 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1dfe3-0f8b-482c-bfb0-5efbc17fc17b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:15.891095 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1339/2680] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:19:15 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:19:15.895405 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0cdb9-ac34-4a9c-ae27-b02025ca61ac admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:15.908073 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0cdb9-ac34-4a9c-ae27-b02025ca61ac admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:15.914453 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3077d9a-3497-4b7c-905c-94a2bf8abd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:15.915376 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3077d9a-3497-4b7c-905c-94a2bf8abd89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:15.915654 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3077d9a-3497-4b7c-905c-94a2bf8abd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:15.915923 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3077d9a-3497-4b7c-905c-94a2bf8abd89 admin admin] PATH_INFO: `/v3/projects/da55f7d66c354b84833b28698076f19c/users/6377eb4b7a39419e814525c9a3bb41f6/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:15.931413 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3077d9a-3497-4b7c-905c-94a2bf8abd89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da55f7d66c354b84833b28698076f19c, user_id=6377eb4b7a39419e814525c9a3bb41f6, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:15.937294 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3077d9a-3497-4b7c-905c-94a2bf8abd89 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:16.032513 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1342/2681] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:19:15 2021] PUT /identity/v3/projects/da55f7d66c354b84833b28698076f19c/users/6377eb4b7a39419e814525c9a3bb41f6/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:16.045603 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f175e-7a33-4199-84bf-8c7dd8b24502 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:16.045894 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f175e-7a33-4199-84bf-8c7dd8b24502 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:16.046166 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f175e-7a33-4199-84bf-8c7dd8b24502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:16.074284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-be1f175e-7a33-4199-84bf-8c7dd8b24502 None None] MFA Rules not processed for user `6377eb4b7a39419e814525c9a3bb41f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:16.075427 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-be1f175e-7a33-4199-84bf-8c7dd8b24502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:16.140359 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1340/2682] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:16 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:16.151706 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3077d9a-3497-4b7c-905c-94a2bf8abd89 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:16.153503 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-d3077d9a-3497-4b7c-905c-94a2bf8abd89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:16.222667 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3077d9a-3497-4b7c-905c-94a2bf8abd89 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:16.227125 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3e9d4-c51f-479a-872f-be28ffbdfa7c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f52add52aa4586aee0b801ceffd764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:16.227797 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3e9d4-c51f-479a-872f-be28ffbdfa7c service glance] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:16.228086 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3e9d4-c51f-479a-872f-be28ffbdfa7c service glance] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:16.228363 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3e9d4-c51f-479a-872f-be28ffbdfa7c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:16.236922 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3e9d4-c51f-479a-872f-be28ffbdfa7c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:16.238719 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3e9d4-c51f-479a-872f-be28ffbdfa7c service glance] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:16.249549 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1343/2683] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:16 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:19:16.620383 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f175e-7a33-4199-84bf-8c7dd8b24502 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:16.621830 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-be1f175e-7a33-4199-84bf-8c7dd8b24502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:16.680968 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f175e-7a33-4199-84bf-8c7dd8b24502 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:16.684542 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf3bf1-9b4f-4a56-8f94-c57b4b0aae3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:16.685191 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf3bf1-9b4f-4a56-8f94-c57b4b0aae3f service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:16.685459 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf3bf1-9b4f-4a56-8f94-c57b4b0aae3f service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:16.685730 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf3bf1-9b4f-4a56-8f94-c57b4b0aae3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:16.687612 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-ecaf3bf1-9b4f-4a56-8f94-c57b4b0aae3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:16.756694 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf3bf1-9b4f-4a56-8f94-c57b4b0aae3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:16.758122 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf3bf1-9b4f-4a56-8f94-c57b4b0aae3f service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:16.768914 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1341/2684] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:16 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:19:17.178104 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3e9d4-c51f-479a-872f-be28ffbdfa7c service glance] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:17.178104 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-baa3e9d4-c51f-479a-872f-be28ffbdfa7c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:17.236809 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3e9d4-c51f-479a-872f-be28ffbdfa7c service glance] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:17.241042 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2313e0-a514-47da-9cea-f749b8566a00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:17.241683 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2313e0-a514-47da-9cea-f749b8566a00 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:17.241971 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2313e0-a514-47da-9cea-f749b8566a00 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:17.242249 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2313e0-a514-47da-9cea-f749b8566a00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:17.244057 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-1b2313e0-a514-47da-9cea-f749b8566a00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:17.306313 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2313e0-a514-47da-9cea-f749b8566a00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:17.307801 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2313e0-a514-47da-9cea-f749b8566a00 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:17.317145 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1344/2685] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:17 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:19:19.143229 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf3bf1-9b4f-4a56-8f94-c57b4b0aae3f service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:19.152715 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf3bf1-9b4f-4a56-8f94-c57b4b0aae3f service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:19.156471 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db7b11-a58a-45e8-8c04-246b6ee4cbe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:19.162837 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db7b11-a58a-45e8-8c04-246b6ee4cbe9 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:19.162837 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db7b11-a58a-45e8-8c04-246b6ee4cbe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:19.162837 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db7b11-a58a-45e8-8c04-246b6ee4cbe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:19.162837 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-a9db7b11-a58a-45e8-8c04-246b6ee4cbe9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:19.174288 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db7b11-a58a-45e8-8c04-246b6ee4cbe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:19.175789 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db7b11-a58a-45e8-8c04-246b6ee4cbe9 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:19.186970 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1342/2686] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:19 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:19:23.571473 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2313e0-a514-47da-9cea-f749b8566a00 service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:23.573008 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-1b2313e0-a514-47da-9cea-f749b8566a00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:23.640505 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2313e0-a514-47da-9cea-f749b8566a00 service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:23.645308 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42763535-243b-42c6-aa00-a6e0b93e38b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:23.646759 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42763535-243b-42c6-aa00-a6e0b93e38b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:23.647099 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42763535-243b-42c6-aa00-a6e0b93e38b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:23.647402 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42763535-243b-42c6-aa00-a6e0b93e38b6 admin admin] PATH_INFO: `/v3/users/0b76b3fa480d45a0a39568b9719daf75` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:23.648680 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42763535-243b-42c6-aa00-a6e0b93e38b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b76b3fa480d45a0a39568b9719daf75)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:23.650512 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42763535-243b-42c6-aa00-a6e0b93e38b6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:23.864334 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-42763535-243b-42c6-aa00-a6e0b93e38b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b76b3fa480d45a0a39568b9719daf75'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:23.997693 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-42763535-243b-42c6-aa00-a6e0b93e38b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b76b3fa480d45a0a39568b9719daf75'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:24.006357 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-42763535-243b-42c6-aa00-a6e0b93e38b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b76b3fa480d45a0a39568b9719daf75'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:24.012343 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-42763535-243b-42c6-aa00-a6e0b93e38b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b76b3fa480d45a0a39568b9719daf75'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:24.020164 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-42763535-243b-42c6-aa00-a6e0b93e38b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b76b3fa480d45a0a39568b9719daf75'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:24.027689 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1345/2687] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:19:23 2021] DELETE /identity/v3/users/0b76b3fa480d45a0a39568b9719daf75 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:24.032320 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922db5fa-ae37-4d9c-ad10-f9f288356a55 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:24.032952 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922db5fa-ae37-4d9c-ad10-f9f288356a55 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:24.032952 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922db5fa-ae37-4d9c-ad10-f9f288356a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:24.051191 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-922db5fa-ae37-4d9c-ad10-f9f288356a55 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:24.053106 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-922db5fa-ae37-4d9c-ad10-f9f288356a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:24.117482 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1343/2688] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:24.135079 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42763535-243b-42c6-aa00-a6e0b93e38b6 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:24.136546 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-42763535-243b-42c6-aa00-a6e0b93e38b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:24.195117 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42763535-243b-42c6-aa00-a6e0b93e38b6 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:24.199142 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cb7b9-0719-4cdd-8b28-ecc13b0c644f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:24.199846 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cb7b9-0719-4cdd-8b28-ecc13b0c644f service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:24.200131 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cb7b9-0719-4cdd-8b28-ecc13b0c644f service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:24.200409 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cb7b9-0719-4cdd-8b28-ecc13b0c644f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:24.210057 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1cb7b9-0719-4cdd-8b28-ecc13b0c644f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:24.211517 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1cb7b9-0719-4cdd-8b28-ecc13b0c644f service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:24.221215 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1346/2689] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:19:24.641085 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922db5fa-ae37-4d9c-ad10-f9f288356a55 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:24.642715 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-922db5fa-ae37-4d9c-ad10-f9f288356a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:24.655527 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922db5fa-ae37-4d9c-ad10-f9f288356a55 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:24.660083 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8da767-c869-4965-89f9-163cb1d28fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:24.660928 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8da767-c869-4965-89f9-163cb1d28fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:24.661387 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8da767-c869-4965-89f9-163cb1d28fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:24.661898 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8da767-c869-4965-89f9-163cb1d28fd8 admin admin] PATH_INFO: `/v3/projects/940930d55f194047afc6ddd00459aff9` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:24.663574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8da767-c869-4965-89f9-163cb1d28fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=940930d55f194047afc6ddd00459aff9)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:24.668243 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8da767-c869-4965-89f9-163cb1d28fd8 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:24.799633 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2e8da767-c869-4965-89f9-163cb1d28fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '940930d55f194047afc6ddd00459aff9', 'request_id': 'req-2e8da767-c869-4965-89f9-163cb1d28fd8'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:24.806627 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2e8da767-c869-4965-89f9-163cb1d28fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '940930d55f194047afc6ddd00459aff9', 'request_id': 'req-2e8da767-c869-4965-89f9-163cb1d28fd8'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:24.813232 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2e8da767-c869-4965-89f9-163cb1d28fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '940930d55f194047afc6ddd00459aff9', 'request_id': 'req-2e8da767-c869-4965-89f9-163cb1d28fd8'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:24.895860 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2e8da767-c869-4965-89f9-163cb1d28fd8 admin admin] The token cache is being invalidate because project 940930d55f194047afc6ddd00459aff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:19:24.896150 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2e8da767-c869-4965-89f9-163cb1d28fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:24.896747 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-2e8da767-c869-4965-89f9-163cb1d28fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:24.898308 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1344/2690] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:19:24 2021] DELETE /identity/v3/projects/940930d55f194047afc6ddd00459aff9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:24.902304 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cb7b9-0719-4cdd-8b28-ecc13b0c644f service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:24.912986 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cb7b9-0719-4cdd-8b28-ecc13b0c644f service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:24.969794 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862724e-749a-4887-bdd9-38d9253616dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:24.970661 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862724e-749a-4887-bdd9-38d9253616dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:24.970944 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862724e-749a-4887-bdd9-38d9253616dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:24.971253 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862724e-749a-4887-bdd9-38d9253616dd admin admin] PATH_INFO: `/v3/users/e401955ea16a486e895bfa656e948af6` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:24.972444 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862724e-749a-4887-bdd9-38d9253616dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e401955ea16a486e895bfa656e948af6)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:24.974395 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862724e-749a-4887-bdd9-38d9253616dd admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:25.166940 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f862724e-749a-4887-bdd9-38d9253616dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e401955ea16a486e895bfa656e948af6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:25.193084 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8da767-c869-4965-89f9-163cb1d28fd8 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:25.194659 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-2e8da767-c869-4965-89f9-163cb1d28fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:25.248890 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f862724e-749a-4887-bdd9-38d9253616dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e401955ea16a486e895bfa656e948af6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:25.256177 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f862724e-749a-4887-bdd9-38d9253616dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e401955ea16a486e895bfa656e948af6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:25.256873 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f862724e-749a-4887-bdd9-38d9253616dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e401955ea16a486e895bfa656e948af6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:25.265688 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8da767-c869-4965-89f9-163cb1d28fd8 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:25.268402 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f862724e-749a-4887-bdd9-38d9253616dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e401955ea16a486e895bfa656e948af6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:25.271168 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f82f4-ed67-4893-a862-298e242683e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:25.271841 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f82f4-ed67-4893-a862-298e242683e9 service nova] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:25.272121 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f82f4-ed67-4893-a862-298e242683e9 service nova] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:25.272424 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f82f4-ed67-4893-a862-298e242683e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:25.274161 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-f87f82f4-ed67-4893-a862-298e242683e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:25.274342 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1347/2691] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:19:24 2021] DELETE /identity/v3/users/e401955ea16a486e895bfa656e948af6 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:25.336970 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f82f4-ed67-4893-a862-298e242683e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:25.338788 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f82f4-ed67-4893-a862-298e242683e9 service nova] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:25.348981 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1345/2692] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:25 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:19:25.713875 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862724e-749a-4887-bdd9-38d9253616dd admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:25.715587 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-f862724e-749a-4887-bdd9-38d9253616dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:25.785403 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862724e-749a-4887-bdd9-38d9253616dd admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:25.792441 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0010b8-5090-4b3e-ab35-e8a7a503dcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:25.793119 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0010b8-5090-4b3e-ab35-e8a7a503dcb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:25.793405 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0010b8-5090-4b3e-ab35-e8a7a503dcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:25.793685 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0010b8-5090-4b3e-ab35-e8a7a503dcb9 admin admin] PATH_INFO: `/v3/projects/c152e2f9770843b1bad13de72a73572c` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:25.794936 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0010b8-5090-4b3e-ab35-e8a7a503dcb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c152e2f9770843b1bad13de72a73572c)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:25.796886 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0010b8-5090-4b3e-ab35-e8a7a503dcb9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:25.920431 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-cf0010b8-5090-4b3e-ab35-e8a7a503dcb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c152e2f9770843b1bad13de72a73572c', 'request_id': 'req-cf0010b8-5090-4b3e-ab35-e8a7a503dcb9'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:25.926434 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-cf0010b8-5090-4b3e-ab35-e8a7a503dcb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c152e2f9770843b1bad13de72a73572c', 'request_id': 'req-cf0010b8-5090-4b3e-ab35-e8a7a503dcb9'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:25.932136 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-cf0010b8-5090-4b3e-ab35-e8a7a503dcb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c152e2f9770843b1bad13de72a73572c', 'request_id': 'req-cf0010b8-5090-4b3e-ab35-e8a7a503dcb9'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:26.005997 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-cf0010b8-5090-4b3e-ab35-e8a7a503dcb9 admin admin] The token cache is being invalidate because project c152e2f9770843b1bad13de72a73572c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:19:26.008998 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-cf0010b8-5090-4b3e-ab35-e8a7a503dcb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:26.008998 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-cf0010b8-5090-4b3e-ab35-e8a7a503dcb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:26.008998 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1348/2693] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:19:25 2021] DELETE /identity/v3/projects/c152e2f9770843b1bad13de72a73572c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:26.015423 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda92583-cbdb-46c6-a729-8086f2fe94d8 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:26.015721 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda92583-cbdb-46c6-a729-8086f2fe94d8 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:26.016001 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda92583-cbdb-46c6-a729-8086f2fe94d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:26.034379 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-eda92583-cbdb-46c6-a729-8086f2fe94d8 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:26.035622 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-eda92583-cbdb-46c6-a729-8086f2fe94d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:26.095850 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1346/2694] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:26.105140 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f46714-40fb-4318-b321-29c56aebe9c8 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:26.105438 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f46714-40fb-4318-b321-29c56aebe9c8 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:26.105722 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f46714-40fb-4318-b321-29c56aebe9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:26.124169 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-67f46714-40fb-4318-b321-29c56aebe9c8 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:26.125362 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-67f46714-40fb-4318-b321-29c56aebe9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:26.133470 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1349/2695] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:26.137786 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda92583-cbdb-46c6-a729-8086f2fe94d8 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:26.148551 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda92583-cbdb-46c6-a729-8086f2fe94d8 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:26.153170 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac6cff-d106-4eeb-9d3b-36355ca37508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:26.153834 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac6cff-d106-4eeb-9d3b-36355ca37508 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:26.154120 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac6cff-d106-4eeb-9d3b-36355ca37508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:26.154396 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac6cff-d106-4eeb-9d3b-36355ca37508 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:26.155131 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac6cff-d106-4eeb-9d3b-36355ca37508 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:19:26.155469 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac6cff-d106-4eeb-9d3b-36355ca37508 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:26.157106 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac6cff-d106-4eeb-9d3b-36355ca37508 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:26.169850 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1347/2696] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:19:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:19:26.174338 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f46714-40fb-4318-b321-29c56aebe9c8 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:26.184228 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f46714-40fb-4318-b321-29c56aebe9c8 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:26.189262 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb6d67-4642-4882-80c3-66acdb816c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:26.189975 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb6d67-4642-4882-80c3-66acdb816c37 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:26.190318 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb6d67-4642-4882-80c3-66acdb816c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:26.190626 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb6d67-4642-4882-80c3-66acdb816c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:26.191425 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb6d67-4642-4882-80c3-66acdb816c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:26.193483 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb6d67-4642-4882-80c3-66acdb816c37 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:26.296659 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1350/2697] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:19:26 2021] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:19:26.300720 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac6cff-d106-4eeb-9d3b-36355ca37508 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:26.311759 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac6cff-d106-4eeb-9d3b-36355ca37508 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:26.375821 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60879f40-3f0b-4f5e-9a78-33f5c14bc778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:26.376538 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60879f40-3f0b-4f5e-9a78-33f5c14bc778 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:26.376835 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60879f40-3f0b-4f5e-9a78-33f5c14bc778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:26.377121 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60879f40-3f0b-4f5e-9a78-33f5c14bc778 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:26.377854 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60879f40-3f0b-4f5e-9a78-33f5c14bc778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:26.380167 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60879f40-3f0b-4f5e-9a78-33f5c14bc778 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:26.474915 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1348/2698] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:19:26 2021] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:19:26.479357 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb6d67-4642-4882-80c3-66acdb816c37 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:26.496265 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb6d67-4642-4882-80c3-66acdb816c37 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:26.502773 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8974f09-6e5b-4c00-89eb-7bedde7a3a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:26.503484 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8974f09-6e5b-4c00-89eb-7bedde7a3a24 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:26.503844 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8974f09-6e5b-4c00-89eb-7bedde7a3a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:26.504092 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8974f09-6e5b-4c00-89eb-7bedde7a3a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:26.505164 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8974f09-6e5b-4c00-89eb-7bedde7a3a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:26.507294 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8974f09-6e5b-4c00-89eb-7bedde7a3a24 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:26.519522 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1351/2699] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:19:26 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:19:26.523972 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60879f40-3f0b-4f5e-9a78-33f5c14bc778 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:26.534138 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60879f40-3f0b-4f5e-9a78-33f5c14bc778 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:26.540229 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33cba1-7b59-47a5-9d95-41f5417236c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:26.541116 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33cba1-7b59-47a5-9d95-41f5417236c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:26.541483 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33cba1-7b59-47a5-9d95-41f5417236c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:26.542895 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33cba1-7b59-47a5-9d95-41f5417236c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:26.542895 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33cba1-7b59-47a5-9d95-41f5417236c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:26.544145 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33cba1-7b59-47a5-9d95-41f5417236c0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:26.555797 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1349/2700] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:19:26 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:19:26.559672 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8974f09-6e5b-4c00-89eb-7bedde7a3a24 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:26.569691 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8974f09-6e5b-4c00-89eb-7bedde7a3a24 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:26.575127 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442d0d8-ded0-46b4-abad-a962c1d00268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:26.575890 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442d0d8-ded0-46b4-abad-a962c1d00268 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:26.576173 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442d0d8-ded0-46b4-abad-a962c1d00268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:26.576445 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442d0d8-ded0-46b4-abad-a962c1d00268 admin admin] PATH_INFO: `/v3/projects/33aec7ff14484833b60801c106ac1eef/users/bb879f52048a4de699a22ee703d681e8/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:26.592878 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442d0d8-ded0-46b4-abad-a962c1d00268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33aec7ff14484833b60801c106ac1eef, user_id=bb879f52048a4de699a22ee703d681e8, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:26.595600 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442d0d8-ded0-46b4-abad-a962c1d00268 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:26.717938 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1352/2701] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:19:26 2021] PUT /identity/v3/projects/33aec7ff14484833b60801c106ac1eef/users/bb879f52048a4de699a22ee703d681e8/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:26.729637 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d6cc5-8171-40e7-934d-efd27b8226d5 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:26.729927 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d6cc5-8171-40e7-934d-efd27b8226d5 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:26.730206 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d6cc5-8171-40e7-934d-efd27b8226d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:26.757356 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-915d6cc5-8171-40e7-934d-efd27b8226d5 None None] MFA Rules not processed for user `bb879f52048a4de699a22ee703d681e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:26.758566 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-915d6cc5-8171-40e7-934d-efd27b8226d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:26.825211 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1350/2702] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:26 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:26.835602 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442d0d8-ded0-46b4-abad-a962c1d00268 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:26.837372 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-9442d0d8-ded0-46b4-abad-a962c1d00268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:26.893589 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442d0d8-ded0-46b4-abad-a962c1d00268 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:26.897863 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f960c-b152-43ce-b998-a4da7a0e4fb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:26.898491 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f960c-b152-43ce-b998-a4da7a0e4fb9 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:26.898772 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f960c-b152-43ce-b998-a4da7a0e4fb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:26.899043 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f960c-b152-43ce-b998-a4da7a0e4fb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:26.908059 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f960c-b152-43ce-b998-a4da7a0e4fb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:26.909492 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f960c-b152-43ce-b998-a4da7a0e4fb9 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:26.919114 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1353/2703] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:26 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:19:38.336510 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d6cc5-8171-40e7-934d-efd27b8226d5 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:38.396014 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d6cc5-8171-40e7-934d-efd27b8226d5 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:38.401062 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb24bad-c65a-45ad-a13c-ff395241f99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:38.401911 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb24bad-c65a-45ad-a13c-ff395241f99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:38.402191 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb24bad-c65a-45ad-a13c-ff395241f99f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:38.402464 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb24bad-c65a-45ad-a13c-ff395241f99f admin admin] PATH_INFO: `/v3/users/bb879f52048a4de699a22ee703d681e8` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:38.403670 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb24bad-c65a-45ad-a13c-ff395241f99f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb879f52048a4de699a22ee703d681e8)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:38.405554 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb24bad-c65a-45ad-a13c-ff395241f99f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:38.635223 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-5eb24bad-c65a-45ad-a13c-ff395241f99f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb879f52048a4de699a22ee703d681e8'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:38.705810 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-5eb24bad-c65a-45ad-a13c-ff395241f99f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb879f52048a4de699a22ee703d681e8'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:38.713494 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-5eb24bad-c65a-45ad-a13c-ff395241f99f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb879f52048a4de699a22ee703d681e8'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:38.714281 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-5eb24bad-c65a-45ad-a13c-ff395241f99f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb879f52048a4de699a22ee703d681e8'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:38.725828 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-5eb24bad-c65a-45ad-a13c-ff395241f99f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb879f52048a4de699a22ee703d681e8'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:38.731636 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1351/2704] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:19:38 2021] DELETE /identity/v3/users/bb879f52048a4de699a22ee703d681e8 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:38.736175 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70e575-03e4-4ebd-85cc-cecc1c696a4f None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:38.736623 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70e575-03e4-4ebd-85cc-cecc1c696a4f None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:38.736735 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70e575-03e4-4ebd-85cc-cecc1c696a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:38.753501 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-0a70e575-03e4-4ebd-85cc-cecc1c696a4f None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:38.754682 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-0a70e575-03e4-4ebd-85cc-cecc1c696a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:38.772782 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb24bad-c65a-45ad-a13c-ff395241f99f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:38.774151 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-5eb24bad-c65a-45ad-a13c-ff395241f99f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:38.813754 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1354/2705] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:38.824866 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70e575-03e4-4ebd-85cc-cecc1c696a4f None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:38.826227 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-0a70e575-03e4-4ebd-85cc-cecc1c696a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:38.844531 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb24bad-c65a-45ad-a13c-ff395241f99f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:38.849201 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece90a7-d74a-433f-8ce3-5ff9cf45bbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:38.850239 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece90a7-d74a-433f-8ce3-5ff9cf45bbe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:38.850530 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece90a7-d74a-433f-8ce3-5ff9cf45bbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:38.850810 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece90a7-d74a-433f-8ce3-5ff9cf45bbe7 admin admin] PATH_INFO: `/v3/users/6377eb4b7a39419e814525c9a3bb41f6` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:38.852062 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece90a7-d74a-433f-8ce3-5ff9cf45bbe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6377eb4b7a39419e814525c9a3bb41f6)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:38.854011 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece90a7-d74a-433f-8ce3-5ff9cf45bbe7 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:38.883505 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70e575-03e4-4ebd-85cc-cecc1c696a4f None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:38.892506 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e805a7-22c6-4372-a4ff-91effb3ae03f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:38.892506 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e805a7-22c6-4372-a4ff-91effb3ae03f service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:38.892506 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e805a7-22c6-4372-a4ff-91effb3ae03f service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:38.892506 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e805a7-22c6-4372-a4ff-91effb3ae03f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:38.897950 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e805a7-22c6-4372-a4ff-91effb3ae03f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:38.899993 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e805a7-22c6-4372-a4ff-91effb3ae03f service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:38.910916 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1355/2706] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:19:39.047001 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-4ece90a7-d74a-433f-8ce3-5ff9cf45bbe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6377eb4b7a39419e814525c9a3bb41f6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:39.125560 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-4ece90a7-d74a-433f-8ce3-5ff9cf45bbe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6377eb4b7a39419e814525c9a3bb41f6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:39.133397 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-4ece90a7-d74a-433f-8ce3-5ff9cf45bbe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6377eb4b7a39419e814525c9a3bb41f6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:39.134079 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-4ece90a7-d74a-433f-8ce3-5ff9cf45bbe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6377eb4b7a39419e814525c9a3bb41f6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:39.145766 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-4ece90a7-d74a-433f-8ce3-5ff9cf45bbe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6377eb4b7a39419e814525c9a3bb41f6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:39.151866 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1352/2707] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:19:38 2021] DELETE /identity/v3/users/6377eb4b7a39419e814525c9a3bb41f6 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:19:39.156532 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b7e79-a443-44ea-86b1-58d64bb8ad83 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:39.157429 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b7e79-a443-44ea-86b1-58d64bb8ad83 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:39.157429 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b7e79-a443-44ea-86b1-58d64bb8ad83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:39.174314 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-786b7e79-a443-44ea-86b1-58d64bb8ad83 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:39.175554 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-786b7e79-a443-44ea-86b1-58d64bb8ad83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:39.233602 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1356/2708] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:39.244372 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece90a7-d74a-433f-8ce3-5ff9cf45bbe7 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:39.245792 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-4ece90a7-d74a-433f-8ce3-5ff9cf45bbe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:39.300898 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece90a7-d74a-433f-8ce3-5ff9cf45bbe7 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:39.305502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c0d2a-7043-4f03-8070-6970f25903e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:39.306137 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c0d2a-7043-4f03-8070-6970f25903e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:39.306560 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c0d2a-7043-4f03-8070-6970f25903e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:39.306742 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c0d2a-7043-4f03-8070-6970f25903e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:39.316353 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c0d2a-7043-4f03-8070-6970f25903e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:39.320282 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c0d2a-7043-4f03-8070-6970f25903e3 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:39.321430 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b7e79-a443-44ea-86b1-58d64bb8ad83 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:39.322901 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-786b7e79-a443-44ea-86b1-58d64bb8ad83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:39.332893 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1353/2709] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:19:39.336216 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b7e79-a443-44ea-86b1-58d64bb8ad83 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:39.341484 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45413fdd-91b4-4d32-b74b-b791d59ebb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:39.342571 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45413fdd-91b4-4d32-b74b-b791d59ebb61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:39.343000 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45413fdd-91b4-4d32-b74b-b791d59ebb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:39.343440 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45413fdd-91b4-4d32-b74b-b791d59ebb61 admin admin] PATH_INFO: `/v3/projects/33aec7ff14484833b60801c106ac1eef` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:39.344831 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45413fdd-91b4-4d32-b74b-b791d59ebb61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33aec7ff14484833b60801c106ac1eef)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:39.346837 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45413fdd-91b4-4d32-b74b-b791d59ebb61 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:39.518937 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-45413fdd-91b4-4d32-b74b-b791d59ebb61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33aec7ff14484833b60801c106ac1eef', 'request_id': 'req-45413fdd-91b4-4d32-b74b-b791d59ebb61'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:39.525122 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-45413fdd-91b4-4d32-b74b-b791d59ebb61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33aec7ff14484833b60801c106ac1eef', 'request_id': 'req-45413fdd-91b4-4d32-b74b-b791d59ebb61'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:39.530341 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-45413fdd-91b4-4d32-b74b-b791d59ebb61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33aec7ff14484833b60801c106ac1eef', 'request_id': 'req-45413fdd-91b4-4d32-b74b-b791d59ebb61'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:39.693184 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-45413fdd-91b4-4d32-b74b-b791d59ebb61 admin admin] The token cache is being invalidate because project 33aec7ff14484833b60801c106ac1eef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:19:39.693694 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-45413fdd-91b4-4d32-b74b-b791d59ebb61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:39.694505 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-45413fdd-91b4-4d32-b74b-b791d59ebb61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:39.696840 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1357/2710] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:19:39 2021] DELETE /identity/v3/projects/33aec7ff14484833b60801c106ac1eef => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:39.923061 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c0d2a-7043-4f03-8070-6970f25903e3 service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:39.925101 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-691c0d2a-7043-4f03-8070-6970f25903e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:39.939017 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c0d2a-7043-4f03-8070-6970f25903e3 service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:39.995600 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9fde6-4c0a-4643-a39e-5f91787687f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:39.996458 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9fde6-4c0a-4643-a39e-5f91787687f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:39.996740 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9fde6-4c0a-4643-a39e-5f91787687f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:39.997016 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9fde6-4c0a-4643-a39e-5f91787687f4 admin admin] PATH_INFO: `/v3/projects/da55f7d66c354b84833b28698076f19c` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:39.998225 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9fde6-4c0a-4643-a39e-5f91787687f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da55f7d66c354b84833b28698076f19c)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:40.000132 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9fde6-4c0a-4643-a39e-5f91787687f4 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:40.107752 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-1ba9fde6-4c0a-4643-a39e-5f91787687f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da55f7d66c354b84833b28698076f19c', 'request_id': 'req-1ba9fde6-4c0a-4643-a39e-5f91787687f4'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:40.113649 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-1ba9fde6-4c0a-4643-a39e-5f91787687f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da55f7d66c354b84833b28698076f19c', 'request_id': 'req-1ba9fde6-4c0a-4643-a39e-5f91787687f4'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:40.119061 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-1ba9fde6-4c0a-4643-a39e-5f91787687f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da55f7d66c354b84833b28698076f19c', 'request_id': 'req-1ba9fde6-4c0a-4643-a39e-5f91787687f4'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:40.196969 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-1ba9fde6-4c0a-4643-a39e-5f91787687f4 admin admin] The token cache is being invalidate because project da55f7d66c354b84833b28698076f19c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:19:40.197181 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-1ba9fde6-4c0a-4643-a39e-5f91787687f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:40.197793 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-1ba9fde6-4c0a-4643-a39e-5f91787687f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:19:40.199413 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1354/2711] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:19:39 2021] DELETE /identity/v3/projects/da55f7d66c354b84833b28698076f19c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:40.205330 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4d4d9-f085-4e7d-a6d9-1b8911d0420e None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:40.205788 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4d4d9-f085-4e7d-a6d9-1b8911d0420e None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:40.205913 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4d4d9-f085-4e7d-a6d9-1b8911d0420e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:40.224664 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-32b4d4d9-f085-4e7d-a6d9-1b8911d0420e None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:40.225861 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-32b4d4d9-f085-4e7d-a6d9-1b8911d0420e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:40.282926 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1358/2712] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:40.291026 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019d87f-bdf1-42bd-b4c8-84a86c86822e None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:40.291409 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019d87f-bdf1-42bd-b4c8-84a86c86822e None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:40.291698 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019d87f-bdf1-42bd-b4c8-84a86c86822e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:40.309866 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-7019d87f-bdf1-42bd-b4c8-84a86c86822e None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:40.311077 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-7019d87f-bdf1-42bd-b4c8-84a86c86822e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:40.319846 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1355/2713] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:40.324039 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4d4d9-f085-4e7d-a6d9-1b8911d0420e None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:40.333418 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4d4d9-f085-4e7d-a6d9-1b8911d0420e None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:40.339006 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea467513-501c-47e7-98b0-dd196249ab1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:40.339686 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea467513-501c-47e7-98b0-dd196249ab1e admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:40.339973 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea467513-501c-47e7-98b0-dd196249ab1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:40.340252 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea467513-501c-47e7-98b0-dd196249ab1e admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:40.340982 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea467513-501c-47e7-98b0-dd196249ab1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:19:40.341289 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea467513-501c-47e7-98b0-dd196249ab1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:40.342861 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea467513-501c-47e7-98b0-dd196249ab1e admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:40.354026 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1359/2714] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:19:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:19:40.358163 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019d87f-bdf1-42bd-b4c8-84a86c86822e None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:40.366955 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019d87f-bdf1-42bd-b4c8-84a86c86822e None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:40.371462 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db735402-e8a6-48f5-aa35-b2a1ba6736e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:40.372093 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db735402-e8a6-48f5-aa35-b2a1ba6736e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:40.372374 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db735402-e8a6-48f5-aa35-b2a1ba6736e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:40.372649 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db735402-e8a6-48f5-aa35-b2a1ba6736e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:40.373335 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db735402-e8a6-48f5-aa35-b2a1ba6736e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:40.375300 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db735402-e8a6-48f5-aa35-b2a1ba6736e8 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:40.503228 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1356/2715] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:19:40 2021] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:19:40.508383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea467513-501c-47e7-98b0-dd196249ab1e admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:40.518145 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea467513-501c-47e7-98b0-dd196249ab1e admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:40.575791 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340c35b-f969-489e-bf9f-219e188d4585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:40.576459 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340c35b-f969-489e-bf9f-219e188d4585 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:40.576741 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340c35b-f969-489e-bf9f-219e188d4585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:40.577019 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340c35b-f969-489e-bf9f-219e188d4585 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:40.577722 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340c35b-f969-489e-bf9f-219e188d4585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:40.579635 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340c35b-f969-489e-bf9f-219e188d4585 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:40.697456 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1360/2716] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:19:40 2021] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:19:40.701600 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db735402-e8a6-48f5-aa35-b2a1ba6736e8 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:40.711947 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db735402-e8a6-48f5-aa35-b2a1ba6736e8 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:40.716411 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cf9aa-2efc-4cb6-8d3a-aeafccb1043d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:40.717056 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cf9aa-2efc-4cb6-8d3a-aeafccb1043d admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:40.717340 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cf9aa-2efc-4cb6-8d3a-aeafccb1043d admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:40.717617 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cf9aa-2efc-4cb6-8d3a-aeafccb1043d admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:40.718357 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89cf9aa-2efc-4cb6-8d3a-aeafccb1043d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:40.719973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89cf9aa-2efc-4cb6-8d3a-aeafccb1043d admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:40.730060 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1357/2717] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:19:40 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:19:40.733904 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340c35b-f969-489e-bf9f-219e188d4585 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:40.744352 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340c35b-f969-489e-bf9f-219e188d4585 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:40.748961 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4c550-7ab4-4cde-80de-1ecabde6ea5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:40.749609 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4c550-7ab4-4cde-80de-1ecabde6ea5d admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:40.749890 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4c550-7ab4-4cde-80de-1ecabde6ea5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:40.750166 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4c550-7ab4-4cde-80de-1ecabde6ea5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:40.750894 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4c550-7ab4-4cde-80de-1ecabde6ea5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:40.752516 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4c550-7ab4-4cde-80de-1ecabde6ea5d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:40.762838 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1361/2718] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:19:40 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:19:40.766817 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cf9aa-2efc-4cb6-8d3a-aeafccb1043d admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:40.776571 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cf9aa-2efc-4cb6-8d3a-aeafccb1043d admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:40.781207 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4c808-b049-4cfb-982e-0c3006f3ba63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:40.782060 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4c808-b049-4cfb-982e-0c3006f3ba63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:40.782341 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4c808-b049-4cfb-982e-0c3006f3ba63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:40.782617 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4c808-b049-4cfb-982e-0c3006f3ba63 admin admin] PATH_INFO: `/v3/projects/29832a113f1544d7a5467a88b2f0d669/users/153a38363b5c4a2588ee3d43b8475342/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:40.796922 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4c808-b049-4cfb-982e-0c3006f3ba63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29832a113f1544d7a5467a88b2f0d669, user_id=153a38363b5c4a2588ee3d43b8475342, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:40.799572 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4c808-b049-4cfb-982e-0c3006f3ba63 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:40.911397 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1358/2719] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:19:40 2021] PUT /identity/v3/projects/29832a113f1544d7a5467a88b2f0d669/users/153a38363b5c4a2588ee3d43b8475342/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:40.922747 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19a62e-6c12-4081-9067-12891bf9ea5b None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:40.923061 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19a62e-6c12-4081-9067-12891bf9ea5b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:40.923368 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19a62e-6c12-4081-9067-12891bf9ea5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:40.941362 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-1d19a62e-6c12-4081-9067-12891bf9ea5b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:40.942545 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-1d19a62e-6c12-4081-9067-12891bf9ea5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:41.000324 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1362/2720] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:41.010176 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4c808-b049-4cfb-982e-0c3006f3ba63 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:41.011869 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-8fc4c808-b049-4cfb-982e-0c3006f3ba63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:41.070225 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4c808-b049-4cfb-982e-0c3006f3ba63 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:41.074064 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608caf6-1a2f-4a1e-a9e1-1fe396081117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:41.074709 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608caf6-1a2f-4a1e-a9e1-1fe396081117 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:41.080713 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608caf6-1a2f-4a1e-a9e1-1fe396081117 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:41.080713 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608caf6-1a2f-4a1e-a9e1-1fe396081117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:41.084679 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608caf6-1a2f-4a1e-a9e1-1fe396081117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:41.086102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608caf6-1a2f-4a1e-a9e1-1fe396081117 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:41.095501 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1359/2721] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:19:43.817548 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19a62e-6c12-4081-9067-12891bf9ea5b None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:43.820422 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-1d19a62e-6c12-4081-9067-12891bf9ea5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:43.977796 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19a62e-6c12-4081-9067-12891bf9ea5b None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:43.993679 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0dd72-cfdb-451e-af2b-601bb8af76f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:43.994381 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0dd72-cfdb-451e-af2b-601bb8af76f3 service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:43.994674 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0dd72-cfdb-451e-af2b-601bb8af76f3 service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:43.994959 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0dd72-cfdb-451e-af2b-601bb8af76f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:43.997046 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e7a0dd72-cfdb-451e-af2b-601bb8af76f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:44.019658 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0dd72-cfdb-451e-af2b-601bb8af76f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:44.021561 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0dd72-cfdb-451e-af2b-601bb8af76f3 service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:44.049818 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1363/2722] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:43 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:19:44.164944 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608caf6-1a2f-4a1e-a9e1-1fe396081117 service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:44.174492 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608caf6-1a2f-4a1e-a9e1-1fe396081117 service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:44.178774 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a2008-eca4-4b05-9139-ccd9a483024a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:44.179699 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a2008-eca4-4b05-9139-ccd9a483024a service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:44.180049 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a2008-eca4-4b05-9139-ccd9a483024a service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:44.185037 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a2008-eca4-4b05-9139-ccd9a483024a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:44.187734 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-551a2008-eca4-4b05-9139-ccd9a483024a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:44.200159 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a2008-eca4-4b05-9139-ccd9a483024a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:44.201717 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a2008-eca4-4b05-9139-ccd9a483024a service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:44.212897 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1360/2723] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:44 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:19:45.877039 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0dd72-cfdb-451e-af2b-601bb8af76f3 service nova] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:45.895563 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0dd72-cfdb-451e-af2b-601bb8af76f3 service nova] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:45.913922 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5eb1f-b9ce-4b36-87e6-40326015d786 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:45.915493 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5eb1f-b9ce-4b36-87e6-40326015d786 service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:45.915999 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5eb1f-b9ce-4b36-87e6-40326015d786 service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:45.916495 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5eb1f-b9ce-4b36-87e6-40326015d786 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:45.926144 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-fda5eb1f-b9ce-4b36-87e6-40326015d786 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:45.961186 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5eb1f-b9ce-4b36-87e6-40326015d786 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:45.963289 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5eb1f-b9ce-4b36-87e6-40326015d786 service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:45.993560 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1364/2724] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:45 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:19:48.401370 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3153e93-a937-407f-8b94-b2ec14953993 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:48.401994 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3153e93-a937-407f-8b94-b2ec14953993 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:48.401994 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3153e93-a937-407f-8b94-b2ec14953993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:48.433574 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-c3153e93-a937-407f-8b94-b2ec14953993 None None] MFA Rules not processed for user `153a38363b5c4a2588ee3d43b8475342`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:48.434792 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c3153e93-a937-407f-8b94-b2ec14953993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:48.499395 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1361/2725] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:48 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:48.503802 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5eb1f-b9ce-4b36-87e6-40326015d786 service nova] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:48.515408 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5eb1f-b9ce-4b36-87e6-40326015d786 service nova] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:48.520255 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378eb1d1-eb61-447a-94e2-bcd1685211e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:48.520910 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378eb1d1-eb61-447a-94e2-bcd1685211e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:48.521196 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378eb1d1-eb61-447a-94e2-bcd1685211e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:48.521475 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378eb1d1-eb61-447a-94e2-bcd1685211e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:48.522419 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378eb1d1-eb61-447a-94e2-bcd1685211e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:48.524344 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378eb1d1-eb61-447a-94e2-bcd1685211e2 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:48.637186 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1365/2726] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:19:48 2021] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:19:48.641426 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3153e93-a937-407f-8b94-b2ec14953993 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:48.655094 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3153e93-a937-407f-8b94-b2ec14953993 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:48.716201 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23885c-8748-40b1-b6d1-a1ef02916fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:48.716986 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23885c-8748-40b1-b6d1-a1ef02916fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:48.717277 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23885c-8748-40b1-b6d1-a1ef02916fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:48.717555 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23885c-8748-40b1-b6d1-a1ef02916fa3 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:48.718318 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23885c-8748-40b1-b6d1-a1ef02916fa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:48.720288 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23885c-8748-40b1-b6d1-a1ef02916fa3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:48.811959 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1362/2727] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:19:48 2021] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:19:48.817941 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378eb1d1-eb61-447a-94e2-bcd1685211e2 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:48.829079 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378eb1d1-eb61-447a-94e2-bcd1685211e2 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:48.835598 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7027e-5410-497e-bcd3-b2a2bbb61adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:48.836417 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7027e-5410-497e-bcd3-b2a2bbb61adc admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:48.836762 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7027e-5410-497e-bcd3-b2a2bbb61adc admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:48.836988 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7027e-5410-497e-bcd3-b2a2bbb61adc admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:48.837696 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7027e-5410-497e-bcd3-b2a2bbb61adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:48.839356 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7027e-5410-497e-bcd3-b2a2bbb61adc admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:48.851381 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1366/2728] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:19:48 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:19:48.855463 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23885c-8748-40b1-b6d1-a1ef02916fa3 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:48.865919 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23885c-8748-40b1-b6d1-a1ef02916fa3 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:48.870821 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fb4b6-0827-4f63-8774-9bbd4b75c742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:48.871747 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fb4b6-0827-4f63-8774-9bbd4b75c742 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:48.872110 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fb4b6-0827-4f63-8774-9bbd4b75c742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:48.872390 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fb4b6-0827-4f63-8774-9bbd4b75c742 admin admin] PATH_INFO: `/v3/projects/60710a74836d4b22b1ab65670b7a47b3/users/2630d2fbb16e4c828de25aaf5d844f26/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:48.887333 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fb4b6-0827-4f63-8774-9bbd4b75c742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60710a74836d4b22b1ab65670b7a47b3, user_id=2630d2fbb16e4c828de25aaf5d844f26, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:48.890008 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fb4b6-0827-4f63-8774-9bbd4b75c742 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:48.971374 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1363/2729] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:19:48 2021] PUT /identity/v3/projects/60710a74836d4b22b1ab65670b7a47b3/users/2630d2fbb16e4c828de25aaf5d844f26/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:48.976243 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7027e-5410-497e-bcd3-b2a2bbb61adc admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:48.987421 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7027e-5410-497e-bcd3-b2a2bbb61adc admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:49.050424 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7300a3-df53-4efd-9994-2ba457d30eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:49.051090 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7300a3-df53-4efd-9994-2ba457d30eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:49.051408 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7300a3-df53-4efd-9994-2ba457d30eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:49.051680 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7300a3-df53-4efd-9994-2ba457d30eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:49.052630 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7300a3-df53-4efd-9994-2ba457d30eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:49.054326 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7300a3-df53-4efd-9994-2ba457d30eb8 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:49.065085 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1367/2730] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:19:48 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:19:49.110238 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fb4b6-0827-4f63-8774-9bbd4b75c742 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:49.127949 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fb4b6-0827-4f63-8774-9bbd4b75c742 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:49.134640 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d89d0-66a2-460b-9ba5-04e17d05c98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:49.135766 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d89d0-66a2-460b-9ba5-04e17d05c98a admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:49.136177 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d89d0-66a2-460b-9ba5-04e17d05c98a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:49.136555 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d89d0-66a2-460b-9ba5-04e17d05c98a admin admin] PATH_INFO: `/v3/projects/60710a74836d4b22b1ab65670b7a47b3/users/2630d2fbb16e4c828de25aaf5d844f26/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:49.138903 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d89d0-66a2-460b-9ba5-04e17d05c98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=60710a74836d4b22b1ab65670b7a47b3, user_id=2630d2fbb16e4c828de25aaf5d844f26, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:49.141918 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d89d0-66a2-460b-9ba5-04e17d05c98a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:49.155546 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1364/2731] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:19:49 2021] PUT /identity/v3/projects/60710a74836d4b22b1ab65670b7a47b3/users/2630d2fbb16e4c828de25aaf5d844f26/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:19:55.516215 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a818e-c8ea-4156-ae52-fd50f125bc6b None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:55.517388 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a818e-c8ea-4156-ae52-fd50f125bc6b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:55.517388 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a818e-c8ea-4156-ae52-fd50f125bc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:55.541562 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-8b1a818e-c8ea-4156-ae52-fd50f125bc6b None None] MFA Rules not processed for user `b68d0745d9cb49a5bd9331148967764a`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:55.543276 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-8b1a818e-c8ea-4156-ae52-fd50f125bc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:55.617302 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1368/2732] 10.222.0.54 () {58 vars in 967 bytes} [Tue Nov 23 04:19:55 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:55.782325 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d89d0-66a2-460b-9ba5-04e17d05c98a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:55.784333 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-ed8d89d0-66a2-460b-9ba5-04e17d05c98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:55.898523 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d89d0-66a2-460b-9ba5-04e17d05c98a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:55.908281 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c9741-981a-48eb-97ba-1b15e98a36ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd439c1f0764f4cac7eb641a485937a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:55.909670 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c9741-981a-48eb-97ba-1b15e98a36ac service swift] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:55.910140 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c9741-981a-48eb-97ba-1b15e98a36ac service swift] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:55.910584 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c9741-981a-48eb-97ba-1b15e98a36ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:55.922553 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c9741-981a-48eb-97ba-1b15e98a36ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:55.924650 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c9741-981a-48eb-97ba-1b15e98a36ac service swift] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:55.944092 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1365/2733] 10.222.0.54 () {60 vars in 1384 bytes} [Tue Nov 23 04:19:55 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 04:19:56.337826 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e383300-46fd-4060-bbf8-96b57f70a6e4 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:56.338316 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e383300-46fd-4060-bbf8-96b57f70a6e4 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:56.338727 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e383300-46fd-4060-bbf8-96b57f70a6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:56.376534 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-2e383300-46fd-4060-bbf8-96b57f70a6e4 None None] MFA Rules not processed for user `2630d2fbb16e4c828de25aaf5d844f26`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:19:56.377751 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-2e383300-46fd-4060-bbf8-96b57f70a6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:19:56.456461 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1369/2734] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:19:56 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:19:56.468796 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c9741-981a-48eb-97ba-1b15e98a36ac service swift] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:19:56.541602 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c9741-981a-48eb-97ba-1b15e98a36ac service swift] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:19:56.549797 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3163054-9dc2-4ad0-8a6d-baa877c7ec01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:19:56.549797 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3163054-9dc2-4ad0-8a6d-baa877c7ec01 service nova] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:19:56.549797 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3163054-9dc2-4ad0-8a6d-baa877c7ec01 service nova] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:19:56.549797 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3163054-9dc2-4ad0-8a6d-baa877c7ec01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:19:56.606387 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3163054-9dc2-4ad0-8a6d-baa877c7ec01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:19:56.608044 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3163054-9dc2-4ad0-8a6d-baa877c7ec01 service nova] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:19:56.617659 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1366/2735] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:19:56 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:20:00.441858 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee1033-b1a6-4e48-823f-3f484040c9b0 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:00.442363 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee1033-b1a6-4e48-823f-3f484040c9b0 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:00.442460 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee1033-b1a6-4e48-823f-3f484040c9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:00.462182 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-77ee1033-b1a6-4e48-823f-3f484040c9b0 None None] MFA Rules not processed for user `153a38363b5c4a2588ee3d43b8475342`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:20:00.463538 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-77ee1033-b1a6-4e48-823f-3f484040c9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:00.479731 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1370/2736] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:20:00 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:20:05.690278 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3163054-9dc2-4ad0-8a6d-baa877c7ec01 service nova] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:05.691771 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-b3163054-9dc2-4ad0-8a6d-baa877c7ec01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:05.760777 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3163054-9dc2-4ad0-8a6d-baa877c7ec01 service nova] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:05.765514 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663101e-e760-4589-8288-5afe8745d194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:05.766632 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663101e-e760-4589-8288-5afe8745d194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:05.766915 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663101e-e760-4589-8288-5afe8745d194 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:05.767247 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663101e-e760-4589-8288-5afe8745d194 admin admin] PATH_INFO: `/v3/users/21a1d655b7be402c9339cfd5d09215f5` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:05.768497 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663101e-e760-4589-8288-5afe8745d194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21a1d655b7be402c9339cfd5d09215f5)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:05.770446 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663101e-e760-4589-8288-5afe8745d194 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:05.967470 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-b663101e-e760-4589-8288-5afe8745d194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21a1d655b7be402c9339cfd5d09215f5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:20:06.033320 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-b663101e-e760-4589-8288-5afe8745d194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21a1d655b7be402c9339cfd5d09215f5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:20:06.041111 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-b663101e-e760-4589-8288-5afe8745d194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21a1d655b7be402c9339cfd5d09215f5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:20:06.041736 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-b663101e-e760-4589-8288-5afe8745d194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21a1d655b7be402c9339cfd5d09215f5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:20:06.054998 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-b663101e-e760-4589-8288-5afe8745d194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21a1d655b7be402c9339cfd5d09215f5'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:20:06.061078 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1367/2737] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:20:05 2021] DELETE /identity/v3/users/21a1d655b7be402c9339cfd5d09215f5 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:20:06.321730 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee1033-b1a6-4e48-823f-3f484040c9b0 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:06.336312 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee1033-b1a6-4e48-823f-3f484040c9b0 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:06.396626 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29aef89-04ad-4d6b-bd58-49d6ec8f66f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:06.397507 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29aef89-04ad-4d6b-bd58-49d6ec8f66f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:06.397896 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29aef89-04ad-4d6b-bd58-49d6ec8f66f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:06.398205 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29aef89-04ad-4d6b-bd58-49d6ec8f66f9 admin admin] PATH_INFO: `/v3/projects/0dcc5d168617498bbafe5038567ca011` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:06.399544 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29aef89-04ad-4d6b-bd58-49d6ec8f66f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dcc5d168617498bbafe5038567ca011)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:06.401417 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29aef89-04ad-4d6b-bd58-49d6ec8f66f9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:06.565022 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f29aef89-04ad-4d6b-bd58-49d6ec8f66f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dcc5d168617498bbafe5038567ca011', 'request_id': 'req-f29aef89-04ad-4d6b-bd58-49d6ec8f66f9'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:20:06.571270 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f29aef89-04ad-4d6b-bd58-49d6ec8f66f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dcc5d168617498bbafe5038567ca011', 'request_id': 'req-f29aef89-04ad-4d6b-bd58-49d6ec8f66f9'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:20:06.576667 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f29aef89-04ad-4d6b-bd58-49d6ec8f66f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dcc5d168617498bbafe5038567ca011', 'request_id': 'req-f29aef89-04ad-4d6b-bd58-49d6ec8f66f9'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:20:06.787835 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f29aef89-04ad-4d6b-bd58-49d6ec8f66f9 admin admin] The token cache is being invalidate because project 0dcc5d168617498bbafe5038567ca011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:20:06.788145 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f29aef89-04ad-4d6b-bd58-49d6ec8f66f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:20:06.788769 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f29aef89-04ad-4d6b-bd58-49d6ec8f66f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:20:06.790296 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1371/2738] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:20:06 2021] DELETE /identity/v3/projects/0dcc5d168617498bbafe5038567ca011 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:20:06.794350 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663101e-e760-4589-8288-5afe8745d194 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:06.795760 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-b663101e-e760-4589-8288-5afe8745d194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:06.808712 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663101e-e760-4589-8288-5afe8745d194 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:06.869760 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e526cb-59e4-4375-8c83-0746ec8b14b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:06.870623 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e526cb-59e4-4375-8c83-0746ec8b14b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:06.870904 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e526cb-59e4-4375-8c83-0746ec8b14b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:06.871179 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e526cb-59e4-4375-8c83-0746ec8b14b1 admin admin] PATH_INFO: `/v3/users/63784b24c95c4867b726f7a4f433d9dd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:06.872430 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e526cb-59e4-4375-8c83-0746ec8b14b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63784b24c95c4867b726f7a4f433d9dd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:06.874362 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e526cb-59e4-4375-8c83-0746ec8b14b1 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:07.073075 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-87e526cb-59e4-4375-8c83-0746ec8b14b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63784b24c95c4867b726f7a4f433d9dd'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:20:07.153449 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-87e526cb-59e4-4375-8c83-0746ec8b14b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63784b24c95c4867b726f7a4f433d9dd'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:20:07.160954 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-87e526cb-59e4-4375-8c83-0746ec8b14b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63784b24c95c4867b726f7a4f433d9dd'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:20:07.162057 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-87e526cb-59e4-4375-8c83-0746ec8b14b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63784b24c95c4867b726f7a4f433d9dd'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:20:07.174032 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-87e526cb-59e4-4375-8c83-0746ec8b14b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63784b24c95c4867b726f7a4f433d9dd'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:20:07.179911 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1368/2739] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:20:06 2021] DELETE /identity/v3/users/63784b24c95c4867b726f7a4f433d9dd => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:20:07.451334 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29aef89-04ad-4d6b-bd58-49d6ec8f66f9 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:07.452779 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-f29aef89-04ad-4d6b-bd58-49d6ec8f66f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:07.466275 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29aef89-04ad-4d6b-bd58-49d6ec8f66f9 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:07.524756 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62bdbe-b70e-43e9-befb-8633d0806185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:07.525639 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62bdbe-b70e-43e9-befb-8633d0806185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:07.525938 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62bdbe-b70e-43e9-befb-8633d0806185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:07.526196 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62bdbe-b70e-43e9-befb-8633d0806185 admin admin] PATH_INFO: `/v3/projects/8f5aeba06d224980b7a3e376b675d4ea` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:07.527413 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62bdbe-b70e-43e9-befb-8633d0806185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f5aeba06d224980b7a3e376b675d4ea)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:07.529293 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62bdbe-b70e-43e9-befb-8633d0806185 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:07.649620 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-bf62bdbe-b70e-43e9-befb-8633d0806185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f5aeba06d224980b7a3e376b675d4ea', 'request_id': 'req-bf62bdbe-b70e-43e9-befb-8633d0806185'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:20:07.655843 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-bf62bdbe-b70e-43e9-befb-8633d0806185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f5aeba06d224980b7a3e376b675d4ea', 'request_id': 'req-bf62bdbe-b70e-43e9-befb-8633d0806185'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:20:07.661036 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-bf62bdbe-b70e-43e9-befb-8633d0806185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f5aeba06d224980b7a3e376b675d4ea', 'request_id': 'req-bf62bdbe-b70e-43e9-befb-8633d0806185'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:20:07.752766 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-bf62bdbe-b70e-43e9-befb-8633d0806185 admin admin] The token cache is being invalidate because project 8f5aeba06d224980b7a3e376b675d4ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:20:07.753068 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-bf62bdbe-b70e-43e9-befb-8633d0806185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:20:07.753713 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-bf62bdbe-b70e-43e9-befb-8633d0806185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:20:07.755294 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1372/2740] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:20:07 2021] DELETE /identity/v3/projects/8f5aeba06d224980b7a3e376b675d4ea => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:20:07.761776 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375b090-b7d9-475e-8cf4-78ce2ec0e6e7 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:07.762070 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375b090-b7d9-475e-8cf4-78ce2ec0e6e7 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:07.762355 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375b090-b7d9-475e-8cf4-78ce2ec0e6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:07.779642 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-a375b090-b7d9-475e-8cf4-78ce2ec0e6e7 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:20:07.780870 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-a375b090-b7d9-475e-8cf4-78ce2ec0e6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:07.839106 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1369/2741] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:20:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:20:07.847101 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cee577-6366-426a-a55f-358b9c3f924b None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:07.847595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cee577-6366-426a-a55f-358b9c3f924b None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:07.847879 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cee577-6366-426a-a55f-358b9c3f924b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:07.866280 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-e7cee577-6366-426a-a55f-358b9c3f924b None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:20:07.867486 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e7cee577-6366-426a-a55f-358b9c3f924b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:07.875150 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1373/2742] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:20:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:20:07.879512 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375b090-b7d9-475e-8cf4-78ce2ec0e6e7 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:07.890750 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375b090-b7d9-475e-8cf4-78ce2ec0e6e7 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:07.895316 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46a699-fe4c-4f5c-b0e0-fe63f806c2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:07.895968 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46a699-fe4c-4f5c-b0e0-fe63f806c2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:07.896439 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46a699-fe4c-4f5c-b0e0-fe63f806c2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:07.896834 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46a699-fe4c-4f5c-b0e0-fe63f806c2b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:07.897569 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46a699-fe4c-4f5c-b0e0-fe63f806c2b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:20:07.897874 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46a699-fe4c-4f5c-b0e0-fe63f806c2b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:07.899466 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46a699-fe4c-4f5c-b0e0-fe63f806c2b5 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:07.910749 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1370/2743] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:20:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:20:07.916356 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cee577-6366-426a-a55f-358b9c3f924b None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:07.925403 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cee577-6366-426a-a55f-358b9c3f924b None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:07.931006 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826ced0-9f7b-4d4e-a242-b676b2d64511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:07.931682 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826ced0-9f7b-4d4e-a242-b676b2d64511 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:07.931962 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826ced0-9f7b-4d4e-a242-b676b2d64511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:07.932235 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826ced0-9f7b-4d4e-a242-b676b2d64511 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:07.932941 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826ced0-9f7b-4d4e-a242-b676b2d64511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:07.934791 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826ced0-9f7b-4d4e-a242-b676b2d64511 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:08.034738 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1374/2744] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:20:07 2021] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:20:08.040122 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46a699-fe4c-4f5c-b0e0-fe63f806c2b5 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:08.050298 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46a699-fe4c-4f5c-b0e0-fe63f806c2b5 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:08.107588 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1a3f9-81fb-4651-8a36-c7021a18f174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:08.108221 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1a3f9-81fb-4651-8a36-c7021a18f174 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:08.108505 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1a3f9-81fb-4651-8a36-c7021a18f174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:08.108784 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1a3f9-81fb-4651-8a36-c7021a18f174 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:08.109492 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1a3f9-81fb-4651-8a36-c7021a18f174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:08.111426 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1a3f9-81fb-4651-8a36-c7021a18f174 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:08.222730 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1371/2745] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:20:08 2021] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:20:08.227452 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826ced0-9f7b-4d4e-a242-b676b2d64511 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:08.237516 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826ced0-9f7b-4d4e-a242-b676b2d64511 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:08.243101 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00958caf-8943-48ac-afea-cb57e340279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:08.243775 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00958caf-8943-48ac-afea-cb57e340279d admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:08.244056 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00958caf-8943-48ac-afea-cb57e340279d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:08.244327 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00958caf-8943-48ac-afea-cb57e340279d admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:08.245051 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00958caf-8943-48ac-afea-cb57e340279d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:08.246615 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00958caf-8943-48ac-afea-cb57e340279d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:08.257409 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1375/2746] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:20:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:20:08.261454 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1a3f9-81fb-4651-8a36-c7021a18f174 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:08.272430 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1a3f9-81fb-4651-8a36-c7021a18f174 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:08.277614 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280710b0-b086-453a-8aa2-636f1ac2a381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:08.278283 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280710b0-b086-453a-8aa2-636f1ac2a381 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:08.278569 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280710b0-b086-453a-8aa2-636f1ac2a381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:08.278847 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280710b0-b086-453a-8aa2-636f1ac2a381 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:08.279632 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280710b0-b086-453a-8aa2-636f1ac2a381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:08.281245 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280710b0-b086-453a-8aa2-636f1ac2a381 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:08.292545 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1372/2747] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:20:08 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:20:08.296992 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00958caf-8943-48ac-afea-cb57e340279d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:08.307048 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00958caf-8943-48ac-afea-cb57e340279d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:08.311733 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1de7bc-5577-4ec5-b7f1-e12f376b207b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:08.312603 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1de7bc-5577-4ec5-b7f1-e12f376b207b admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:08.312882 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1de7bc-5577-4ec5-b7f1-e12f376b207b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:08.313156 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1de7bc-5577-4ec5-b7f1-e12f376b207b admin admin] PATH_INFO: `/v3/projects/8068470657b040ab9af34219d8935846/users/97e3605d1b0045e48d5836380ce77dc6/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:08.327427 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1de7bc-5577-4ec5-b7f1-e12f376b207b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8068470657b040ab9af34219d8935846, user_id=97e3605d1b0045e48d5836380ce77dc6, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:08.330225 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1de7bc-5577-4ec5-b7f1-e12f376b207b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:08.400422 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1376/2748] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:20:08 2021] PUT /identity/v3/projects/8068470657b040ab9af34219d8935846/users/97e3605d1b0045e48d5836380ce77dc6/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:20:08.407301 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec25e5d-872d-4675-a7a9-af48e5dc192a None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:08.407301 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec25e5d-872d-4675-a7a9-af48e5dc192a None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:08.407301 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec25e5d-872d-4675-a7a9-af48e5dc192a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:08.425331 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-3ec25e5d-872d-4675-a7a9-af48e5dc192a None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:20:08.426528 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-3ec25e5d-872d-4675-a7a9-af48e5dc192a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:08.487272 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1373/2749] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:20:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:20:08.497316 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1de7bc-5577-4ec5-b7f1-e12f376b207b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:08.499384 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-4b1de7bc-5577-4ec5-b7f1-e12f376b207b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:08.557244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1de7bc-5577-4ec5-b7f1-e12f376b207b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:08.560912 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc986da-8144-418b-ac57-13cbbbf1407c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:08.561560 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc986da-8144-418b-ac57-13cbbbf1407c service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:08.561842 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc986da-8144-418b-ac57-13cbbbf1407c service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:08.562120 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc986da-8144-418b-ac57-13cbbbf1407c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:08.571743 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc986da-8144-418b-ac57-13cbbbf1407c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:08.573199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc986da-8144-418b-ac57-13cbbbf1407c service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:08.583116 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1377/2750] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:20:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:20:14.276849 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7957ba4-04f7-452e-bd39-37cd65aa392f None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:14.277331 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7957ba4-04f7-452e-bd39-37cd65aa392f None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:14.277416 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7957ba4-04f7-452e-bd39-37cd65aa392f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:14.305484 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-b7957ba4-04f7-452e-bd39-37cd65aa392f None None] MFA Rules not processed for user `97e3605d1b0045e48d5836380ce77dc6`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:20:14.306715 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-b7957ba4-04f7-452e-bd39-37cd65aa392f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:14.377559 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1374/2751] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:20:14 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:20:14.382731 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc986da-8144-418b-ac57-13cbbbf1407c service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:14.392731 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc986da-8144-418b-ac57-13cbbbf1407c service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:14.398060 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc9a73-962c-45f1-b1bc-e245a7f82039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:14.398707 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc9a73-962c-45f1-b1bc-e245a7f82039 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:14.399011 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc9a73-962c-45f1-b1bc-e245a7f82039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:14.399629 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc9a73-962c-45f1-b1bc-e245a7f82039 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:14.400349 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc9a73-962c-45f1-b1bc-e245a7f82039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:14.402254 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc9a73-962c-45f1-b1bc-e245a7f82039 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:14.486265 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1378/2752] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:20:14 2021] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:20:14.491145 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7957ba4-04f7-452e-bd39-37cd65aa392f None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:14.501916 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7957ba4-04f7-452e-bd39-37cd65aa392f None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:14.559825 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce2349-8161-4ccf-b1cb-d687a43e05f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:14.560495 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce2349-8161-4ccf-b1cb-d687a43e05f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:14.560772 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce2349-8161-4ccf-b1cb-d687a43e05f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:14.561049 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce2349-8161-4ccf-b1cb-d687a43e05f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:14.561778 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce2349-8161-4ccf-b1cb-d687a43e05f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:14.563838 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce2349-8161-4ccf-b1cb-d687a43e05f0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:14.639181 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1375/2753] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:20:14 2021] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:20:14.643254 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc9a73-962c-45f1-b1bc-e245a7f82039 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:14.654094 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc9a73-962c-45f1-b1bc-e245a7f82039 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:14.659442 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e04e72-35d5-4b83-a9ca-97a6e930f94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:14.660180 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e04e72-35d5-4b83-a9ca-97a6e930f94b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:14.660465 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e04e72-35d5-4b83-a9ca-97a6e930f94b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:14.660761 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e04e72-35d5-4b83-a9ca-97a6e930f94b admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:14.662314 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e04e72-35d5-4b83-a9ca-97a6e930f94b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:14.664057 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e04e72-35d5-4b83-a9ca-97a6e930f94b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:14.676454 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1379/2754] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:20:14 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:20:14.681560 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce2349-8161-4ccf-b1cb-d687a43e05f0 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:14.691704 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce2349-8161-4ccf-b1cb-d687a43e05f0 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:14.696703 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b22f8-cc6e-4358-82a1-e10b4f234882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:14.697568 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b22f8-cc6e-4358-82a1-e10b4f234882 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:14.697848 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b22f8-cc6e-4358-82a1-e10b4f234882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:14.698139 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b22f8-cc6e-4358-82a1-e10b4f234882 admin admin] PATH_INFO: `/v3/projects/79306b7f404247ca9a8254321142d89b/users/76e7bda8f0bf456a8c522fded8bd1af4/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:14.713476 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b22f8-cc6e-4358-82a1-e10b4f234882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79306b7f404247ca9a8254321142d89b, user_id=76e7bda8f0bf456a8c522fded8bd1af4, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:14.716193 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b22f8-cc6e-4358-82a1-e10b4f234882 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:14.793840 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1376/2755] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:20:14 2021] PUT /identity/v3/projects/79306b7f404247ca9a8254321142d89b/users/76e7bda8f0bf456a8c522fded8bd1af4/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:20:14.797785 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e04e72-35d5-4b83-a9ca-97a6e930f94b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:14.808320 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e04e72-35d5-4b83-a9ca-97a6e930f94b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:14.864150 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf8629-8bd0-42f6-b49f-88b1fcf13a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:14.864893 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf8629-8bd0-42f6-b49f-88b1fcf13a67 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:14.865771 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf8629-8bd0-42f6-b49f-88b1fcf13a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:14.866140 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf8629-8bd0-42f6-b49f-88b1fcf13a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:14.866788 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf8629-8bd0-42f6-b49f-88b1fcf13a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:14.868453 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf8629-8bd0-42f6-b49f-88b1fcf13a67 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:14.879090 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1380/2756] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:20:14 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:20:14.883317 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b22f8-cc6e-4358-82a1-e10b4f234882 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:14.893788 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b22f8-cc6e-4358-82a1-e10b4f234882 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:14.899192 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a662b-1d58-41f3-8c2d-ade2a11b2b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:14.900372 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a662b-1d58-41f3-8c2d-ade2a11b2b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:14.900716 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a662b-1d58-41f3-8c2d-ade2a11b2b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:14.901086 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a662b-1d58-41f3-8c2d-ade2a11b2b80 admin admin] PATH_INFO: `/v3/projects/79306b7f404247ca9a8254321142d89b/users/76e7bda8f0bf456a8c522fded8bd1af4/roles/3db7012b41944542a50049819500eadd` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:14.903286 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a662b-1d58-41f3-8c2d-ade2a11b2b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79306b7f404247ca9a8254321142d89b, user_id=76e7bda8f0bf456a8c522fded8bd1af4, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:14.906004 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a662b-1d58-41f3-8c2d-ade2a11b2b80 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:14.918510 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1377/2757] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:20:14 2021] PUT /identity/v3/projects/79306b7f404247ca9a8254321142d89b/users/76e7bda8f0bf456a8c522fded8bd1af4/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:20:19.612960 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf8629-8bd0-42f6-b49f-88b1fcf13a67 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:19.711053 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf8629-8bd0-42f6-b49f-88b1fcf13a67 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:19.817334 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4810c9-5f4e-4d25-a32d-b71f55a74d17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:19.821813 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4810c9-5f4e-4d25-a32d-b71f55a74d17 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:19.823704 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4810c9-5f4e-4d25-a32d-b71f55a74d17 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:19.824370 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4810c9-5f4e-4d25-a32d-b71f55a74d17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:19.827769 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-9d4810c9-5f4e-4d25-a32d-b71f55a74d17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:19.848073 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4810c9-5f4e-4d25-a32d-b71f55a74d17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:19.852397 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4810c9-5f4e-4d25-a32d-b71f55a74d17 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:19.866968 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1381/2758] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:20:19 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:20:20.417195 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fb324-b1af-403e-8a0d-d0fabb75a24b None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:20.418230 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fb324-b1af-403e-8a0d-d0fabb75a24b None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:20.419639 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fb324-b1af-403e-8a0d-d0fabb75a24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:20.440945 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-363fb324-b1af-403e-8a0d-d0fabb75a24b None None] MFA Rules not processed for user `b68d0745d9cb49a5bd9331148967764a`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:20:20.442190 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-363fb324-b1af-403e-8a0d-d0fabb75a24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:20.516333 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1378/2759] 10.222.0.54 () {58 vars in 1009 bytes} [Tue Nov 23 04:20:20 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:20:20.535529 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4810c9-5f4e-4d25-a32d-b71f55a74d17 service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:20.539651 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-9d4810c9-5f4e-4d25-a32d-b71f55a74d17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:20.619893 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4810c9-5f4e-4d25-a32d-b71f55a74d17 service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:20.626719 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04faf77-4afe-46d6-a798-2db99eec554c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd439c1f0764f4cac7eb641a485937a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:20.627453 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04faf77-4afe-46d6-a798-2db99eec554c service swift] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:20.627729 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04faf77-4afe-46d6-a798-2db99eec554c service swift] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:20.628011 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04faf77-4afe-46d6-a798-2db99eec554c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:20.643189 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04faf77-4afe-46d6-a798-2db99eec554c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:20.644812 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04faf77-4afe-46d6-a798-2db99eec554c service swift] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:20.655095 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1382/2760] 10.222.0.54 () {60 vars in 1384 bytes} [Tue Nov 23 04:20:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 23 04:20:21.314695 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59974b63-c4b7-48d5-a2f1-34e725685fde None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:21.314905 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59974b63-c4b7-48d5-a2f1-34e725685fde None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:21.315183 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59974b63-c4b7-48d5-a2f1-34e725685fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:21.350090 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-59974b63-c4b7-48d5-a2f1-34e725685fde None None] MFA Rules not processed for user `76e7bda8f0bf456a8c522fded8bd1af4`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:20:21.351699 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-59974b63-c4b7-48d5-a2f1-34e725685fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:21.441967 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1379/2761] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:20:21 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:20:21.452159 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04faf77-4afe-46d6-a798-2db99eec554c service swift] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:21.454767 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-e04faf77-4afe-46d6-a798-2db99eec554c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:21.547892 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04faf77-4afe-46d6-a798-2db99eec554c service swift] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:21.551086 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb6f96-5cf1-4446-8a4f-ce9952fd2f1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:21.551873 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb6f96-5cf1-4446-8a4f-ce9952fd2f1b service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:21.553019 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb6f96-5cf1-4446-8a4f-ce9952fd2f1b service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:21.553538 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb6f96-5cf1-4446-8a4f-ce9952fd2f1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:21.638436 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb6f96-5cf1-4446-8a4f-ce9952fd2f1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:21.640825 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb6f96-5cf1-4446-8a4f-ce9952fd2f1b service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:21.658033 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1383/2762] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:20:21 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:20:21.884078 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ede0a8-0315-4e37-8d23-4b4e4a2ec1b0 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:21.884361 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ede0a8-0315-4e37-8d23-4b4e4a2ec1b0 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:21.884889 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ede0a8-0315-4e37-8d23-4b4e4a2ec1b0 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:21.886823 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1380/2763] 10.222.0.54 () {54 vars in 960 bytes} [Tue Nov 23 04:20:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:20:21.892380 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902c936-7d1d-48d3-aaaf-c982cdba9182 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:21.892669 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902c936-7d1d-48d3-aaaf-c982cdba9182 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:21.892952 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902c936-7d1d-48d3-aaaf-c982cdba9182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:21.985504 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-8902c936-7d1d-48d3-aaaf-c982cdba9182 None None] MFA Rules not processed for user `b23c3a2a6cfd4492b7d8eaa62dacec94`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:20:21.986740 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-8902c936-7d1d-48d3-aaaf-c982cdba9182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:22.124431 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1384/2764] 10.222.0.54 () {58 vars in 1057 bytes} [Tue Nov 23 04:20:21 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:20:22.126639 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ede0a8-0315-4e37-8d23-4b4e4a2ec1b0 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:22.128521 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-19ede0a8-0315-4e37-8d23-4b4e4a2ec1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:22.138761 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902c936-7d1d-48d3-aaaf-c982cdba9182 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:22.151775 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902c936-7d1d-48d3-aaaf-c982cdba9182 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:22.165468 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c961e-ad51-42f7-b56d-3ee4641e8ebb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23c3a2a6cfd4492b7d8eaa62dacec94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:22.166957 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c961e-ad51-42f7-b56d-3ee4641e8ebb service placement] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:22.167477 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c961e-ad51-42f7-b56d-3ee4641e8ebb service placement] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:22.168106 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c961e-ad51-42f7-b56d-3ee4641e8ebb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:22.170895 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-058c961e-ad51-42f7-b56d-3ee4641e8ebb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:22.176575 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ede0a8-0315-4e37-8d23-4b4e4a2ec1b0 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:22.186850 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c961e-ad51-42f7-b56d-3ee4641e8ebb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:22.188412 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c961e-ad51-42f7-b56d-3ee4641e8ebb service placement] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:22.188904 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b4de0-925c-4538-b629-d12046014870 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:22.189556 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b4de0-925c-4538-b629-d12046014870 service nova] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:22.189848 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b4de0-925c-4538-b629-d12046014870 service nova] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:22.190350 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b4de0-925c-4538-b629-d12046014870 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:22.194466 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-b62b4de0-925c-4538-b629-d12046014870 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:22.213304 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1385/2765] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:20:22 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:20:22.215392 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b4de0-925c-4538-b629-d12046014870 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:22.217258 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b4de0-925c-4538-b629-d12046014870 service nova] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:22.230434 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1381/2766] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:20:22 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:20:40.875972 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76babe-fe0d-4b56-99b3-4b33f5d7ce9c None None] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:40.876532 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76babe-fe0d-4b56-99b3-4b33f5d7ce9c None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:40.876629 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76babe-fe0d-4b56-99b3-4b33f5d7ce9c None None] PATH_INFO: `/` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:40.878584 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1386/2767] 10.222.0.54 () {54 vars in 921 bytes} [Tue Nov 23 04:20:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:20:40.884985 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b016b5-cd9a-419e-89f2-b78ca7cbc45e None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:40.885472 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b016b5-cd9a-419e-89f2-b78ca7cbc45e None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:40.885678 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b016b5-cd9a-419e-89f2-b78ca7cbc45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:40.904069 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-d6b016b5-cd9a-419e-89f2-b78ca7cbc45e None None] MFA Rules not processed for user `35e14131fb22470cba63cd5e8db359e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:20:40.905306 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-d6b016b5-cd9a-419e-89f2-b78ca7cbc45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:40.915365 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1382/2768] 10.222.0.54 () {58 vars in 1018 bytes} [Tue Nov 23 04:20:40 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:20:40.929656 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76babe-fe0d-4b56-99b3-4b33f5d7ce9c None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:40.931556 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-aa76babe-fe0d-4b56-99b3-4b33f5d7ce9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:40.985857 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76babe-fe0d-4b56-99b3-4b33f5d7ce9c None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:40.989374 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd822b4-d5c7-4c6e-a7b5-6a7519a422e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f52add52aa4586aee0b801ceffd764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:40.990003 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd822b4-d5c7-4c6e-a7b5-6a7519a422e7 service glance] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:40.990285 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd822b4-d5c7-4c6e-a7b5-6a7519a422e7 service glance] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:40.990560 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd822b4-d5c7-4c6e-a7b5-6a7519a422e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:41.000883 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd822b4-d5c7-4c6e-a7b5-6a7519a422e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:41.002282 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd822b4-d5c7-4c6e-a7b5-6a7519a422e7 service glance] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:41.012660 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1387/2769] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:20:40 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:20:41.221508 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2a845-8e14-4b41-9859-35c969571f72 None None] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:41.221796 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2a845-8e14-4b41-9859-35c969571f72 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:41.222076 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2a845-8e14-4b41-9859-35c969571f72 None None] PATH_INFO: `/` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:41.223910 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1383/2770] 10.222.0.54 () {54 vars in 921 bytes} [Tue Nov 23 04:20:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 04:20:41.229710 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ba5d4-ff22-49fb-84af-87942fef59aa None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:41.230006 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ba5d4-ff22-49fb-84af-87942fef59aa None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:41.230287 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ba5d4-ff22-49fb-84af-87942fef59aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:41.248103 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-a84ba5d4-ff22-49fb-84af-87942fef59aa None None] MFA Rules not processed for user `5c06e29d656f48c99caeb193975b5b91`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:20:41.249248 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-a84ba5d4-ff22-49fb-84af-87942fef59aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:41.255650 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1388/2771] 10.222.0.54 () {58 vars in 1018 bytes} [Tue Nov 23 04:20:41 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:20:41.267971 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2a845-8e14-4b41-9859-35c969571f72 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:41.279454 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2a845-8e14-4b41-9859-35c969571f72 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:41.282962 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5042c-627a-4848-b8ac-fe18fbec128b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:41.283621 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5042c-627a-4848-b8ac-fe18fbec128b service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:41.283901 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5042c-627a-4848-b8ac-fe18fbec128b service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:41.284174 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5042c-627a-4848-b8ac-fe18fbec128b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:41.292108 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5042c-627a-4848-b8ac-fe18fbec128b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:41.293511 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5042c-627a-4848-b8ac-fe18fbec128b service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:41.300928 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1384/2772] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:20:41 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:20:44.183795 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecfd67-8b10-40cd-9b10-4a1c8c50bf6f None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:44.184307 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecfd67-8b10-40cd-9b10-4a1c8c50bf6f None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:44.184418 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecfd67-8b10-40cd-9b10-4a1c8c50bf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:44.203700 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-89ecfd67-8b10-40cd-9b10-4a1c8c50bf6f None None] MFA Rules not processed for user `b68d0745d9cb49a5bd9331148967764a`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:20:44.205188 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-89ecfd67-8b10-40cd-9b10-4a1c8c50bf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:44.213395 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1389/2773] 10.222.0.54 () {58 vars in 1009 bytes} [Tue Nov 23 04:20:44 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:20:44.227085 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5042c-627a-4848-b8ac-fe18fbec128b service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:44.239229 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5042c-627a-4848-b8ac-fe18fbec128b service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:44.245510 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a44657-f954-44f8-8e5d-a70d411703b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd439c1f0764f4cac7eb641a485937a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:44.245876 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a44657-f954-44f8-8e5d-a70d411703b1 service swift] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:44.246239 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a44657-f954-44f8-8e5d-a70d411703b1 service swift] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:44.246493 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a44657-f954-44f8-8e5d-a70d411703b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:44.254845 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a44657-f954-44f8-8e5d-a70d411703b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:44.256625 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a44657-f954-44f8-8e5d-a70d411703b1 service swift] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:44.268467 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1385/2774] 10.222.0.54 () {60 vars in 1384 bytes} [Tue Nov 23 04:20:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 23 04:20:44.298423 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01217c91-1819-48ec-a3b2-37ab1da27bf9 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:44.298715 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01217c91-1819-48ec-a3b2-37ab1da27bf9 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:44.298995 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01217c91-1819-48ec-a3b2-37ab1da27bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:44.316221 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-01217c91-1819-48ec-a3b2-37ab1da27bf9 None None] MFA Rules not processed for user `97e3605d1b0045e48d5836380ce77dc6`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:20:44.317417 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-01217c91-1819-48ec-a3b2-37ab1da27bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:44.325041 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1390/2775] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:20:44 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:20:44.679548 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a44657-f954-44f8-8e5d-a70d411703b1 service swift] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:20:44.679548 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-30a44657-f954-44f8-8e5d-a70d411703b1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:44.700594 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a44657-f954-44f8-8e5d-a70d411703b1 service swift] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:20:44.704508 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeebb07-bea5-443e-9144-40212febba80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:20:44.705161 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeebb07-bea5-443e-9144-40212febba80 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:20:44.705442 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeebb07-bea5-443e-9144-40212febba80 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:20:44.705718 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeebb07-bea5-443e-9144-40212febba80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:20:44.708221 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-eeeebb07-bea5-443e-9144-40212febba80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:20:44.803294 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeebb07-bea5-443e-9144-40212febba80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:20:44.805868 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeebb07-bea5-443e-9144-40212febba80 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:20:44.817320 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1386/2776] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:20:44 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:21:01.634121 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317552af-9e03-48da-9ecd-520d1a13fc5d None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:21:01.634673 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317552af-9e03-48da-9ecd-520d1a13fc5d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:21:01.634673 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317552af-9e03-48da-9ecd-520d1a13fc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:21:01.652889 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-317552af-9e03-48da-9ecd-520d1a13fc5d None None] MFA Rules not processed for user `b68d0745d9cb49a5bd9331148967764a`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:21:01.654076 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-317552af-9e03-48da-9ecd-520d1a13fc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:21:01.661695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1391/2777] 10.222.0.54 () {58 vars in 967 bytes} [Tue Nov 23 04:21:01 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:21:01.685519 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeebb07-bea5-443e-9144-40212febba80 service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:21:01.696802 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeebb07-bea5-443e-9144-40212febba80 service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:21:01.701883 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdac014-5624-42b6-8dd5-0371a3abe472 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bd439c1f0764f4cac7eb641a485937a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:21:01.702510 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdac014-5624-42b6-8dd5-0371a3abe472 service swift] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:21:01.702790 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdac014-5624-42b6-8dd5-0371a3abe472 service swift] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:21:01.703065 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdac014-5624-42b6-8dd5-0371a3abe472 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:21:01.711112 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdac014-5624-42b6-8dd5-0371a3abe472 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:21:01.712729 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdac014-5624-42b6-8dd5-0371a3abe472 service swift] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:21:01.722701 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1387/2778] 10.222.0.54 () {60 vars in 1384 bytes} [Tue Nov 23 04:21:01 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 04:21:10.896106 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317552af-9e03-48da-9ecd-520d1a13fc5d None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:21:10.905442 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317552af-9e03-48da-9ecd-520d1a13fc5d None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:21:10.909046 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c792e-ccef-47da-9e39-b9a2187ee020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:21:10.909687 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c792e-ccef-47da-9e39-b9a2187ee020 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:21:10.909975 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c792e-ccef-47da-9e39-b9a2187ee020 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:21:10.910253 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c792e-ccef-47da-9e39-b9a2187ee020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:21:10.919892 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c792e-ccef-47da-9e39-b9a2187ee020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:21:10.921302 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c792e-ccef-47da-9e39-b9a2187ee020 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:21:10.930353 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1392/2779] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:21:10 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:21:45.484503 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdac014-5624-42b6-8dd5-0371a3abe472 service swift] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:21:45.493612 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdac014-5624-42b6-8dd5-0371a3abe472 service swift] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:21:45.497408 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059edf2-a1fa-4f7e-b02d-d96b6e780e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:21:45.498616 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059edf2-a1fa-4f7e-b02d-d96b6e780e9e service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:21:45.498909 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059edf2-a1fa-4f7e-b02d-d96b6e780e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:21:45.499190 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059edf2-a1fa-4f7e-b02d-d96b6e780e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:21:45.501020 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-f059edf2-a1fa-4f7e-b02d-d96b6e780e9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:21:45.563316 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059edf2-a1fa-4f7e-b02d-d96b6e780e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:21:45.564743 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059edf2-a1fa-4f7e-b02d-d96b6e780e9e service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:21:45.574289 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1388/2780] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:21:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:21:49.150832 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c792e-ccef-47da-9e39-b9a2187ee020 service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:21:49.152265 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-db6c792e-ccef-47da-9e39-b9a2187ee020 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:21:49.166536 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c792e-ccef-47da-9e39-b9a2187ee020 service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:21:49.171227 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6e473-5b89-4dcb-a18e-53eb3dcb9ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:21:49.172080 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6e473-5b89-4dcb-a18e-53eb3dcb9ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:21:49.172855 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6e473-5b89-4dcb-a18e-53eb3dcb9ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:21:49.173164 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6e473-5b89-4dcb-a18e-53eb3dcb9ed5 admin admin] PATH_INFO: `/v3/users/1009c9c7798f48f6ad891766711d0c0f` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:21:49.174475 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c6e473-5b89-4dcb-a18e-53eb3dcb9ed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1009c9c7798f48f6ad891766711d0c0f)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:21:49.176449 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c6e473-5b89-4dcb-a18e-53eb3dcb9ed5 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:21:49.387326 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a6c6e473-5b89-4dcb-a18e-53eb3dcb9ed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1009c9c7798f48f6ad891766711d0c0f'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:21:49.471132 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a6c6e473-5b89-4dcb-a18e-53eb3dcb9ed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1009c9c7798f48f6ad891766711d0c0f'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:21:49.478141 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a6c6e473-5b89-4dcb-a18e-53eb3dcb9ed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1009c9c7798f48f6ad891766711d0c0f'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:21:49.478781 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a6c6e473-5b89-4dcb-a18e-53eb3dcb9ed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1009c9c7798f48f6ad891766711d0c0f'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:21:49.490769 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a6c6e473-5b89-4dcb-a18e-53eb3dcb9ed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1009c9c7798f48f6ad891766711d0c0f'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:21:49.496887 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1393/2781] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:21:49 2021] DELETE /identity/v3/users/1009c9c7798f48f6ad891766711d0c0f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:21:49.736598 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059edf2-a1fa-4f7e-b02d-d96b6e780e9e service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:21:49.746498 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059edf2-a1fa-4f7e-b02d-d96b6e780e9e service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:21:49.815081 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f527690-b757-452a-b8e7-3394f2ca9434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:21:49.815970 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f527690-b757-452a-b8e7-3394f2ca9434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:21:49.816257 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f527690-b757-452a-b8e7-3394f2ca9434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:21:49.816536 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f527690-b757-452a-b8e7-3394f2ca9434 admin admin] PATH_INFO: `/v3/projects/891dccdfaeb440dd89a185b6d130b3f0` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:21:49.817767 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f527690-b757-452a-b8e7-3394f2ca9434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=891dccdfaeb440dd89a185b6d130b3f0)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:21:49.820588 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f527690-b757-452a-b8e7-3394f2ca9434 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:21:49.917936 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-3f527690-b757-452a-b8e7-3394f2ca9434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '891dccdfaeb440dd89a185b6d130b3f0', 'request_id': 'req-3f527690-b757-452a-b8e7-3394f2ca9434'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:21:49.924607 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-3f527690-b757-452a-b8e7-3394f2ca9434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '891dccdfaeb440dd89a185b6d130b3f0', 'request_id': 'req-3f527690-b757-452a-b8e7-3394f2ca9434'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:21:49.929785 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-3f527690-b757-452a-b8e7-3394f2ca9434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '891dccdfaeb440dd89a185b6d130b3f0', 'request_id': 'req-3f527690-b757-452a-b8e7-3394f2ca9434'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:21:50.013123 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-3f527690-b757-452a-b8e7-3394f2ca9434 admin admin] The token cache is being invalidate because project 891dccdfaeb440dd89a185b6d130b3f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:21:50.013414 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-3f527690-b757-452a-b8e7-3394f2ca9434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:21:50.014022 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-3f527690-b757-452a-b8e7-3394f2ca9434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:21:50.015570 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1389/2782] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:21:49 2021] DELETE /identity/v3/projects/891dccdfaeb440dd89a185b6d130b3f0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:21:50.021887 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61257639-3bdf-4c3e-82f1-dbd26cac8acc None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:21:50.022178 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61257639-3bdf-4c3e-82f1-dbd26cac8acc None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:21:50.022458 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61257639-3bdf-4c3e-82f1-dbd26cac8acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:21:50.041440 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-61257639-3bdf-4c3e-82f1-dbd26cac8acc None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:21:50.042656 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-61257639-3bdf-4c3e-82f1-dbd26cac8acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:21:50.098932 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1394/2783] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:21:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:21:50.107117 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d1503-afd9-48e7-9db6-7a6048eeb90c None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:21:50.107435 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d1503-afd9-48e7-9db6-7a6048eeb90c None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:21:50.107716 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d1503-afd9-48e7-9db6-7a6048eeb90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:21:50.125463 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-bd4d1503-afd9-48e7-9db6-7a6048eeb90c None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:21:50.126649 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-bd4d1503-afd9-48e7-9db6-7a6048eeb90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:21:50.134911 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1390/2784] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:21:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:21:50.138874 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61257639-3bdf-4c3e-82f1-dbd26cac8acc None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:21:50.148771 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61257639-3bdf-4c3e-82f1-dbd26cac8acc None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:21:50.153325 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71849cba-4933-4c52-a0b7-7aa9e97c1b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:21:50.153971 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71849cba-4933-4c52-a0b7-7aa9e97c1b45 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:21:50.154254 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71849cba-4933-4c52-a0b7-7aa9e97c1b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:21:50.154533 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71849cba-4933-4c52-a0b7-7aa9e97c1b45 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:21:50.155288 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71849cba-4933-4c52-a0b7-7aa9e97c1b45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:21:50.155597 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71849cba-4933-4c52-a0b7-7aa9e97c1b45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:21:50.157199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71849cba-4933-4c52-a0b7-7aa9e97c1b45 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:21:50.169771 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1395/2785] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:21:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 04:21:50.174057 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d1503-afd9-48e7-9db6-7a6048eeb90c None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:21:50.183158 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d1503-afd9-48e7-9db6-7a6048eeb90c None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:21:50.187848 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44547d72-e43d-4639-8fe8-3a17d0feda98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:21:50.188493 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44547d72-e43d-4639-8fe8-3a17d0feda98 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:21:50.188780 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44547d72-e43d-4639-8fe8-3a17d0feda98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:21:50.189064 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44547d72-e43d-4639-8fe8-3a17d0feda98 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:21:50.189857 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44547d72-e43d-4639-8fe8-3a17d0feda98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:21:50.191777 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44547d72-e43d-4639-8fe8-3a17d0feda98 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:21:50.277664 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1391/2786] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:21:50 2021] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:21:50.281740 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71849cba-4933-4c52-a0b7-7aa9e97c1b45 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:21:50.292693 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71849cba-4933-4c52-a0b7-7aa9e97c1b45 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:21:50.351521 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb661e-c8bc-423a-bb0f-dfd8223db2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:21:50.352188 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb661e-c8bc-423a-bb0f-dfd8223db2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:21:50.352475 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb661e-c8bc-423a-bb0f-dfd8223db2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:21:50.352752 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb661e-c8bc-423a-bb0f-dfd8223db2c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:21:50.353471 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb661e-c8bc-423a-bb0f-dfd8223db2c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:21:50.355381 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb661e-c8bc-423a-bb0f-dfd8223db2c6 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:21:50.454387 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1396/2787] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:21:50 2021] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:21:50.459467 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44547d72-e43d-4639-8fe8-3a17d0feda98 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:21:50.469541 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44547d72-e43d-4639-8fe8-3a17d0feda98 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:21:50.474584 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f0196-b6d0-4f13-baec-8dc3eb743b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:21:50.475269 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f0196-b6d0-4f13-baec-8dc3eb743b91 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:21:50.475554 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f0196-b6d0-4f13-baec-8dc3eb743b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:21:50.475831 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f0196-b6d0-4f13-baec-8dc3eb743b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:21:50.476570 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f0196-b6d0-4f13-baec-8dc3eb743b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:21:50.478148 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f0196-b6d0-4f13-baec-8dc3eb743b91 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:21:50.488263 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1392/2788] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:21:50 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:21:50.492260 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb661e-c8bc-423a-bb0f-dfd8223db2c6 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:21:50.502881 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb661e-c8bc-423a-bb0f-dfd8223db2c6 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:21:50.507814 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecf053-2ef7-42ab-b9c5-a867193201e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:21:50.508468 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecf053-2ef7-42ab-b9c5-a867193201e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:21:50.508785 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecf053-2ef7-42ab-b9c5-a867193201e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:21:50.509069 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecf053-2ef7-42ab-b9c5-a867193201e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:21:50.509810 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cecf053-2ef7-42ab-b9c5-a867193201e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:21:50.511418 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cecf053-2ef7-42ab-b9c5-a867193201e2 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:21:50.522157 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1397/2789] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:21:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:21:50.526316 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f0196-b6d0-4f13-baec-8dc3eb743b91 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:21:50.536867 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f0196-b6d0-4f13-baec-8dc3eb743b91 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:21:50.541579 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda0a20-18ce-4c1c-8619-8fa517160c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:21:50.542444 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda0a20-18ce-4c1c-8619-8fa517160c8f admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:21:50.542724 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda0a20-18ce-4c1c-8619-8fa517160c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:21:50.542997 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda0a20-18ce-4c1c-8619-8fa517160c8f admin admin] PATH_INFO: `/v3/projects/ed6fa4f03d864e43be8dc7eec4c89213/users/ca8923a30e7b4b6b9b3c2eef472c2117/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:21:50.558140 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda0a20-18ce-4c1c-8619-8fa517160c8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed6fa4f03d864e43be8dc7eec4c89213, user_id=ca8923a30e7b4b6b9b3c2eef472c2117, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:21:50.561127 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda0a20-18ce-4c1c-8619-8fa517160c8f admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:21:50.626289 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1393/2790] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:21:50 2021] PUT /identity/v3/projects/ed6fa4f03d864e43be8dc7eec4c89213/users/ca8923a30e7b4b6b9b3c2eef472c2117/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:21:50.632630 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a450f-ce98-4ecd-89cc-ff478de4277a None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:21:50.632919 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a450f-ce98-4ecd-89cc-ff478de4277a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:21:50.633203 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a450f-ce98-4ecd-89cc-ff478de4277a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:21:50.653709 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-783a450f-ce98-4ecd-89cc-ff478de4277a None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:21:50.654989 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-783a450f-ce98-4ecd-89cc-ff478de4277a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:21:50.722715 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1398/2791] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:21:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:21:50.732897 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda0a20-18ce-4c1c-8619-8fa517160c8f admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:21:50.734688 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-8fda0a20-18ce-4c1c-8619-8fa517160c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:21:50.800064 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda0a20-18ce-4c1c-8619-8fa517160c8f admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:21:50.803649 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad11b2-ea4b-433b-9ebf-cc8aeb5b98a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:21:50.804733 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad11b2-ea4b-433b-9ebf-cc8aeb5b98a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:21:50.804733 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad11b2-ea4b-433b-9ebf-cc8aeb5b98a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:21:50.804964 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad11b2-ea4b-433b-9ebf-cc8aeb5b98a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:21:50.814540 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad11b2-ea4b-433b-9ebf-cc8aeb5b98a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:21:50.816508 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad11b2-ea4b-433b-9ebf-cc8aeb5b98a8 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:21:50.830264 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1394/2792] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:21:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:21:56.181939 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb7272-96fe-43d3-bbef-bc6ab591d722 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:21:56.182525 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb7272-96fe-43d3-bbef-bc6ab591d722 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:21:56.182525 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb7272-96fe-43d3-bbef-bc6ab591d722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:21:56.210391 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-42eb7272-96fe-43d3-bbef-bc6ab591d722 None None] MFA Rules not processed for user `ca8923a30e7b4b6b9b3c2eef472c2117`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:21:56.211651 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-42eb7272-96fe-43d3-bbef-bc6ab591d722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:21:56.277261 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1399/2793] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:21:56 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:21:56.291345 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad11b2-ea4b-433b-9ebf-cc8aeb5b98a8 service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:21:56.292856 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-14ad11b2-ea4b-433b-9ebf-cc8aeb5b98a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:21:56.368908 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad11b2-ea4b-433b-9ebf-cc8aeb5b98a8 service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:21:56.374273 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2366150-46eb-45bd-9063-37e01b1700d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:21:56.374921 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2366150-46eb-45bd-9063-37e01b1700d9 service nova] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:21:56.375203 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2366150-46eb-45bd-9063-37e01b1700d9 service nova] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:21:56.375506 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2366150-46eb-45bd-9063-37e01b1700d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:21:56.384727 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2366150-46eb-45bd-9063-37e01b1700d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:21:56.386308 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2366150-46eb-45bd-9063-37e01b1700d9 service nova] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:21:56.396110 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1395/2794] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:21:56 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:21:59.260681 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909ad00-431e-42fd-bbc5-f3159b10be3a None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:21:59.261667 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909ad00-431e-42fd-bbc5-f3159b10be3a None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:21:59.262018 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909ad00-431e-42fd-bbc5-f3159b10be3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:21:59.281141 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-1909ad00-431e-42fd-bbc5-f3159b10be3a None None] MFA Rules not processed for user `ca8923a30e7b4b6b9b3c2eef472c2117`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:21:59.282345 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-1909ad00-431e-42fd-bbc5-f3159b10be3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:21:59.290354 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1400/2795] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:21:59 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:21:59.597912 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2366150-46eb-45bd-9063-37e01b1700d9 service nova] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:21:59.599355 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c2366150-46eb-45bd-9063-37e01b1700d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:21:59.611066 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2366150-46eb-45bd-9063-37e01b1700d9 service nova] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:21:59.615394 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a0ac3-f24a-41cc-8d61-c2f3c3e09aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:21:59.616018 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a0ac3-f24a-41cc-8d61-c2f3c3e09aca service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:21:59.616301 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a0ac3-f24a-41cc-8d61-c2f3c3e09aca service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:21:59.616576 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a0ac3-f24a-41cc-8d61-c2f3c3e09aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:21:59.618284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-922a0ac3-f24a-41cc-8d61-c2f3c3e09aca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:21:59.627800 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a0ac3-f24a-41cc-8d61-c2f3c3e09aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:21:59.629218 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a0ac3-f24a-41cc-8d61-c2f3c3e09aca service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:21:59.637073 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1396/2796] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:21:59 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:22:58.170909 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909ad00-431e-42fd-bbc5-f3159b10be3a None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:22:58.172417 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-1909ad00-431e-42fd-bbc5-f3159b10be3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:22:58.240688 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909ad00-431e-42fd-bbc5-f3159b10be3a None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:22:58.245939 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5848f-84f4-460d-b16f-af68e3e2e782 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23c3a2a6cfd4492b7d8eaa62dacec94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:22:58.246679 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5848f-84f4-460d-b16f-af68e3e2e782 service placement] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:22:58.246960 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5848f-84f4-460d-b16f-af68e3e2e782 service placement] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:22:58.247267 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5848f-84f4-460d-b16f-af68e3e2e782 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:22:58.249030 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-94a5848f-84f4-460d-b16f-af68e3e2e782 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:22:58.260774 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5848f-84f4-460d-b16f-af68e3e2e782 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:22:58.267004 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5848f-84f4-460d-b16f-af68e3e2e782 service placement] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:22:58.272827 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1401/2797] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:22:58 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:22:59.801153 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a0ac3-f24a-41cc-8d61-c2f3c3e09aca service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:22:59.809791 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a0ac3-f24a-41cc-8d61-c2f3c3e09aca service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:22:59.813432 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f9577-d0f1-4111-9288-51ff5d083b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:22:59.814066 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f9577-d0f1-4111-9288-51ff5d083b09 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:22:59.814349 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f9577-d0f1-4111-9288-51ff5d083b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:22:59.814624 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f9577-d0f1-4111-9288-51ff5d083b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:22:59.816413 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-295f9577-d0f1-4111-9288-51ff5d083b09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:22:59.826837 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f9577-d0f1-4111-9288-51ff5d083b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:22:59.828304 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f9577-d0f1-4111-9288-51ff5d083b09 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:22:59.837405 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1397/2798] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:22:59 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:23:15.112887 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de73bd-1230-4e1b-bc64-ecb378896fd8 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:23:15.113410 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de73bd-1230-4e1b-bc64-ecb378896fd8 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:23:15.113532 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de73bd-1230-4e1b-bc64-ecb378896fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:23:15.133723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-26de73bd-1230-4e1b-bc64-ecb378896fd8 None None] MFA Rules not processed for user `97e3605d1b0045e48d5836380ce77dc6`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:23:15.134924 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-26de73bd-1230-4e1b-bc64-ecb378896fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:23:15.194277 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1402/2799] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:23:15 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:24:16.181642 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f9577-d0f1-4111-9288-51ff5d083b09 service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:24:16.190349 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f9577-d0f1-4111-9288-51ff5d083b09 service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:24:16.194131 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81db09-16bc-4057-9f3e-72980407da54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:24:16.194761 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81db09-16bc-4057-9f3e-72980407da54 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:24:16.195045 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81db09-16bc-4057-9f3e-72980407da54 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:24:16.195355 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81db09-16bc-4057-9f3e-72980407da54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:24:16.197125 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-8c81db09-16bc-4057-9f3e-72980407da54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:24:16.210994 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81db09-16bc-4057-9f3e-72980407da54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:24:16.212444 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81db09-16bc-4057-9f3e-72980407da54 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:24:16.223514 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1398/2800] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:24:16 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:24:36.635420 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de73bd-1230-4e1b-bc64-ecb378896fd8 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:24:36.644853 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de73bd-1230-4e1b-bc64-ecb378896fd8 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:24:36.648441 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a05a1-07ee-4283-87f9-e84c3a596325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:24:36.649140 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a05a1-07ee-4283-87f9-e84c3a596325 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:24:36.649422 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a05a1-07ee-4283-87f9-e84c3a596325 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:24:36.649696 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a05a1-07ee-4283-87f9-e84c3a596325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:24:36.651642 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-837a05a1-07ee-4283-87f9-e84c3a596325 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:24:36.666610 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a05a1-07ee-4283-87f9-e84c3a596325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:24:36.668372 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a05a1-07ee-4283-87f9-e84c3a596325 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:24:36.684967 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1403/2801] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:24:36 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:24:41.599318 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81db09-16bc-4057-9f3e-72980407da54 service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:24:41.608545 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81db09-16bc-4057-9f3e-72980407da54 service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:24:41.612174 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d3e54-8f18-478c-b3c0-ab628c63866a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:24:41.613653 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d3e54-8f18-478c-b3c0-ab628c63866a service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:24:41.613653 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d3e54-8f18-478c-b3c0-ab628c63866a service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:24:41.613653 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d3e54-8f18-478c-b3c0-ab628c63866a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:24:41.615372 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-5d5d3e54-8f18-478c-b3c0-ab628c63866a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:24:41.628437 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d3e54-8f18-478c-b3c0-ab628c63866a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:24:41.629847 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d3e54-8f18-478c-b3c0-ab628c63866a service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:24:41.639703 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1399/2802] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:24:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:24:48.582047 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a05a1-07ee-4283-87f9-e84c3a596325 service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:24:48.583540 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-837a05a1-07ee-4283-87f9-e84c3a596325 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:24:48.596760 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a05a1-07ee-4283-87f9-e84c3a596325 service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:24:48.601315 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e02bd8-330a-4a26-80ba-ec7c9491e2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:24:48.602670 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e02bd8-330a-4a26-80ba-ec7c9491e2ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:24:48.602948 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e02bd8-330a-4a26-80ba-ec7c9491e2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:24:48.603238 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e02bd8-330a-4a26-80ba-ec7c9491e2ff admin admin] PATH_INFO: `/v3/users/153a38363b5c4a2588ee3d43b8475342` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:24:48.604429 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e02bd8-330a-4a26-80ba-ec7c9491e2ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=153a38363b5c4a2588ee3d43b8475342)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:24:48.606301 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e02bd8-330a-4a26-80ba-ec7c9491e2ff admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:24:48.749051 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d3e02bd8-330a-4a26-80ba-ec7c9491e2ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '153a38363b5c4a2588ee3d43b8475342'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:24:48.810338 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d3e02bd8-330a-4a26-80ba-ec7c9491e2ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '153a38363b5c4a2588ee3d43b8475342'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:24:48.817485 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d3e02bd8-330a-4a26-80ba-ec7c9491e2ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '153a38363b5c4a2588ee3d43b8475342'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:24:48.818112 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d3e02bd8-330a-4a26-80ba-ec7c9491e2ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '153a38363b5c4a2588ee3d43b8475342'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:24:48.829724 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d3e02bd8-330a-4a26-80ba-ec7c9491e2ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '153a38363b5c4a2588ee3d43b8475342'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:24:48.835300 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1404/2803] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:24:48 2021] DELETE /identity/v3/users/153a38363b5c4a2588ee3d43b8475342 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:24:49.093150 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d3e54-8f18-478c-b3c0-ab628c63866a service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:24:49.107007 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d3e54-8f18-478c-b3c0-ab628c63866a service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:24:49.159818 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a45266-9167-47bf-8f7c-2cf0e303850b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:24:49.160666 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a45266-9167-47bf-8f7c-2cf0e303850b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:24:49.160943 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a45266-9167-47bf-8f7c-2cf0e303850b admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:24:49.161214 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a45266-9167-47bf-8f7c-2cf0e303850b admin admin] PATH_INFO: `/v3/projects/29832a113f1544d7a5467a88b2f0d669` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:24:49.162418 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a45266-9167-47bf-8f7c-2cf0e303850b admin admin] RBAC: Authorizing `identity:delete_project(project_id=29832a113f1544d7a5467a88b2f0d669)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:24:49.164338 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a45266-9167-47bf-8f7c-2cf0e303850b admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:24:49.295850 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-42a45266-9167-47bf-8f7c-2cf0e303850b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29832a113f1544d7a5467a88b2f0d669', 'request_id': 'req-42a45266-9167-47bf-8f7c-2cf0e303850b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:24:49.301956 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-42a45266-9167-47bf-8f7c-2cf0e303850b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29832a113f1544d7a5467a88b2f0d669', 'request_id': 'req-42a45266-9167-47bf-8f7c-2cf0e303850b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:24:49.307682 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-42a45266-9167-47bf-8f7c-2cf0e303850b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29832a113f1544d7a5467a88b2f0d669', 'request_id': 'req-42a45266-9167-47bf-8f7c-2cf0e303850b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:24:49.387416 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-42a45266-9167-47bf-8f7c-2cf0e303850b admin admin] The token cache is being invalidate because project 29832a113f1544d7a5467a88b2f0d669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:24:49.387635 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-42a45266-9167-47bf-8f7c-2cf0e303850b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:24:49.388266 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-42a45266-9167-47bf-8f7c-2cf0e303850b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:24:49.389863 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1400/2804] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:24:49 2021] DELETE /identity/v3/projects/29832a113f1544d7a5467a88b2f0d669 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:24:49.394033 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e02bd8-330a-4a26-80ba-ec7c9491e2ff admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:24:49.395466 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-d3e02bd8-330a-4a26-80ba-ec7c9491e2ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:24:49.409020 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e02bd8-330a-4a26-80ba-ec7c9491e2ff admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:24:49.462837 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c6bfc-a265-4767-b9eb-9b8bffbd0479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:24:49.463729 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c6bfc-a265-4767-b9eb-9b8bffbd0479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:24:49.464016 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c6bfc-a265-4767-b9eb-9b8bffbd0479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:24:49.464293 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c6bfc-a265-4767-b9eb-9b8bffbd0479 admin admin] PATH_INFO: `/v3/users/2630d2fbb16e4c828de25aaf5d844f26` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:24:49.465479 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c6bfc-a265-4767-b9eb-9b8bffbd0479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2630d2fbb16e4c828de25aaf5d844f26)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:24:49.467409 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c6bfc-a265-4767-b9eb-9b8bffbd0479 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:24:49.629361 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2e4c6bfc-a265-4767-b9eb-9b8bffbd0479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2630d2fbb16e4c828de25aaf5d844f26'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:24:49.690214 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2e4c6bfc-a265-4767-b9eb-9b8bffbd0479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2630d2fbb16e4c828de25aaf5d844f26'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:24:49.698086 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2e4c6bfc-a265-4767-b9eb-9b8bffbd0479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2630d2fbb16e4c828de25aaf5d844f26'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:24:49.698695 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2e4c6bfc-a265-4767-b9eb-9b8bffbd0479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2630d2fbb16e4c828de25aaf5d844f26'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:24:49.709969 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-2e4c6bfc-a265-4767-b9eb-9b8bffbd0479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2630d2fbb16e4c828de25aaf5d844f26'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:24:49.716043 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1405/2805] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:24:49 2021] DELETE /identity/v3/users/2630d2fbb16e4c828de25aaf5d844f26 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:24:49.972973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a45266-9167-47bf-8f7c-2cf0e303850b admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:24:49.974448 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-42a45266-9167-47bf-8f7c-2cf0e303850b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:24:49.990674 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a45266-9167-47bf-8f7c-2cf0e303850b admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:24:50.050714 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862fa0f-75a5-4764-b794-701ba3351254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:24:50.051606 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862fa0f-75a5-4764-b794-701ba3351254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:24:50.051898 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862fa0f-75a5-4764-b794-701ba3351254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:24:50.052174 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862fa0f-75a5-4764-b794-701ba3351254 admin admin] PATH_INFO: `/v3/projects/60710a74836d4b22b1ab65670b7a47b3` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:24:50.053498 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862fa0f-75a5-4764-b794-701ba3351254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60710a74836d4b22b1ab65670b7a47b3)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:24:50.055497 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862fa0f-75a5-4764-b794-701ba3351254 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:24:50.160062 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0862fa0f-75a5-4764-b794-701ba3351254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60710a74836d4b22b1ab65670b7a47b3', 'request_id': 'req-0862fa0f-75a5-4764-b794-701ba3351254'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:24:50.166151 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0862fa0f-75a5-4764-b794-701ba3351254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60710a74836d4b22b1ab65670b7a47b3', 'request_id': 'req-0862fa0f-75a5-4764-b794-701ba3351254'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:24:50.171435 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0862fa0f-75a5-4764-b794-701ba3351254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60710a74836d4b22b1ab65670b7a47b3', 'request_id': 'req-0862fa0f-75a5-4764-b794-701ba3351254'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:24:50.284632 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0862fa0f-75a5-4764-b794-701ba3351254 admin admin] The token cache is being invalidate because project 60710a74836d4b22b1ab65670b7a47b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:24:50.285037 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0862fa0f-75a5-4764-b794-701ba3351254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:24:50.285674 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-0862fa0f-75a5-4764-b794-701ba3351254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:24:50.287200 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1401/2806] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:24:49 2021] DELETE /identity/v3/projects/60710a74836d4b22b1ab65670b7a47b3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:24:53.478936 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c6bfc-a265-4767-b9eb-9b8bffbd0479 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:24:53.480334 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-2e4c6bfc-a265-4767-b9eb-9b8bffbd0479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:24:53.556039 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c6bfc-a265-4767-b9eb-9b8bffbd0479 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:24:53.626008 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42081b-11b2-41c8-93d8-8af026539a48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:24:53.626793 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42081b-11b2-41c8-93d8-8af026539a48 service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:24:53.627135 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42081b-11b2-41c8-93d8-8af026539a48 service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:24:53.629522 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42081b-11b2-41c8-93d8-8af026539a48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:24:53.629522 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-ed42081b-11b2-41c8-93d8-8af026539a48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:24:53.644820 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42081b-11b2-41c8-93d8-8af026539a48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:24:53.646480 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42081b-11b2-41c8-93d8-8af026539a48 service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:24:53.659082 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1406/2807] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:24:53 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:24:58.472093 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17406a44-dd49-4446-a019-91890c9b31b4 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:24:58.472620 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17406a44-dd49-4446-a019-91890c9b31b4 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:24:58.472620 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17406a44-dd49-4446-a019-91890c9b31b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:24:58.490447 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-17406a44-dd49-4446-a019-91890c9b31b4 None None] MFA Rules not processed for user `ca8923a30e7b4b6b9b3c2eef472c2117`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:24:58.491622 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-17406a44-dd49-4446-a019-91890c9b31b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:24:58.545221 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1402/2808] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:24:58 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:25:02.209455 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42081b-11b2-41c8-93d8-8af026539a48 service nova] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:25:02.211409 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-ed42081b-11b2-41c8-93d8-8af026539a48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:25:02.268804 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42081b-11b2-41c8-93d8-8af026539a48 service nova] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:25:02.272518 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae60f16-06d7-4116-b253-f9bbc1ecaf9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:25:02.273182 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae60f16-06d7-4116-b253-f9bbc1ecaf9d service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:25:02.273470 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae60f16-06d7-4116-b253-f9bbc1ecaf9d service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:25:02.273751 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae60f16-06d7-4116-b253-f9bbc1ecaf9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:25:02.276690 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-0ae60f16-06d7-4116-b253-f9bbc1ecaf9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:25:02.287038 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae60f16-06d7-4116-b253-f9bbc1ecaf9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:25:02.288551 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae60f16-06d7-4116-b253-f9bbc1ecaf9d service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:25:02.297381 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1407/2809] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:25:02 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:25:14.921738 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b445b-2b61-44f4-9930-76b899c5f103 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:25:14.922251 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b445b-2b61-44f4-9930-76b899c5f103 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:25:14.922360 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b445b-2b61-44f4-9930-76b899c5f103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:25:14.941061 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-c12b445b-2b61-44f4-9930-76b899c5f103 None None] MFA Rules not processed for user `97e3605d1b0045e48d5836380ce77dc6`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:25:14.942342 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c12b445b-2b61-44f4-9930-76b899c5f103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:25:15.000271 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1403/2810] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:25:14 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:25:21.026205 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae60f16-06d7-4116-b253-f9bbc1ecaf9d service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:25:21.027807 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-0ae60f16-06d7-4116-b253-f9bbc1ecaf9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:25:21.043689 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae60f16-06d7-4116-b253-f9bbc1ecaf9d service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:25:21.049241 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e514f82-0621-418d-9920-15b4bbc3b588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:25:21.049895 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e514f82-0621-418d-9920-15b4bbc3b588 service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:25:21.050310 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e514f82-0621-418d-9920-15b4bbc3b588 service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:25:21.050624 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e514f82-0621-418d-9920-15b4bbc3b588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:25:21.052522 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-7e514f82-0621-418d-9920-15b4bbc3b588 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:25:21.064083 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e514f82-0621-418d-9920-15b4bbc3b588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:25:21.065655 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e514f82-0621-418d-9920-15b4bbc3b588 service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:25:21.075274 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1408/2811] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:25:21 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:25:32.593724 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b445b-2b61-44f4-9930-76b899c5f103 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:25:32.606083 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b445b-2b61-44f4-9930-76b899c5f103 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:25:32.611723 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c0db9-2ab6-4a25-86f2-789e6ff6df44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:25:32.612359 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c0db9-2ab6-4a25-86f2-789e6ff6df44 service nova] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:25:32.612639 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c0db9-2ab6-4a25-86f2-789e6ff6df44 service nova] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:25:32.612904 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c0db9-2ab6-4a25-86f2-789e6ff6df44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:25:32.614659 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-5b3c0db9-2ab6-4a25-86f2-789e6ff6df44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:25:32.626467 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c0db9-2ab6-4a25-86f2-789e6ff6df44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:25:32.628051 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c0db9-2ab6-4a25-86f2-789e6ff6df44 service nova] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:25:32.638190 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1404/2812] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:25:32 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:26:34.261621 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e514f82-0621-418d-9920-15b4bbc3b588 service nova] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:34.263089 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-7e514f82-0621-418d-9920-15b4bbc3b588 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:26:34.325876 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e514f82-0621-418d-9920-15b4bbc3b588 service nova] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:34.330370 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4415890-f2f5-4d3c-aa52-a7f312db72f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:34.331324 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4415890-f2f5-4d3c-aa52-a7f312db72f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:34.331613 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4415890-f2f5-4d3c-aa52-a7f312db72f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:34.331891 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4415890-f2f5-4d3c-aa52-a7f312db72f3 admin admin] PATH_INFO: `/v3/users/ca8923a30e7b4b6b9b3c2eef472c2117` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:34.333121 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4415890-f2f5-4d3c-aa52-a7f312db72f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca8923a30e7b4b6b9b3c2eef472c2117)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:34.335003 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4415890-f2f5-4d3c-aa52-a7f312db72f3 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:34.473980 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d4415890-f2f5-4d3c-aa52-a7f312db72f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca8923a30e7b4b6b9b3c2eef472c2117'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:34.522917 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d4415890-f2f5-4d3c-aa52-a7f312db72f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca8923a30e7b4b6b9b3c2eef472c2117'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:34.530178 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d4415890-f2f5-4d3c-aa52-a7f312db72f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca8923a30e7b4b6b9b3c2eef472c2117'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:34.530832 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d4415890-f2f5-4d3c-aa52-a7f312db72f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca8923a30e7b4b6b9b3c2eef472c2117'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:34.542809 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-d4415890-f2f5-4d3c-aa52-a7f312db72f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca8923a30e7b4b6b9b3c2eef472c2117'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:34.548626 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1409/2813] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:26:34 2021] DELETE /identity/v3/users/ca8923a30e7b4b6b9b3c2eef472c2117 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:26:34.759516 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c0db9-2ab6-4a25-86f2-789e6ff6df44 service nova] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:34.772905 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c0db9-2ab6-4a25-86f2-789e6ff6df44 service nova] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:34.826989 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812049da-1dee-4b18-be9e-0a72260efcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:34.827938 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812049da-1dee-4b18-be9e-0a72260efcb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:34.828220 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812049da-1dee-4b18-be9e-0a72260efcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:34.828494 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812049da-1dee-4b18-be9e-0a72260efcb3 admin admin] PATH_INFO: `/v3/projects/ed6fa4f03d864e43be8dc7eec4c89213` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:34.829693 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812049da-1dee-4b18-be9e-0a72260efcb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed6fa4f03d864e43be8dc7eec4c89213)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:34.832292 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812049da-1dee-4b18-be9e-0a72260efcb3 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:34.961910 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-812049da-1dee-4b18-be9e-0a72260efcb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed6fa4f03d864e43be8dc7eec4c89213', 'request_id': 'req-812049da-1dee-4b18-be9e-0a72260efcb3'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:34.967982 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-812049da-1dee-4b18-be9e-0a72260efcb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed6fa4f03d864e43be8dc7eec4c89213', 'request_id': 'req-812049da-1dee-4b18-be9e-0a72260efcb3'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:34.973331 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-812049da-1dee-4b18-be9e-0a72260efcb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed6fa4f03d864e43be8dc7eec4c89213', 'request_id': 'req-812049da-1dee-4b18-be9e-0a72260efcb3'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:35.058847 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-812049da-1dee-4b18-be9e-0a72260efcb3 admin admin] The token cache is being invalidate because project ed6fa4f03d864e43be8dc7eec4c89213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:26:35.059063 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-812049da-1dee-4b18-be9e-0a72260efcb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:35.059699 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-812049da-1dee-4b18-be9e-0a72260efcb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:35.061487 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1405/2814] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:26:34 2021] DELETE /identity/v3/projects/ed6fa4f03d864e43be8dc7eec4c89213 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:26:35.067793 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910e7e0-bc24-43cb-9dfd-709188b7fda0 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:35.068727 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910e7e0-bc24-43cb-9dfd-709188b7fda0 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:35.069007 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910e7e0-bc24-43cb-9dfd-709188b7fda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:35.098576 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-6910e7e0-bc24-43cb-9dfd-709188b7fda0 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:26:35.099851 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-6910e7e0-bc24-43cb-9dfd-709188b7fda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:26:35.197213 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1410/2815] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:26:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:26:35.205269 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa2d76-24c8-45e2-9acf-c5e0c59769b4 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:35.205557 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa2d76-24c8-45e2-9acf-c5e0c59769b4 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:35.205858 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa2d76-24c8-45e2-9acf-c5e0c59769b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:35.223362 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-a5fa2d76-24c8-45e2-9acf-c5e0c59769b4 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:26:35.224619 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-a5fa2d76-24c8-45e2-9acf-c5e0c59769b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:26:35.232484 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1406/2816] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:26:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:26:35.236564 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910e7e0-bc24-43cb-9dfd-709188b7fda0 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:35.246368 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910e7e0-bc24-43cb-9dfd-709188b7fda0 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:35.250794 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714c46b-6291-4e18-8a00-2f81b614724a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:35.251469 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714c46b-6291-4e18-8a00-2f81b614724a admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:35.251750 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714c46b-6291-4e18-8a00-2f81b614724a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:35.252074 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714c46b-6291-4e18-8a00-2f81b614724a admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:35.252802 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714c46b-6291-4e18-8a00-2f81b614724a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:26:35.253106 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714c46b-6291-4e18-8a00-2f81b614724a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:35.255296 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714c46b-6291-4e18-8a00-2f81b614724a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:35.266395 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1411/2817] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:26:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:26:35.270922 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa2d76-24c8-45e2-9acf-c5e0c59769b4 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:35.280234 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa2d76-24c8-45e2-9acf-c5e0c59769b4 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:35.284896 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2221706-cbde-4459-bb70-ffa6a1a974c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:35.285584 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2221706-cbde-4459-bb70-ffa6a1a974c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:35.285817 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2221706-cbde-4459-bb70-ffa6a1a974c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:35.286183 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2221706-cbde-4459-bb70-ffa6a1a974c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:35.286882 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2221706-cbde-4459-bb70-ffa6a1a974c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:35.288800 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2221706-cbde-4459-bb70-ffa6a1a974c2 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:35.364667 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1407/2818] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:26:35 2021] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:26:35.368482 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714c46b-6291-4e18-8a00-2f81b614724a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:35.378101 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714c46b-6291-4e18-8a00-2f81b614724a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:35.432457 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928588d-9259-4630-bd4a-bffcb3eb985a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:35.433114 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928588d-9259-4630-bd4a-bffcb3eb985a admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:35.433405 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928588d-9259-4630-bd4a-bffcb3eb985a admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:35.433678 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928588d-9259-4630-bd4a-bffcb3eb985a admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:35.434379 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928588d-9259-4630-bd4a-bffcb3eb985a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:35.436294 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928588d-9259-4630-bd4a-bffcb3eb985a admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:35.505992 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1412/2819] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:26:35 2021] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:26:35.510061 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2221706-cbde-4459-bb70-ffa6a1a974c2 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:35.520461 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2221706-cbde-4459-bb70-ffa6a1a974c2 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:35.525028 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cd3c4-4798-45bc-be94-690be6fad3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:35.525665 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cd3c4-4798-45bc-be94-690be6fad3db admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:35.525945 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cd3c4-4798-45bc-be94-690be6fad3db admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:35.526217 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cd3c4-4798-45bc-be94-690be6fad3db admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:35.526943 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5cd3c4-4798-45bc-be94-690be6fad3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:35.528532 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5cd3c4-4798-45bc-be94-690be6fad3db admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:35.539342 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1408/2820] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:26:35 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:26:35.543158 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928588d-9259-4630-bd4a-bffcb3eb985a admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:35.553463 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928588d-9259-4630-bd4a-bffcb3eb985a admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:35.558026 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15af9a-407f-4a04-9a74-87a6585b790f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:35.558670 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15af9a-407f-4a04-9a74-87a6585b790f admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:35.558955 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15af9a-407f-4a04-9a74-87a6585b790f admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:35.559251 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15af9a-407f-4a04-9a74-87a6585b790f admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:35.559988 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15af9a-407f-4a04-9a74-87a6585b790f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:35.561547 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15af9a-407f-4a04-9a74-87a6585b790f admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:35.571790 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1413/2821] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:26:35 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:26:35.575664 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cd3c4-4798-45bc-be94-690be6fad3db admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:35.585603 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cd3c4-4798-45bc-be94-690be6fad3db admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:35.590117 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95429ddd-7e9e-4136-90d2-d3c7caba21e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:35.591701 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95429ddd-7e9e-4136-90d2-d3c7caba21e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:35.591701 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95429ddd-7e9e-4136-90d2-d3c7caba21e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:35.591701 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95429ddd-7e9e-4136-90d2-d3c7caba21e0 admin admin] PATH_INFO: `/v3/projects/583d0ff4304d486283221548b385794c/users/75c8e5b844844a058983044c13f403e7/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:35.606014 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95429ddd-7e9e-4136-90d2-d3c7caba21e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=583d0ff4304d486283221548b385794c, user_id=75c8e5b844844a058983044c13f403e7, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:35.608791 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95429ddd-7e9e-4136-90d2-d3c7caba21e0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:35.677472 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1409/2822] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:26:35 2021] PUT /identity/v3/projects/583d0ff4304d486283221548b385794c/users/75c8e5b844844a058983044c13f403e7/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:26:35.687682 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd33b0-4759-4639-9d53-8af90216c551 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:35.687975 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd33b0-4759-4639-9d53-8af90216c551 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:35.688257 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd33b0-4759-4639-9d53-8af90216c551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:35.713993 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-f5fd33b0-4759-4639-9d53-8af90216c551 None None] MFA Rules not processed for user `75c8e5b844844a058983044c13f403e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:26:35.715194 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-f5fd33b0-4759-4639-9d53-8af90216c551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:26:35.775314 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1414/2823] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:26:35 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:26:35.787438 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95429ddd-7e9e-4136-90d2-d3c7caba21e0 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:35.789094 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-95429ddd-7e9e-4136-90d2-d3c7caba21e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:26:35.874683 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95429ddd-7e9e-4136-90d2-d3c7caba21e0 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:35.880284 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce0fca-a429-4822-aab6-4d8f1eb1dbea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:35.880924 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce0fca-a429-4822-aab6-4d8f1eb1dbea service nova] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:35.881208 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce0fca-a429-4822-aab6-4d8f1eb1dbea service nova] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:35.881484 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce0fca-a429-4822-aab6-4d8f1eb1dbea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:35.889102 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce0fca-a429-4822-aab6-4d8f1eb1dbea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:35.890661 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce0fca-a429-4822-aab6-4d8f1eb1dbea service nova] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:35.899785 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1410/2824] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:26:35 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:26:44.916531 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd33b0-4759-4639-9d53-8af90216c551 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:44.976253 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd33b0-4759-4639-9d53-8af90216c551 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:44.980816 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f022de-b64f-4707-a6a9-3a17cdc88e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:44.981679 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f022de-b64f-4707-a6a9-3a17cdc88e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:44.981961 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f022de-b64f-4707-a6a9-3a17cdc88e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:44.982263 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f022de-b64f-4707-a6a9-3a17cdc88e71 admin admin] PATH_INFO: `/v3/users/75c8e5b844844a058983044c13f403e7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:44.983490 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f022de-b64f-4707-a6a9-3a17cdc88e71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75c8e5b844844a058983044c13f403e7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:44.985447 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f022de-b64f-4707-a6a9-3a17cdc88e71 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:45.123610 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-06f022de-b64f-4707-a6a9-3a17cdc88e71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75c8e5b844844a058983044c13f403e7'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:45.179813 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-06f022de-b64f-4707-a6a9-3a17cdc88e71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75c8e5b844844a058983044c13f403e7'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:45.187276 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-06f022de-b64f-4707-a6a9-3a17cdc88e71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75c8e5b844844a058983044c13f403e7'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:45.188038 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-06f022de-b64f-4707-a6a9-3a17cdc88e71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75c8e5b844844a058983044c13f403e7'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:45.199965 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-06f022de-b64f-4707-a6a9-3a17cdc88e71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75c8e5b844844a058983044c13f403e7'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:45.205708 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1415/2825] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:26:44 2021] DELETE /identity/v3/users/75c8e5b844844a058983044c13f403e7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:26:45.211085 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46c101-8e80-441a-ad8a-f6715fcfca69 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:45.211608 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46c101-8e80-441a-ad8a-f6715fcfca69 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:45.211705 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46c101-8e80-441a-ad8a-f6715fcfca69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:45.236721 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-ac46c101-8e80-441a-ad8a-f6715fcfca69 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:26:45.237918 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-ac46c101-8e80-441a-ad8a-f6715fcfca69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:26:45.295161 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1411/2826] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:26:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:26:45.305216 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f022de-b64f-4707-a6a9-3a17cdc88e71 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:45.306622 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-06f022de-b64f-4707-a6a9-3a17cdc88e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:26:45.383314 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f022de-b64f-4707-a6a9-3a17cdc88e71 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:45.387108 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451acc0-cd33-4ad2-a84c-a6bf9ec9d0b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:45.387771 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451acc0-cd33-4ad2-a84c-a6bf9ec9d0b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:45.395746 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451acc0-cd33-4ad2-a84c-a6bf9ec9d0b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:45.395746 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451acc0-cd33-4ad2-a84c-a6bf9ec9d0b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:45.397756 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451acc0-cd33-4ad2-a84c-a6bf9ec9d0b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:45.399162 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451acc0-cd33-4ad2-a84c-a6bf9ec9d0b2 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:45.408677 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1416/2827] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:26:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 04:26:45.747453 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46c101-8e80-441a-ad8a-f6715fcfca69 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:45.749044 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-ac46c101-8e80-441a-ad8a-f6715fcfca69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:26:45.761181 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46c101-8e80-441a-ad8a-f6715fcfca69 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:45.767828 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4245ec-7c76-4385-8d68-8d5794859a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:45.768678 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4245ec-7c76-4385-8d68-8d5794859a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:45.768960 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4245ec-7c76-4385-8d68-8d5794859a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:45.769236 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4245ec-7c76-4385-8d68-8d5794859a38 admin admin] PATH_INFO: `/v3/projects/583d0ff4304d486283221548b385794c` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:45.770467 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4245ec-7c76-4385-8d68-8d5794859a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=583d0ff4304d486283221548b385794c)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:45.773183 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4245ec-7c76-4385-8d68-8d5794859a38 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:45.864776 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8a4245ec-7c76-4385-8d68-8d5794859a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '583d0ff4304d486283221548b385794c', 'request_id': 'req-8a4245ec-7c76-4385-8d68-8d5794859a38'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:45.870788 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8a4245ec-7c76-4385-8d68-8d5794859a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '583d0ff4304d486283221548b385794c', 'request_id': 'req-8a4245ec-7c76-4385-8d68-8d5794859a38'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:45.876264 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8a4245ec-7c76-4385-8d68-8d5794859a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '583d0ff4304d486283221548b385794c', 'request_id': 'req-8a4245ec-7c76-4385-8d68-8d5794859a38'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:45.938898 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8a4245ec-7c76-4385-8d68-8d5794859a38 admin admin] The token cache is being invalidate because project 583d0ff4304d486283221548b385794c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:26:45.939181 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8a4245ec-7c76-4385-8d68-8d5794859a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:45.939871 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8a4245ec-7c76-4385-8d68-8d5794859a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:45.941431 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1412/2828] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:26:45 2021] DELETE /identity/v3/projects/583d0ff4304d486283221548b385794c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:26:45.947756 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e5b24-2ecb-4e53-9d23-d316ea4c27ae None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:45.948187 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e5b24-2ecb-4e53-9d23-d316ea4c27ae None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:45.948328 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e5b24-2ecb-4e53-9d23-d316ea4c27ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:45.984597 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-6b8e5b24-2ecb-4e53-9d23-d316ea4c27ae None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:26:45.985777 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-6b8e5b24-2ecb-4e53-9d23-d316ea4c27ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:26:46.042496 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1417/2829] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:26:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:26:46.051117 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b7563-15bb-4f3e-84c5-ac8ee56663c5 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:46.051478 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b7563-15bb-4f3e-84c5-ac8ee56663c5 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:46.051770 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b7563-15bb-4f3e-84c5-ac8ee56663c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:46.070243 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-9b6b7563-15bb-4f3e-84c5-ac8ee56663c5 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:26:46.071463 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-9b6b7563-15bb-4f3e-84c5-ac8ee56663c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:26:46.079382 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1413/2830] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:26:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:26:46.083676 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e5b24-2ecb-4e53-9d23-d316ea4c27ae None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:46.094326 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e5b24-2ecb-4e53-9d23-d316ea4c27ae None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:46.098907 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aed5be-596b-41f8-8a73-db50466650e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:46.100956 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aed5be-596b-41f8-8a73-db50466650e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:46.100956 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aed5be-596b-41f8-8a73-db50466650e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:46.100956 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aed5be-596b-41f8-8a73-db50466650e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:46.101253 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aed5be-596b-41f8-8a73-db50466650e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:26:46.101999 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aed5be-596b-41f8-8a73-db50466650e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:46.103615 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aed5be-596b-41f8-8a73-db50466650e0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:46.115052 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1418/2831] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:26:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 04:26:46.119529 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b7563-15bb-4f3e-84c5-ac8ee56663c5 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:46.128755 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b7563-15bb-4f3e-84c5-ac8ee56663c5 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:46.135626 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a297d7d-07d9-42fd-ac48-7dbce940a617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:46.136257 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a297d7d-07d9-42fd-ac48-7dbce940a617 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:46.136535 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a297d7d-07d9-42fd-ac48-7dbce940a617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:46.137155 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a297d7d-07d9-42fd-ac48-7dbce940a617 admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:46.137866 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a297d7d-07d9-42fd-ac48-7dbce940a617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:46.139859 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a297d7d-07d9-42fd-ac48-7dbce940a617 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:46.266453 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1414/2832] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:26:46 2021] POST /identity/v3/projects => generated 399 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:26:46.270370 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aed5be-596b-41f8-8a73-db50466650e0 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:46.281058 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aed5be-596b-41f8-8a73-db50466650e0 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:46.337280 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27614d2d-2612-4f57-8021-19b32f0aac33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:46.337853 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27614d2d-2612-4f57-8021-19b32f0aac33 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:46.338134 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27614d2d-2612-4f57-8021-19b32f0aac33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:46.338412 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27614d2d-2612-4f57-8021-19b32f0aac33 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:46.339100 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27614d2d-2612-4f57-8021-19b32f0aac33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:46.341004 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27614d2d-2612-4f57-8021-19b32f0aac33 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:46.439275 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1419/2833] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:26:46 2021] POST /identity/v3/users => generated 300 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 04:26:46.441365 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a297d7d-07d9-42fd-ac48-7dbce940a617 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:46.452670 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a297d7d-07d9-42fd-ac48-7dbce940a617 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:46.457530 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fd017-2cee-4603-a416-9608334c21fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:46.458238 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fd017-2cee-4603-a416-9608334c21fd admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:46.458524 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fd017-2cee-4603-a416-9608334c21fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:46.458808 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fd017-2cee-4603-a416-9608334c21fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:46.459611 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fd017-2cee-4603-a416-9608334c21fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:46.461197 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fd017-2cee-4603-a416-9608334c21fd admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:46.471949 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1415/2834] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:26:46 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:26:46.476147 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27614d2d-2612-4f57-8021-19b32f0aac33 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:46.486035 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27614d2d-2612-4f57-8021-19b32f0aac33 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:46.491747 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15649613-6362-4883-a389-fc2e55cfbffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:46.492425 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15649613-6362-4883-a389-fc2e55cfbffb admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:46.492691 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15649613-6362-4883-a389-fc2e55cfbffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:46.492970 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15649613-6362-4883-a389-fc2e55cfbffb admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:46.493704 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15649613-6362-4883-a389-fc2e55cfbffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:46.495306 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15649613-6362-4883-a389-fc2e55cfbffb admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:46.505224 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1420/2835] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:26:46 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:26:46.510318 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fd017-2cee-4603-a416-9608334c21fd admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:46.521039 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fd017-2cee-4603-a416-9608334c21fd admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:46.525836 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc79b97-a5af-438c-a5a7-86823c8a7e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:46.526732 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc79b97-a5af-438c-a5a7-86823c8a7e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:46.527013 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc79b97-a5af-438c-a5a7-86823c8a7e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:46.527317 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc79b97-a5af-438c-a5a7-86823c8a7e4c admin admin] PATH_INFO: `/v3/projects/345b06e27c5f400e8b5ab63d0006bb8f/users/cc33841a50974994acf61eb617bb54cb/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:46.541709 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc79b97-a5af-438c-a5a7-86823c8a7e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=345b06e27c5f400e8b5ab63d0006bb8f, user_id=cc33841a50974994acf61eb617bb54cb, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:46.544490 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc79b97-a5af-438c-a5a7-86823c8a7e4c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:46.625913 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1416/2836] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:26:46 2021] PUT /identity/v3/projects/345b06e27c5f400e8b5ab63d0006bb8f/users/cc33841a50974994acf61eb617bb54cb/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:26:46.636671 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788321f5-584d-4c2f-90a5-84ef2407b36e None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:46.636959 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788321f5-584d-4c2f-90a5-84ef2407b36e None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:46.637242 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788321f5-584d-4c2f-90a5-84ef2407b36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:46.663460 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-788321f5-584d-4c2f-90a5-84ef2407b36e None None] MFA Rules not processed for user `cc33841a50974994acf61eb617bb54cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:26:46.664657 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-788321f5-584d-4c2f-90a5-84ef2407b36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:26:46.727390 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1421/2837] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:26:46 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:26:46.731861 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc79b97-a5af-438c-a5a7-86823c8a7e4c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:46.791968 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc79b97-a5af-438c-a5a7-86823c8a7e4c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:46.796558 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f006a1-72c2-48c9-82d3-beb07de5a70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:46.797202 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f006a1-72c2-48c9-82d3-beb07de5a70c admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:46.797484 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f006a1-72c2-48c9-82d3-beb07de5a70c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:46.797755 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f006a1-72c2-48c9-82d3-beb07de5a70c admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:46.798446 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f006a1-72c2-48c9-82d3-beb07de5a70c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:46.800341 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f006a1-72c2-48c9-82d3-beb07de5a70c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:46.877878 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1417/2838] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:26:46 2021] POST /identity/v3/projects => generated 401 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:26:46.882015 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788321f5-584d-4c2f-90a5-84ef2407b36e None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:46.892347 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788321f5-584d-4c2f-90a5-84ef2407b36e None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:46.945813 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2ee9a-696e-4939-a567-5fa42586b047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:46.946459 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2ee9a-696e-4939-a567-5fa42586b047 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:46.946739 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2ee9a-696e-4939-a567-5fa42586b047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:46.947008 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2ee9a-696e-4939-a567-5fa42586b047 admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:46.947741 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2ee9a-696e-4939-a567-5fa42586b047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:46.949620 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2ee9a-696e-4939-a567-5fa42586b047 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:47.026093 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1422/2839] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:26:46 2021] POST /identity/v3/users => generated 307 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:26:47.030351 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f006a1-72c2-48c9-82d3-beb07de5a70c admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:47.041338 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f006a1-72c2-48c9-82d3-beb07de5a70c admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:47.045914 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0249f7-f844-4783-896e-6ae8dc7c07a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:47.046556 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0249f7-f844-4783-896e-6ae8dc7c07a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:47.046835 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0249f7-f844-4783-896e-6ae8dc7c07a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:47.047108 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0249f7-f844-4783-896e-6ae8dc7c07a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:47.047868 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0249f7-f844-4783-896e-6ae8dc7c07a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:47.049428 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0249f7-f844-4783-896e-6ae8dc7c07a0 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:47.059787 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1418/2840] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:26:47 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:26:47.063888 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2ee9a-696e-4939-a567-5fa42586b047 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:47.073721 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2ee9a-696e-4939-a567-5fa42586b047 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:47.078317 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09776d5-1c7c-4df2-9f3c-d713fe34be2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:47.079184 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09776d5-1c7c-4df2-9f3c-d713fe34be2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:47.079499 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09776d5-1c7c-4df2-9f3c-d713fe34be2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:47.079773 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09776d5-1c7c-4df2-9f3c-d713fe34be2d admin admin] PATH_INFO: `/v3/projects/cd1a6b29a797430aa38a1961448dffaa/users/5012aa5191de4c079a15d2e9833a60fd/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:47.094860 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09776d5-1c7c-4df2-9f3c-d713fe34be2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd1a6b29a797430aa38a1961448dffaa, user_id=5012aa5191de4c079a15d2e9833a60fd, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:47.097542 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09776d5-1c7c-4df2-9f3c-d713fe34be2d admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:47.144989 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1423/2841] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:26:47 2021] PUT /identity/v3/projects/cd1a6b29a797430aa38a1961448dffaa/users/5012aa5191de4c079a15d2e9833a60fd/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:26:47.149361 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0249f7-f844-4783-896e-6ae8dc7c07a0 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:47.159325 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0249f7-f844-4783-896e-6ae8dc7c07a0 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:47.213217 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c42f7-7ab4-4f6f-9814-3a193facf8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:47.213903 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c42f7-7ab4-4f6f-9814-3a193facf8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:47.214187 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c42f7-7ab4-4f6f-9814-3a193facf8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:47.214464 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c42f7-7ab4-4f6f-9814-3a193facf8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:47.215204 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c42f7-7ab4-4f6f-9814-3a193facf8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:47.216819 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c42f7-7ab4-4f6f-9814-3a193facf8a5 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:47.227618 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1419/2842] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:26:47 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:26:47.231789 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09776d5-1c7c-4df2-9f3c-d713fe34be2d admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:47.242216 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09776d5-1c7c-4df2-9f3c-d713fe34be2d admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:47.246780 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a77357-366f-43cc-bc6d-4805cc33ab58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:47.247681 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a77357-366f-43cc-bc6d-4805cc33ab58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:47.247964 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a77357-366f-43cc-bc6d-4805cc33ab58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:47.248242 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a77357-366f-43cc-bc6d-4805cc33ab58 admin admin] PATH_INFO: `/v3/projects/cd1a6b29a797430aa38a1961448dffaa/users/5012aa5191de4c079a15d2e9833a60fd/roles/3db7012b41944542a50049819500eadd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:47.250189 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a77357-366f-43cc-bc6d-4805cc33ab58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd1a6b29a797430aa38a1961448dffaa, user_id=5012aa5191de4c079a15d2e9833a60fd, role_id=3db7012b41944542a50049819500eadd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:47.252823 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a77357-366f-43cc-bc6d-4805cc33ab58 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:47.262893 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1424/2843] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:26:47 2021] PUT /identity/v3/projects/cd1a6b29a797430aa38a1961448dffaa/users/5012aa5191de4c079a15d2e9833a60fd/roles/3db7012b41944542a50049819500eadd => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:26:47.273452 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46276453-cb83-415c-b97c-23706091a000 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:47.273966 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46276453-cb83-415c-b97c-23706091a000 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:47.274065 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46276453-cb83-415c-b97c-23706091a000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:47.300422 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-46276453-cb83-415c-b97c-23706091a000 None None] MFA Rules not processed for user `5012aa5191de4c079a15d2e9833a60fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:26:47.301613 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-46276453-cb83-415c-b97c-23706091a000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:26:47.366837 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1420/2844] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:26:47 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:26:47.376531 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a77357-366f-43cc-bc6d-4805cc33ab58 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:47.378208 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-69a77357-366f-43cc-bc6d-4805cc33ab58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:26:47.435384 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a77357-366f-43cc-bc6d-4805cc33ab58 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:47.438857 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764cec5-7bae-47c7-9051-c57f9bd808fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:47.439524 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764cec5-7bae-47c7-9051-c57f9bd808fc service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:47.439812 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764cec5-7bae-47c7-9051-c57f9bd808fc service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:47.440098 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764cec5-7bae-47c7-9051-c57f9bd808fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:47.450004 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764cec5-7bae-47c7-9051-c57f9bd808fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:47.451466 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764cec5-7bae-47c7-9051-c57f9bd808fc service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:47.461647 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1425/2845] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:26:47 2021] GET /identity/v3/auth/tokens => generated 3335 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:26:47.622413 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46276453-cb83-415c-b97c-23706091a000 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:47.632373 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46276453-cb83-415c-b97c-23706091a000 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:47.635868 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8342583-85e4-4bbc-9fd1-c7fe3f054b3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:47.636490 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8342583-85e4-4bbc-9fd1-c7fe3f054b3e service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:47.636768 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8342583-85e4-4bbc-9fd1-c7fe3f054b3e service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:47.637040 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8342583-85e4-4bbc-9fd1-c7fe3f054b3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:47.691366 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8342583-85e4-4bbc-9fd1-c7fe3f054b3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:47.692768 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8342583-85e4-4bbc-9fd1-c7fe3f054b3e service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:47.701913 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1421/2846] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:26:47 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:26:52.609033 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764cec5-7bae-47c7-9051-c57f9bd808fc service cinder] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:52.669614 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764cec5-7bae-47c7-9051-c57f9bd808fc service cinder] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:52.674175 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be3843-d606-421f-bd25-fbfa8194dc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:52.675041 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be3843-d606-421f-bd25-fbfa8194dc2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:52.675355 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be3843-d606-421f-bd25-fbfa8194dc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:52.675635 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be3843-d606-421f-bd25-fbfa8194dc2b admin admin] PATH_INFO: `/v3/users/cc33841a50974994acf61eb617bb54cb` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:52.676841 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be3843-d606-421f-bd25-fbfa8194dc2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc33841a50974994acf61eb617bb54cb)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:52.678929 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be3843-d606-421f-bd25-fbfa8194dc2b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:52.843625 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-05be3843-d606-421f-bd25-fbfa8194dc2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc33841a50974994acf61eb617bb54cb'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:52.905024 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-05be3843-d606-421f-bd25-fbfa8194dc2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc33841a50974994acf61eb617bb54cb'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:52.911918 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-05be3843-d606-421f-bd25-fbfa8194dc2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc33841a50974994acf61eb617bb54cb'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:52.912564 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-05be3843-d606-421f-bd25-fbfa8194dc2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc33841a50974994acf61eb617bb54cb'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:52.923903 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-05be3843-d606-421f-bd25-fbfa8194dc2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc33841a50974994acf61eb617bb54cb'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:52.930126 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1426/2847] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:26:52 2021] DELETE /identity/v3/users/cc33841a50974994acf61eb617bb54cb => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:26:52.934738 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88393ff2-99c5-4b4d-97da-8cf758198b24 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:52.935197 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88393ff2-99c5-4b4d-97da-8cf758198b24 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:52.935346 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88393ff2-99c5-4b4d-97da-8cf758198b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:52.952693 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-88393ff2-99c5-4b4d-97da-8cf758198b24 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:26:52.953886 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-88393ff2-99c5-4b4d-97da-8cf758198b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:26:53.021378 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1422/2848] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:26:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:26:53.033107 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be3843-d606-421f-bd25-fbfa8194dc2b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:53.034512 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-05be3843-d606-421f-bd25-fbfa8194dc2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:26:53.089483 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be3843-d606-421f-bd25-fbfa8194dc2b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:53.093126 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5399fb0-352d-45ce-9534-96bb951b3d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:53.093808 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5399fb0-352d-45ce-9534-96bb951b3d78 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:53.094119 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5399fb0-352d-45ce-9534-96bb951b3d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:53.094393 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5399fb0-352d-45ce-9534-96bb951b3d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:53.103939 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5399fb0-352d-45ce-9534-96bb951b3d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:53.105371 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5399fb0-352d-45ce-9534-96bb951b3d78 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:53.114882 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1427/2849] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:26:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:26:53.535734 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88393ff2-99c5-4b4d-97da-8cf758198b24 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:53.537310 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-88393ff2-99c5-4b4d-97da-8cf758198b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:26:53.549775 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88393ff2-99c5-4b4d-97da-8cf758198b24 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:53.554344 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e4ac5-0dd4-4858-b876-ae1d8577bd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:53.555268 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e4ac5-0dd4-4858-b876-ae1d8577bd2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:53.555586 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e4ac5-0dd4-4858-b876-ae1d8577bd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:53.555828 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e4ac5-0dd4-4858-b876-ae1d8577bd2a admin admin] PATH_INFO: `/v3/projects/345b06e27c5f400e8b5ab63d0006bb8f` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:53.557079 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e4ac5-0dd4-4858-b876-ae1d8577bd2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=345b06e27c5f400e8b5ab63d0006bb8f)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:53.558988 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e4ac5-0dd4-4858-b876-ae1d8577bd2a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:53.671430 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-6f1e4ac5-0dd4-4858-b876-ae1d8577bd2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '345b06e27c5f400e8b5ab63d0006bb8f', 'request_id': 'req-6f1e4ac5-0dd4-4858-b876-ae1d8577bd2a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:53.677601 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-6f1e4ac5-0dd4-4858-b876-ae1d8577bd2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '345b06e27c5f400e8b5ab63d0006bb8f', 'request_id': 'req-6f1e4ac5-0dd4-4858-b876-ae1d8577bd2a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:53.683312 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-6f1e4ac5-0dd4-4858-b876-ae1d8577bd2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '345b06e27c5f400e8b5ab63d0006bb8f', 'request_id': 'req-6f1e4ac5-0dd4-4858-b876-ae1d8577bd2a'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:53.756076 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-6f1e4ac5-0dd4-4858-b876-ae1d8577bd2a admin admin] The token cache is being invalidate because project 345b06e27c5f400e8b5ab63d0006bb8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:26:53.756385 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-6f1e4ac5-0dd4-4858-b876-ae1d8577bd2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:53.757000 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-6f1e4ac5-0dd4-4858-b876-ae1d8577bd2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:53.758551 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1423/2850] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:26:53 2021] DELETE /identity/v3/projects/345b06e27c5f400e8b5ab63d0006bb8f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:26:53.762472 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5399fb0-352d-45ce-9534-96bb951b3d78 service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:53.772029 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5399fb0-352d-45ce-9534-96bb951b3d78 service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:53.827665 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a159b-19ee-4401-9882-247118366f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:53.828519 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a159b-19ee-4401-9882-247118366f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:53.828798 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a159b-19ee-4401-9882-247118366f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:53.829072 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a159b-19ee-4401-9882-247118366f84 admin admin] PATH_INFO: `/v3/users/5012aa5191de4c079a15d2e9833a60fd` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:53.830411 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a159b-19ee-4401-9882-247118366f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5012aa5191de4c079a15d2e9833a60fd)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:53.832370 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a159b-19ee-4401-9882-247118366f84 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:54.038074 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-6a2a159b-19ee-4401-9882-247118366f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5012aa5191de4c079a15d2e9833a60fd'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:54.104254 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-6a2a159b-19ee-4401-9882-247118366f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5012aa5191de4c079a15d2e9833a60fd'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:54.111361 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-6a2a159b-19ee-4401-9882-247118366f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5012aa5191de4c079a15d2e9833a60fd'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:54.112013 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-6a2a159b-19ee-4401-9882-247118366f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5012aa5191de4c079a15d2e9833a60fd'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:54.123245 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-6a2a159b-19ee-4401-9882-247118366f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5012aa5191de4c079a15d2e9833a60fd'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:54.129074 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1428/2851] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:26:53 2021] DELETE /identity/v3/users/5012aa5191de4c079a15d2e9833a60fd => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:26:54.535557 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e4ac5-0dd4-4858-b876-ae1d8577bd2a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:54.537079 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-6f1e4ac5-0dd4-4858-b876-ae1d8577bd2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:26:54.552136 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e4ac5-0dd4-4858-b876-ae1d8577bd2a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:54.610833 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd2620-0582-4815-99ef-f38e33539b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:54.611722 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd2620-0582-4815-99ef-f38e33539b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:54.612004 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd2620-0582-4815-99ef-f38e33539b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:54.612282 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd2620-0582-4815-99ef-f38e33539b91 admin admin] PATH_INFO: `/v3/projects/cd1a6b29a797430aa38a1961448dffaa` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:54.613508 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd2620-0582-4815-99ef-f38e33539b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd1a6b29a797430aa38a1961448dffaa)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:54.615457 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd2620-0582-4815-99ef-f38e33539b91 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:54.699172 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8ddd2620-0582-4815-99ef-f38e33539b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd1a6b29a797430aa38a1961448dffaa', 'request_id': 'req-8ddd2620-0582-4815-99ef-f38e33539b91'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:54.705382 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8ddd2620-0582-4815-99ef-f38e33539b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd1a6b29a797430aa38a1961448dffaa', 'request_id': 'req-8ddd2620-0582-4815-99ef-f38e33539b91'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:54.710918 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8ddd2620-0582-4815-99ef-f38e33539b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd1a6b29a797430aa38a1961448dffaa', 'request_id': 'req-8ddd2620-0582-4815-99ef-f38e33539b91'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:54.755787 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8ddd2620-0582-4815-99ef-f38e33539b91 admin admin] The token cache is being invalidate because project cd1a6b29a797430aa38a1961448dffaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:26:54.756075 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8ddd2620-0582-4815-99ef-f38e33539b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:54.756706 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-8ddd2620-0582-4815-99ef-f38e33539b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:26:54.758226 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1424/2852] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:26:54 2021] DELETE /identity/v3/projects/cd1a6b29a797430aa38a1961448dffaa => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:26:54.766058 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb912d20-5ba7-42da-bebe-723118c8f26d None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:54.766569 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb912d20-5ba7-42da-bebe-723118c8f26d None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:54.766700 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb912d20-5ba7-42da-bebe-723118c8f26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:54.798617 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-fb912d20-5ba7-42da-bebe-723118c8f26d None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:26:54.798617 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-fb912d20-5ba7-42da-bebe-723118c8f26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:26:54.855058 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1429/2853] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:26:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:26:54.863131 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697a02a-7255-476d-945a-3d30a0ad88ff None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:54.863450 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697a02a-7255-476d-945a-3d30a0ad88ff None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:54.863732 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697a02a-7255-476d-945a-3d30a0ad88ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:54.882327 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-b697a02a-7255-476d-945a-3d30a0ad88ff None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:26:54.883577 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-b697a02a-7255-476d-945a-3d30a0ad88ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:26:54.891276 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1425/2854] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:26:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:26:54.895388 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb912d20-5ba7-42da-bebe-723118c8f26d None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:54.905664 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb912d20-5ba7-42da-bebe-723118c8f26d None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:54.910219 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cf327-0f8b-4384-9eb2-3eca3e1efd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:54.910873 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cf327-0f8b-4384-9eb2-3eca3e1efd4b admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:54.911155 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cf327-0f8b-4384-9eb2-3eca3e1efd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:54.911462 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cf327-0f8b-4384-9eb2-3eca3e1efd4b admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:54.912208 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107cf327-0f8b-4384-9eb2-3eca3e1efd4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:26:54.912514 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107cf327-0f8b-4384-9eb2-3eca3e1efd4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:54.915019 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107cf327-0f8b-4384-9eb2-3eca3e1efd4b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:54.926482 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1430/2855] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:26:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:26:54.930980 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697a02a-7255-476d-945a-3d30a0ad88ff None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:54.940191 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697a02a-7255-476d-945a-3d30a0ad88ff None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:54.946204 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c4cd0-3247-4df5-940d-57e98246dd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:54.946854 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c4cd0-3247-4df5-940d-57e98246dd7a admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:54.947163 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c4cd0-3247-4df5-940d-57e98246dd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:54.947479 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c4cd0-3247-4df5-940d-57e98246dd7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:54.948192 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c4cd0-3247-4df5-940d-57e98246dd7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:54.950105 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c4cd0-3247-4df5-940d-57e98246dd7a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:55.055165 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1426/2856] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:26:54 2021] POST /identity/v3/projects => generated 367 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:26:55.059388 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cf327-0f8b-4384-9eb2-3eca3e1efd4b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:55.069213 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cf327-0f8b-4384-9eb2-3eca3e1efd4b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:55.123890 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79952431-a194-4734-8b54-12457df73c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:55.124554 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79952431-a194-4734-8b54-12457df73c4b admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:55.124840 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79952431-a194-4734-8b54-12457df73c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:55.125118 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79952431-a194-4734-8b54-12457df73c4b admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:55.125814 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79952431-a194-4734-8b54-12457df73c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:55.127869 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79952431-a194-4734-8b54-12457df73c4b admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:55.219819 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1431/2857] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:26:55 2021] POST /identity/v3/users => generated 284 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:26:55.224112 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c4cd0-3247-4df5-940d-57e98246dd7a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:55.234950 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c4cd0-3247-4df5-940d-57e98246dd7a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:55.239738 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875155cb-c974-4006-979e-b10e6bd64809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:55.240390 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875155cb-c974-4006-979e-b10e6bd64809 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:55.240675 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875155cb-c974-4006-979e-b10e6bd64809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:55.241195 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875155cb-c974-4006-979e-b10e6bd64809 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:55.241978 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875155cb-c974-4006-979e-b10e6bd64809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:55.243638 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875155cb-c974-4006-979e-b10e6bd64809 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:55.254036 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1427/2858] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:26:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:26:55.258444 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79952431-a194-4734-8b54-12457df73c4b admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:55.268283 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79952431-a194-4734-8b54-12457df73c4b admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:55.273957 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab18afd-5a73-4c47-b627-5156f6f6b387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:55.274606 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab18afd-5a73-4c47-b627-5156f6f6b387 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:55.274896 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab18afd-5a73-4c47-b627-5156f6f6b387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:55.275177 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab18afd-5a73-4c47-b627-5156f6f6b387 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:55.275944 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab18afd-5a73-4c47-b627-5156f6f6b387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:55.277519 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab18afd-5a73-4c47-b627-5156f6f6b387 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:55.287591 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1432/2859] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:26:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:26:55.292410 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875155cb-c974-4006-979e-b10e6bd64809 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:55.302068 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875155cb-c974-4006-979e-b10e6bd64809 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:55.306819 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8311cd-96b3-4766-bf75-6867d2c14e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:55.307638 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8311cd-96b3-4766-bf75-6867d2c14e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:55.307923 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8311cd-96b3-4766-bf75-6867d2c14e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:55.308194 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8311cd-96b3-4766-bf75-6867d2c14e03 admin admin] PATH_INFO: `/v3/projects/abb173e0ef684933a3f37fa1d87562a7/users/db28218f8eee435b8c75b5901c2c1ce0/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:55.322912 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8311cd-96b3-4766-bf75-6867d2c14e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb173e0ef684933a3f37fa1d87562a7, user_id=db28218f8eee435b8c75b5901c2c1ce0, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:55.325551 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8311cd-96b3-4766-bf75-6867d2c14e03 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:55.390593 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1428/2860] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:26:55 2021] PUT /identity/v3/projects/abb173e0ef684933a3f37fa1d87562a7/users/db28218f8eee435b8c75b5901c2c1ce0/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:26:55.402633 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f2f31-c195-4f3d-bb2f-f3d5107d9dcd None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:55.402916 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f2f31-c195-4f3d-bb2f-f3d5107d9dcd None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:55.403199 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f2f31-c195-4f3d-bb2f-f3d5107d9dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:55.429242 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-cd4f2f31-c195-4f3d-bb2f-f3d5107d9dcd None None] MFA Rules not processed for user `db28218f8eee435b8c75b5901c2c1ce0`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:26:55.430428 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-cd4f2f31-c195-4f3d-bb2f-f3d5107d9dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:26:55.490827 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1433/2861] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:26:55 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:26:55.503138 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8311cd-96b3-4766-bf75-6867d2c14e03 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:26:55.504849 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-cf8311cd-96b3-4766-bf75-6867d2c14e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:26:55.559956 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8311cd-96b3-4766-bf75-6867d2c14e03 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:26:55.563665 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6255c-213a-47af-bf97-94486fe2a42d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f52add52aa4586aee0b801ceffd764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:26:55.564294 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6255c-213a-47af-bf97-94486fe2a42d service glance] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:26:55.564573 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6255c-213a-47af-bf97-94486fe2a42d service glance] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:26:55.564854 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6255c-213a-47af-bf97-94486fe2a42d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:26:55.573584 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6255c-213a-47af-bf97-94486fe2a42d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:26:55.575019 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6255c-213a-47af-bf97-94486fe2a42d service glance] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:26:55.583711 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1429/2862] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:26:55 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:27:20.881367 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f2f31-c195-4f3d-bb2f-f3d5107d9dcd None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:27:20.882824 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-cd4f2f31-c195-4f3d-bb2f-f3d5107d9dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:27:20.968092 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f2f31-c195-4f3d-bb2f-f3d5107d9dcd None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:27:20.975342 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5568b-cfb7-497f-810c-9d88f5cb45fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e14131fb22470cba63cd5e8db359e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:27:20.976002 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5568b-cfb7-497f-810c-9d88f5cb45fe service nova] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:20.976290 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5568b-cfb7-497f-810c-9d88f5cb45fe service nova] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:20.976572 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5568b-cfb7-497f-810c-9d88f5cb45fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:20.979084 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-10c5568b-cfb7-497f-810c-9d88f5cb45fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:27:20.991543 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5568b-cfb7-497f-810c-9d88f5cb45fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:27:20.993814 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5568b-cfb7-497f-810c-9d88f5cb45fe service nova] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:27:21.004612 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1434/2863] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:27:20 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:27:30.641209 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6255c-213a-47af-bf97-94486fe2a42d service glance] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:27:30.642690 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-3cd6255c-213a-47af-bf97-94486fe2a42d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:27:30.702126 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6255c-213a-47af-bf97-94486fe2a42d service glance] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:27:30.705820 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7cd76-aff4-4664-a964-e7a6ffbd9b72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:27:30.706456 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7cd76-aff4-4664-a964-e7a6ffbd9b72 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:30.706738 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7cd76-aff4-4664-a964-e7a6ffbd9b72 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:30.707012 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7cd76-aff4-4664-a964-e7a6ffbd9b72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:30.708816 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-90b7cd76-aff4-4664-a964-e7a6ffbd9b72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:27:30.768197 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7cd76-aff4-4664-a964-e7a6ffbd9b72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:27:30.769621 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7cd76-aff4-4664-a964-e7a6ffbd9b72 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:27:30.780076 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1430/2864] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:27:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:27:31.632965 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5568b-cfb7-497f-810c-9d88f5cb45fe service nova] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:27:31.643129 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5568b-cfb7-497f-810c-9d88f5cb45fe service nova] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:27:31.647658 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8d51b-c164-43a7-b29f-9023fdff2ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:27:31.648515 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8d51b-c164-43a7-b29f-9023fdff2ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:31.648797 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8d51b-c164-43a7-b29f-9023fdff2ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:31.649073 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8d51b-c164-43a7-b29f-9023fdff2ed2 admin admin] PATH_INFO: `/v3/users/db28218f8eee435b8c75b5901c2c1ce0` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:31.650795 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8d51b-c164-43a7-b29f-9023fdff2ed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db28218f8eee435b8c75b5901c2c1ce0)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:27:31.652943 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8d51b-c164-43a7-b29f-9023fdff2ed2 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:27:31.930143 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-42f8d51b-c164-43a7-b29f-9023fdff2ed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db28218f8eee435b8c75b5901c2c1ce0'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:31.990850 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-42f8d51b-c164-43a7-b29f-9023fdff2ed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db28218f8eee435b8c75b5901c2c1ce0'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:31.999034 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-42f8d51b-c164-43a7-b29f-9023fdff2ed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db28218f8eee435b8c75b5901c2c1ce0'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:31.999733 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-42f8d51b-c164-43a7-b29f-9023fdff2ed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db28218f8eee435b8c75b5901c2c1ce0'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:32.013305 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-42f8d51b-c164-43a7-b29f-9023fdff2ed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db28218f8eee435b8c75b5901c2c1ce0'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:32.020144 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1435/2865] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:27:31 2021] DELETE /identity/v3/users/db28218f8eee435b8c75b5901c2c1ce0 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:27:32.024301 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7251f8-54a8-47f4-be41-bde999afbab7 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:32.024814 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7251f8-54a8-47f4-be41-bde999afbab7 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:32.024909 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7251f8-54a8-47f4-be41-bde999afbab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:32.043400 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-7b7251f8-54a8-47f4-be41-bde999afbab7 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:27:32.052846 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-7b7251f8-54a8-47f4-be41-bde999afbab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:27:32.103344 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1431/2866] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:27:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 04:27:32.114004 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8d51b-c164-43a7-b29f-9023fdff2ed2 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:27:32.115565 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-42f8d51b-c164-43a7-b29f-9023fdff2ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:27:32.176408 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8d51b-c164-43a7-b29f-9023fdff2ed2 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:27:32.180045 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601d355-c224-4f36-b96a-ff8bc0384d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:27:32.180703 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601d355-c224-4f36-b96a-ff8bc0384d19 service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:32.180988 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601d355-c224-4f36-b96a-ff8bc0384d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:32.181276 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601d355-c224-4f36-b96a-ff8bc0384d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:32.192352 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601d355-c224-4f36-b96a-ff8bc0384d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:27:32.193810 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601d355-c224-4f36-b96a-ff8bc0384d19 service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:27:32.204512 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1436/2867] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:27:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:27:32.609047 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7251f8-54a8-47f4-be41-bde999afbab7 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:27:32.610291 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-7b7251f8-54a8-47f4-be41-bde999afbab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:27:32.625664 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7251f8-54a8-47f4-be41-bde999afbab7 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:27:32.632320 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e57d1-9a83-4df4-ae5f-b2f824bf1422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:27:32.633500 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e57d1-9a83-4df4-ae5f-b2f824bf1422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:32.633948 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e57d1-9a83-4df4-ae5f-b2f824bf1422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:32.634385 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e57d1-9a83-4df4-ae5f-b2f824bf1422 admin admin] PATH_INFO: `/v3/projects/abb173e0ef684933a3f37fa1d87562a7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:32.636530 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e57d1-9a83-4df4-ae5f-b2f824bf1422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb173e0ef684933a3f37fa1d87562a7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:27:32.639066 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e57d1-9a83-4df4-ae5f-b2f824bf1422 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:27:32.778879 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-576e57d1-9a83-4df4-ae5f-b2f824bf1422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb173e0ef684933a3f37fa1d87562a7', 'request_id': 'req-576e57d1-9a83-4df4-ae5f-b2f824bf1422'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:32.785364 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-576e57d1-9a83-4df4-ae5f-b2f824bf1422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb173e0ef684933a3f37fa1d87562a7', 'request_id': 'req-576e57d1-9a83-4df4-ae5f-b2f824bf1422'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:32.791652 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-576e57d1-9a83-4df4-ae5f-b2f824bf1422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb173e0ef684933a3f37fa1d87562a7', 'request_id': 'req-576e57d1-9a83-4df4-ae5f-b2f824bf1422'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:32.863380 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-576e57d1-9a83-4df4-ae5f-b2f824bf1422 admin admin] The token cache is being invalidate because project abb173e0ef684933a3f37fa1d87562a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79250) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:27:32.867921 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-576e57d1-9a83-4df4-ae5f-b2f824bf1422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:32.867921 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-576e57d1-9a83-4df4-ae5f-b2f824bf1422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:32.867921 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1432/2868] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:27:32 2021] DELETE /identity/v3/projects/abb173e0ef684933a3f37fa1d87562a7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:27:32.872764 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3521e8-9e7d-4d0c-b8a1-aee5e53c2521 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:32.873283 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3521e8-9e7d-4d0c-b8a1-aee5e53c2521 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:32.873391 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3521e8-9e7d-4d0c-b8a1-aee5e53c2521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:32.894245 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-2b3521e8-9e7d-4d0c-b8a1-aee5e53c2521 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:27:32.895536 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-2b3521e8-9e7d-4d0c-b8a1-aee5e53c2521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:27:32.956357 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1437/2869] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:27:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:27:32.965418 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603f271-f9bd-454b-82dd-617c3320abf3 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:32.965707 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603f271-f9bd-454b-82dd-617c3320abf3 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:32.965999 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603f271-f9bd-454b-82dd-617c3320abf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:32.985024 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-c603f271-f9bd-454b-82dd-617c3320abf3 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:27:32.986247 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-c603f271-f9bd-454b-82dd-617c3320abf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:27:32.996242 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1433/2870] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:27:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:27:33.000322 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3521e8-9e7d-4d0c-b8a1-aee5e53c2521 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:27:33.010935 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3521e8-9e7d-4d0c-b8a1-aee5e53c2521 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:27:33.015974 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faed62-03b5-49db-b150-30f020edb7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:27:33.016751 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faed62-03b5-49db-b150-30f020edb7fc admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:33.017123 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faed62-03b5-49db-b150-30f020edb7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:33.017502 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faed62-03b5-49db-b150-30f020edb7fc admin admin] PATH_INFO: `/v3/domains` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:33.018371 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1faed62-03b5-49db-b150-30f020edb7fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:27:33.018779 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1faed62-03b5-49db-b150-30f020edb7fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:27:33.020612 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1faed62-03b5-49db-b150-30f020edb7fc admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:27:33.037536 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1438/2871] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:27:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:27:33.044346 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603f271-f9bd-454b-82dd-617c3320abf3 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:27:33.059767 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603f271-f9bd-454b-82dd-617c3320abf3 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:27:33.061056 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88ccbe-83dd-48ad-b927-7eb9894944fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:27:33.061835 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88ccbe-83dd-48ad-b927-7eb9894944fc admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:33.062206 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88ccbe-83dd-48ad-b927-7eb9894944fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:33.062551 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88ccbe-83dd-48ad-b927-7eb9894944fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:33.063378 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88ccbe-83dd-48ad-b927-7eb9894944fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:27:33.065371 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88ccbe-83dd-48ad-b927-7eb9894944fc admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:27:33.174771 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1434/2872] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:27:33 2021] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:27:33.179031 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faed62-03b5-49db-b150-30f020edb7fc admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:27:33.194696 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faed62-03b5-49db-b150-30f020edb7fc admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:27:33.256043 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb182b9-c1e6-4cd7-9551-2f57a75f52de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:27:33.256732 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb182b9-c1e6-4cd7-9551-2f57a75f52de admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:33.257016 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb182b9-c1e6-4cd7-9551-2f57a75f52de admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:33.257290 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb182b9-c1e6-4cd7-9551-2f57a75f52de admin admin] PATH_INFO: `/v3/users` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:33.258034 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb182b9-c1e6-4cd7-9551-2f57a75f52de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:27:33.260615 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb182b9-c1e6-4cd7-9551-2f57a75f52de admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:27:33.347664 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1439/2873] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:27:33 2021] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:27:33.348988 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88ccbe-83dd-48ad-b927-7eb9894944fc admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:27:33.359477 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88ccbe-83dd-48ad-b927-7eb9894944fc admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:27:33.364153 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c8a38-cc34-48ae-a4fc-5edb4b48e974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:27:33.364850 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8a38-cc34-48ae-a4fc-5edb4b48e974 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:33.365134 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8a38-cc34-48ae-a4fc-5edb4b48e974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:33.365409 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8a38-cc34-48ae-a4fc-5edb4b48e974 admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:33.366193 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c8a38-cc34-48ae-a4fc-5edb4b48e974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:27:33.367818 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c8a38-cc34-48ae-a4fc-5edb4b48e974 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:27:33.389432 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1435/2874] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:27:33 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:27:33.390973 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb182b9-c1e6-4cd7-9551-2f57a75f52de admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:27:33.401657 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb182b9-c1e6-4cd7-9551-2f57a75f52de admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:27:33.411520 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03119b-9ece-4bd6-b753-457ef1767ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:27:33.411520 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03119b-9ece-4bd6-b753-457ef1767ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:33.411520 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03119b-9ece-4bd6-b753-457ef1767ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:33.411520 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03119b-9ece-4bd6-b753-457ef1767ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:33.411904 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03119b-9ece-4bd6-b753-457ef1767ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:27:33.412544 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03119b-9ece-4bd6-b753-457ef1767ba7 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:27:33.425312 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1440/2875] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:27:33 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 04:27:33.429382 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c8a38-cc34-48ae-a4fc-5edb4b48e974 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:27:33.441121 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c8a38-cc34-48ae-a4fc-5edb4b48e974 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:27:33.446737 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0fc83-a248-4aee-a7fb-876613443d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:27:33.448386 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0fc83-a248-4aee-a7fb-876613443d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:33.448739 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0fc83-a248-4aee-a7fb-876613443d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:33.449224 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0fc83-a248-4aee-a7fb-876613443d1e admin admin] PATH_INFO: `/v3/projects/5aefaed1a2c141bf8363bb8ad5676b30/users/24fc924af9d5451e90d31896b61074b6/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:33.465903 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0fc83-a248-4aee-a7fb-876613443d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aefaed1a2c141bf8363bb8ad5676b30, user_id=24fc924af9d5451e90d31896b61074b6, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:27:33.468750 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0fc83-a248-4aee-a7fb-876613443d1e admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:27:33.555418 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1436/2876] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:27:33 2021] PUT /identity/v3/projects/5aefaed1a2c141bf8363bb8ad5676b30/users/24fc924af9d5451e90d31896b61074b6/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:27:33.562595 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe2db8-236b-41db-b15b-84310d6705d1 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:33.562883 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe2db8-236b-41db-b15b-84310d6705d1 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:33.563162 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe2db8-236b-41db-b15b-84310d6705d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:33.583156 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-78fe2db8-236b-41db-b15b-84310d6705d1 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:27:33.584396 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-78fe2db8-236b-41db-b15b-84310d6705d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:27:33.641579 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1441/2877] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:27:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:27:33.651851 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0fc83-a248-4aee-a7fb-876613443d1e admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:27:33.656106 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-78e0fc83-a248-4aee-a7fb-876613443d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:27:33.714246 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0fc83-a248-4aee-a7fb-876613443d1e admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:27:33.718630 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb585d1-60af-4512-b2b6-ee81b9d4bcd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:27:33.719366 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb585d1-60af-4512-b2b6-ee81b9d4bcd6 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:33.719653 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb585d1-60af-4512-b2b6-ee81b9d4bcd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:33.720044 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb585d1-60af-4512-b2b6-ee81b9d4bcd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:33.729973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb585d1-60af-4512-b2b6-ee81b9d4bcd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:27:33.731529 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb585d1-60af-4512-b2b6-ee81b9d4bcd6 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:27:33.741129 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1437/2878] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:27:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:27:35.111668 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60301ef2-1e62-4e21-9553-607e17d2ec99 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:35.112535 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60301ef2-1e62-4e21-9553-607e17d2ec99 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:35.112815 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60301ef2-1e62-4e21-9553-607e17d2ec99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:35.143036 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-60301ef2-1e62-4e21-9553-607e17d2ec99 None None] MFA Rules not processed for user `24fc924af9d5451e90d31896b61074b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:27:35.145002 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-60301ef2-1e62-4e21-9553-607e17d2ec99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:27:35.214729 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1442/2879] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:27:35 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:27:35.225194 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb585d1-60af-4512-b2b6-ee81b9d4bcd6 service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:27:35.226755 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-9bb585d1-60af-4512-b2b6-ee81b9d4bcd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:27:35.310711 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb585d1-60af-4512-b2b6-ee81b9d4bcd6 service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:27:35.314339 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb4070-2ce0-4113-8185-f6da1746bfca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:27:35.314975 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb4070-2ce0-4113-8185-f6da1746bfca service cinder] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:35.315277 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb4070-2ce0-4113-8185-f6da1746bfca service cinder] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:35.315552 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb4070-2ce0-4113-8185-f6da1746bfca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:35.324525 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb4070-2ce0-4113-8185-f6da1746bfca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:27:35.325952 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb4070-2ce0-4113-8185-f6da1746bfca service cinder] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:27:35.335186 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1438/2880] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:27:35 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:27:37.055047 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11073f-7ada-4849-bf59-3d7dd8c63b52 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:37.055513 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11073f-7ada-4849-bf59-3d7dd8c63b52 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:37.055641 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11073f-7ada-4849-bf59-3d7dd8c63b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:37.074175 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-3d11073f-7ada-4849-bf59-3d7dd8c63b52 None None] MFA Rules not processed for user `24fc924af9d5451e90d31896b61074b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:27:37.075417 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-3d11073f-7ada-4849-bf59-3d7dd8c63b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:27:37.082177 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1443/2881] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:27:37 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:27:37.328426 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb4070-2ce0-4113-8185-f6da1746bfca service cinder] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:27:37.340761 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb4070-2ce0-4113-8185-f6da1746bfca service cinder] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:27:37.345417 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8655e4c-d72e-45e9-9311-46a54b7c4f3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:27:37.346074 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8655e4c-d72e-45e9-9311-46a54b7c4f3c service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:37.346337 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8655e4c-d72e-45e9-9311-46a54b7c4f3c service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:37.346617 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8655e4c-d72e-45e9-9311-46a54b7c4f3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:37.350646 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-d8655e4c-d72e-45e9-9311-46a54b7c4f3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:27:37.362571 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8655e4c-d72e-45e9-9311-46a54b7c4f3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:27:37.364092 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8655e4c-d72e-45e9-9311-46a54b7c4f3c service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:27:37.373416 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1439/2882] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:27:37 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:27:38.351133 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11073f-7ada-4849-bf59-3d7dd8c63b52 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:27:38.352816 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-3d11073f-7ada-4849-bf59-3d7dd8c63b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:27:38.367390 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11073f-7ada-4849-bf59-3d7dd8c63b52 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:27:38.372674 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534e227-540d-4fa5-931c-84071c517814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:27:38.375984 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534e227-540d-4fa5-931c-84071c517814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:38.375984 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534e227-540d-4fa5-931c-84071c517814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:38.375984 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534e227-540d-4fa5-931c-84071c517814 admin admin] PATH_INFO: `/v3/users/97e3605d1b0045e48d5836380ce77dc6` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:38.375984 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534e227-540d-4fa5-931c-84071c517814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e3605d1b0045e48d5836380ce77dc6)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:27:38.377377 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534e227-540d-4fa5-931c-84071c517814 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:27:38.574981 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f534e227-540d-4fa5-931c-84071c517814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e3605d1b0045e48d5836380ce77dc6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:38.647252 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f534e227-540d-4fa5-931c-84071c517814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e3605d1b0045e48d5836380ce77dc6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:38.654600 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f534e227-540d-4fa5-931c-84071c517814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e3605d1b0045e48d5836380ce77dc6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:38.655263 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f534e227-540d-4fa5-931c-84071c517814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e3605d1b0045e48d5836380ce77dc6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:38.667409 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f534e227-540d-4fa5-931c-84071c517814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e3605d1b0045e48d5836380ce77dc6'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:38.673492 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1444/2883] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:27:38 2021] DELETE /identity/v3/users/97e3605d1b0045e48d5836380ce77dc6 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:27:38.767500 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8655e4c-d72e-45e9-9311-46a54b7c4f3c service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:27:38.769204 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-d8655e4c-d72e-45e9-9311-46a54b7c4f3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:27:38.865827 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8655e4c-d72e-45e9-9311-46a54b7c4f3c service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:27:38.924075 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e13e3-9e3e-4664-b0ea-d1a0fc9fcfdd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23c3a2a6cfd4492b7d8eaa62dacec94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:27:38.924728 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e13e3-9e3e-4664-b0ea-d1a0fc9fcfdd service placement] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:38.925020 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e13e3-9e3e-4664-b0ea-d1a0fc9fcfdd service placement] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:38.925299 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e13e3-9e3e-4664-b0ea-d1a0fc9fcfdd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:38.927282 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-4a8e13e3-9e3e-4664-b0ea-d1a0fc9fcfdd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:27:38.929644 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534e227-540d-4fa5-931c-84071c517814 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:27:38.931032 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-f534e227-540d-4fa5-931c-84071c517814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:27:38.942322 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e13e3-9e3e-4664-b0ea-d1a0fc9fcfdd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:27:38.944202 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e13e3-9e3e-4664-b0ea-d1a0fc9fcfdd service placement] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:27:38.956257 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1440/2884] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:27:38 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:27:38.999798 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534e227-540d-4fa5-931c-84071c517814 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:27:39.004412 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11d72d-8862-47b6-95d4-dfead0c978f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:27:39.005267 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11d72d-8862-47b6-95d4-dfead0c978f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:39.005632 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11d72d-8862-47b6-95d4-dfead0c978f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:39.005800 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11d72d-8862-47b6-95d4-dfead0c978f5 admin admin] PATH_INFO: `/v3/projects/8068470657b040ab9af34219d8935846` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:39.006992 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11d72d-8862-47b6-95d4-dfead0c978f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8068470657b040ab9af34219d8935846)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:27:39.008921 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11d72d-8862-47b6-95d4-dfead0c978f5 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:27:39.121951 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-eb11d72d-8862-47b6-95d4-dfead0c978f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8068470657b040ab9af34219d8935846', 'request_id': 'req-eb11d72d-8862-47b6-95d4-dfead0c978f5'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:39.128368 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-eb11d72d-8862-47b6-95d4-dfead0c978f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8068470657b040ab9af34219d8935846', 'request_id': 'req-eb11d72d-8862-47b6-95d4-dfead0c978f5'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:39.133735 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-eb11d72d-8862-47b6-95d4-dfead0c978f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8068470657b040ab9af34219d8935846', 'request_id': 'req-eb11d72d-8862-47b6-95d4-dfead0c978f5'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:39.258260 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-eb11d72d-8862-47b6-95d4-dfead0c978f5 admin admin] The token cache is being invalidate because project 8068470657b040ab9af34219d8935846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:27:39.258553 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-eb11d72d-8862-47b6-95d4-dfead0c978f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:39.259165 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-eb11d72d-8862-47b6-95d4-dfead0c978f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:39.260736 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1445/2885] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:27:38 2021] DELETE /identity/v3/projects/8068470657b040ab9af34219d8935846 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 04:27:39.264742 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e13e3-9e3e-4664-b0ea-d1a0fc9fcfdd service placement] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:27:39.275798 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e13e3-9e3e-4664-b0ea-d1a0fc9fcfdd service placement] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:27:39.330562 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8758847-a3a8-4e14-81c9-f61be66bebe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:27:39.331453 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8758847-a3a8-4e14-81c9-f61be66bebe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:39.331739 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8758847-a3a8-4e14-81c9-f61be66bebe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:39.332053 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8758847-a3a8-4e14-81c9-f61be66bebe5 admin admin] PATH_INFO: `/v3/users/76e7bda8f0bf456a8c522fded8bd1af4` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:39.333269 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8758847-a3a8-4e14-81c9-f61be66bebe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76e7bda8f0bf456a8c522fded8bd1af4)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:27:39.335169 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8758847-a3a8-4e14-81c9-f61be66bebe5 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:27:39.536312 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-e8758847-a3a8-4e14-81c9-f61be66bebe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76e7bda8f0bf456a8c522fded8bd1af4'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:39.630313 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-e8758847-a3a8-4e14-81c9-f61be66bebe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76e7bda8f0bf456a8c522fded8bd1af4'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:39.638341 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-e8758847-a3a8-4e14-81c9-f61be66bebe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76e7bda8f0bf456a8c522fded8bd1af4'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:39.639001 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-e8758847-a3a8-4e14-81c9-f61be66bebe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76e7bda8f0bf456a8c522fded8bd1af4'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:39.651199 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-e8758847-a3a8-4e14-81c9-f61be66bebe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76e7bda8f0bf456a8c522fded8bd1af4'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:39.657205 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1441/2886] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:27:39 2021] DELETE /identity/v3/users/76e7bda8f0bf456a8c522fded8bd1af4 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:27:39.908398 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11d72d-8862-47b6-95d4-dfead0c978f5 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:27:39.909898 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-eb11d72d-8862-47b6-95d4-dfead0c978f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:27:39.923899 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11d72d-8862-47b6-95d4-dfead0c978f5 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:27:39.982232 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da07d9-4f03-40a7-bdc1-fb7ad98e1969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:27:39.983114 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da07d9-4f03-40a7-bdc1-fb7ad98e1969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:27:39.983426 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da07d9-4f03-40a7-bdc1-fb7ad98e1969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:27:39.983698 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da07d9-4f03-40a7-bdc1-fb7ad98e1969 admin admin] PATH_INFO: `/v3/projects/79306b7f404247ca9a8254321142d89b` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:27:39.984930 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da07d9-4f03-40a7-bdc1-fb7ad98e1969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79306b7f404247ca9a8254321142d89b)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:27:39.986820 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da07d9-4f03-40a7-bdc1-fb7ad98e1969 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:27:40.115413 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f2da07d9-4f03-40a7-bdc1-fb7ad98e1969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79306b7f404247ca9a8254321142d89b', 'request_id': 'req-f2da07d9-4f03-40a7-bdc1-fb7ad98e1969'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:40.122376 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f2da07d9-4f03-40a7-bdc1-fb7ad98e1969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79306b7f404247ca9a8254321142d89b', 'request_id': 'req-f2da07d9-4f03-40a7-bdc1-fb7ad98e1969'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:40.127736 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f2da07d9-4f03-40a7-bdc1-fb7ad98e1969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79306b7f404247ca9a8254321142d89b', 'request_id': 'req-f2da07d9-4f03-40a7-bdc1-fb7ad98e1969'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:40.189723 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f2da07d9-4f03-40a7-bdc1-fb7ad98e1969 admin admin] The token cache is being invalidate because project 79306b7f404247ca9a8254321142d89b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:27:40.190017 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f2da07d9-4f03-40a7-bdc1-fb7ad98e1969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:40.190621 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-f2da07d9-4f03-40a7-bdc1-fb7ad98e1969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:27:40.192201 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1446/2887] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:27:39 2021] DELETE /identity/v3/projects/79306b7f404247ca9a8254321142d89b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:28:34.469721 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8758847-a3a8-4e14-81c9-f61be66bebe5 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:28:34.471151 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-e8758847-a3a8-4e14-81c9-f61be66bebe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:28:34.539340 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8758847-a3a8-4e14-81c9-f61be66bebe5 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:28:34.597401 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a0e99-8da7-466e-ae5a-60713d0a0ce1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23c3a2a6cfd4492b7d8eaa62dacec94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:28:34.598327 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a0e99-8da7-466e-ae5a-60713d0a0ce1 service placement] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:28:34.598613 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a0e99-8da7-466e-ae5a-60713d0a0ce1 service placement] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:28:34.598893 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a0e99-8da7-466e-ae5a-60713d0a0ce1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:28:34.601372 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-277a0e99-8da7-466e-ae5a-60713d0a0ce1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:28:34.613172 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a0e99-8da7-466e-ae5a-60713d0a0ce1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:28:34.614742 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a0e99-8da7-466e-ae5a-60713d0a0ce1 service placement] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:28:34.626089 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1442/2888] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:28:34 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:28:48.791344 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d14351-02ea-4eb0-8503-a8c5849f65f6 None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:28:48.791834 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d14351-02ea-4eb0-8503-a8c5849f65f6 None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:28:48.791935 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d14351-02ea-4eb0-8503-a8c5849f65f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:28:48.810093 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-98d14351-02ea-4eb0-8503-a8c5849f65f6 None None] MFA Rules not processed for user `24fc924af9d5451e90d31896b61074b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:28:48.811296 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-98d14351-02ea-4eb0-8503-a8c5849f65f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:28:48.863773 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1447/2889] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:28:48 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:28:49.089121 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a0e99-8da7-466e-ae5a-60713d0a0ce1 service placement] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:28:49.090516 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-277a0e99-8da7-466e-ae5a-60713d0a0ce1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:28:49.143984 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a0e99-8da7-466e-ae5a-60713d0a0ce1 service placement] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:28:49.148159 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11900128-dc63-4d40-9a38-cbd7409b71aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:28:49.148787 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11900128-dc63-4d40-9a38-cbd7409b71aa service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:28:49.149072 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11900128-dc63-4d40-9a38-cbd7409b71aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:28:49.149349 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11900128-dc63-4d40-9a38-cbd7409b71aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:28:49.151494 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-11900128-dc63-4d40-9a38-cbd7409b71aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:28:49.161067 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11900128-dc63-4d40-9a38-cbd7409b71aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:28:49.166179 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11900128-dc63-4d40-9a38-cbd7409b71aa service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:28:49.171097 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1443/2890] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:28:49 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:29:26.049535 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d14351-02ea-4eb0-8503-a8c5849f65f6 None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:29:26.059913 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d14351-02ea-4eb0-8503-a8c5849f65f6 None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:29:26.063451 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3ff04-0f0e-4331-8450-38e6d472e51d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:29:26.064079 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3ff04-0f0e-4331-8450-38e6d472e51d service neutron] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:29:26.064363 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3ff04-0f0e-4331-8450-38e6d472e51d service neutron] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:29:26.064639 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3ff04-0f0e-4331-8450-38e6d472e51d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:29:26.066367 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-18c3ff04-0f0e-4331-8450-38e6d472e51d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:29:26.146488 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3ff04-0f0e-4331-8450-38e6d472e51d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:29:26.148015 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3ff04-0f0e-4331-8450-38e6d472e51d service neutron] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:29:26.168249 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1448/2891] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:29:26 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:29:54.547667 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11900128-dc63-4d40-9a38-cbd7409b71aa service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:29:54.549131 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-11900128-dc63-4d40-9a38-cbd7409b71aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:29:54.614411 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11900128-dc63-4d40-9a38-cbd7409b71aa service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:29:54.618917 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc19ff7-79a7-498c-8799-2672e8db4286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:29:54.619799 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc19ff7-79a7-498c-8799-2672e8db4286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:29:54.620084 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc19ff7-79a7-498c-8799-2672e8db4286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:29:54.620358 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc19ff7-79a7-498c-8799-2672e8db4286 admin admin] PATH_INFO: `/v3/users/24fc924af9d5451e90d31896b61074b6` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:29:54.621591 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc19ff7-79a7-498c-8799-2672e8db4286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24fc924af9d5451e90d31896b61074b6)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:29:54.623527 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc19ff7-79a7-498c-8799-2672e8db4286 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:29:54.801052 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-1fc19ff7-79a7-498c-8799-2672e8db4286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24fc924af9d5451e90d31896b61074b6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:29:54.861826 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-1fc19ff7-79a7-498c-8799-2672e8db4286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24fc924af9d5451e90d31896b61074b6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:29:54.868699 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-1fc19ff7-79a7-498c-8799-2672e8db4286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24fc924af9d5451e90d31896b61074b6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:29:54.869319 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-1fc19ff7-79a7-498c-8799-2672e8db4286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24fc924af9d5451e90d31896b61074b6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:29:54.880502 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-1fc19ff7-79a7-498c-8799-2672e8db4286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24fc924af9d5451e90d31896b61074b6'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:29:54.886124 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1444/2892] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:29:54 2021] DELETE /identity/v3/users/24fc924af9d5451e90d31896b61074b6 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:29:55.130806 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3ff04-0f0e-4331-8450-38e6d472e51d service neutron] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:29:55.141933 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3ff04-0f0e-4331-8450-38e6d472e51d service neutron] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:29:55.198339 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1320fe4-bdda-421f-a377-8a1a6ed99896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:29:55.199198 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1320fe4-bdda-421f-a377-8a1a6ed99896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:29:55.199511 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1320fe4-bdda-421f-a377-8a1a6ed99896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:29:55.199790 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1320fe4-bdda-421f-a377-8a1a6ed99896 admin admin] PATH_INFO: `/v3/projects/5aefaed1a2c141bf8363bb8ad5676b30` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:29:55.200981 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1320fe4-bdda-421f-a377-8a1a6ed99896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aefaed1a2c141bf8363bb8ad5676b30)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:29:55.203669 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1320fe4-bdda-421f-a377-8a1a6ed99896 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:29:55.294612 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a1320fe4-bdda-421f-a377-8a1a6ed99896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aefaed1a2c141bf8363bb8ad5676b30', 'request_id': 'req-a1320fe4-bdda-421f-a377-8a1a6ed99896'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:29:55.300779 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a1320fe4-bdda-421f-a377-8a1a6ed99896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aefaed1a2c141bf8363bb8ad5676b30', 'request_id': 'req-a1320fe4-bdda-421f-a377-8a1a6ed99896'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:29:55.306030 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a1320fe4-bdda-421f-a377-8a1a6ed99896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aefaed1a2c141bf8363bb8ad5676b30', 'request_id': 'req-a1320fe4-bdda-421f-a377-8a1a6ed99896'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:29:55.358126 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a1320fe4-bdda-421f-a377-8a1a6ed99896 admin admin] The token cache is being invalidate because project 5aefaed1a2c141bf8363bb8ad5676b30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:29:55.358419 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a1320fe4-bdda-421f-a377-8a1a6ed99896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:29:55.359039 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-a1320fe4-bdda-421f-a377-8a1a6ed99896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:29:55.360612 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1449/2893] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:29:55 2021] DELETE /identity/v3/projects/5aefaed1a2c141bf8363bb8ad5676b30 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:29:55.366387 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14cd00-f24b-4966-9d6e-2db882e09031 None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:29:55.366672 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14cd00-f24b-4966-9d6e-2db882e09031 None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:29:55.366949 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14cd00-f24b-4966-9d6e-2db882e09031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:29:55.384441 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-8f14cd00-f24b-4966-9d6e-2db882e09031 None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:29:55.385555 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-8f14cd00-f24b-4966-9d6e-2db882e09031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:29:55.441641 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1445/2894] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:29:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:29:55.449640 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a267ce8-cf8f-4dad-b9bf-5fa20498fbab None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:29:55.449934 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a267ce8-cf8f-4dad-b9bf-5fa20498fbab None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:29:55.450214 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a267ce8-cf8f-4dad-b9bf-5fa20498fbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:29:55.468938 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-1a267ce8-cf8f-4dad-b9bf-5fa20498fbab None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:29:55.470132 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-1a267ce8-cf8f-4dad-b9bf-5fa20498fbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:29:55.477897 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1450/2895] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:29:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:29:55.481976 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14cd00-f24b-4966-9d6e-2db882e09031 None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:29:55.491403 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14cd00-f24b-4966-9d6e-2db882e09031 None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:29:55.495921 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bbe6a-6f5a-4d2b-b6ec-147e2280c8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:29:55.496564 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bbe6a-6f5a-4d2b-b6ec-147e2280c8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:29:55.496846 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bbe6a-6f5a-4d2b-b6ec-147e2280c8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:29:55.497122 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bbe6a-6f5a-4d2b-b6ec-147e2280c8f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:29:55.497849 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bbe6a-6f5a-4d2b-b6ec-147e2280c8f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79250) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 04:29:55.498154 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bbe6a-6f5a-4d2b-b6ec-147e2280c8f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:29:55.500290 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bbe6a-6f5a-4d2b-b6ec-147e2280c8f4 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:29:55.511347 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1446/2896] 10.222.0.54 () {58 vars in 1152 bytes} [Tue Nov 23 04:29:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 04:29:55.516055 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a267ce8-cf8f-4dad-b9bf-5fa20498fbab None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:29:55.525355 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a267ce8-cf8f-4dad-b9bf-5fa20498fbab None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:29:55.529976 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374cfbd-c2bb-44b3-beb8-2be9b312a5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:29:55.530611 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374cfbd-c2bb-44b3-beb8-2be9b312a5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:29:55.530886 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374cfbd-c2bb-44b3-beb8-2be9b312a5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:29:55.531156 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374cfbd-c2bb-44b3-beb8-2be9b312a5c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:29:55.531881 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374cfbd-c2bb-44b3-beb8-2be9b312a5c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:29:55.533735 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374cfbd-c2bb-44b3-beb8-2be9b312a5c0 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:29:55.617337 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1451/2897] 10.222.0.54 () {60 vars in 1152 bytes} [Tue Nov 23 04:29:55 2021] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:29:55.621386 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bbe6a-6f5a-4d2b-b6ec-147e2280c8f4 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:29:55.631790 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bbe6a-6f5a-4d2b-b6ec-147e2280c8f4 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:29:55.687643 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6957474-bce1-4faf-8606-c4180d399c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:29:55.688314 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6957474-bce1-4faf-8606-c4180d399c01 admin admin] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:29:55.688601 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6957474-bce1-4faf-8606-c4180d399c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:29:55.688909 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6957474-bce1-4faf-8606-c4180d399c01 admin admin] PATH_INFO: `/v3/users` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:29:55.689620 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6957474-bce1-4faf-8606-c4180d399c01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:29:55.691641 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6957474-bce1-4faf-8606-c4180d399c01 admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:29:55.759017 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1447/2898] 10.222.0.54 () {60 vars in 1143 bytes} [Tue Nov 23 04:29:55 2021] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 04:29:55.763061 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374cfbd-c2bb-44b3-beb8-2be9b312a5c0 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:29:55.773418 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374cfbd-c2bb-44b3-beb8-2be9b312a5c0 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:29:55.778473 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebdd84-950c-464e-b6d9-30c12887984c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:29:55.779119 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebdd84-950c-464e-b6d9-30c12887984c admin admin] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:29:55.779435 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebdd84-950c-464e-b6d9-30c12887984c admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:29:55.779798 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebdd84-950c-464e-b6d9-30c12887984c admin admin] PATH_INFO: `/v3/roles` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:29:55.780577 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebdd84-950c-464e-b6d9-30c12887984c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:29:55.782167 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebdd84-950c-464e-b6d9-30c12887984c admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:29:55.793437 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1452/2899] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:29:55 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:29:55.798087 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6957474-bce1-4faf-8606-c4180d399c01 admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:29:55.807894 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6957474-bce1-4faf-8606-c4180d399c01 admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:29:55.813045 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce6fed-46cf-4055-8282-649d58f8d80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:29:55.813691 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce6fed-46cf-4055-8282-649d58f8d80c admin admin] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:29:55.813973 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce6fed-46cf-4055-8282-649d58f8d80c admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:29:55.814250 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce6fed-46cf-4055-8282-649d58f8d80c admin admin] PATH_INFO: `/v3/roles` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:29:55.814986 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce6fed-46cf-4055-8282-649d58f8d80c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:29:55.816585 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce6fed-46cf-4055-8282-649d58f8d80c admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:29:55.826343 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1448/2900] 10.222.0.54 () {58 vars in 1121 bytes} [Tue Nov 23 04:29:55 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 04:29:55.831709 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebdd84-950c-464e-b6d9-30c12887984c admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:29:55.841599 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebdd84-950c-464e-b6d9-30c12887984c admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:29:55.846383 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752d09c-f27d-4a43-94cb-962db71cc9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:29:55.847303 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752d09c-f27d-4a43-94cb-962db71cc9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:29:55.851752 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752d09c-f27d-4a43-94cb-962db71cc9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:29:55.851752 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752d09c-f27d-4a43-94cb-962db71cc9c9 admin admin] PATH_INFO: `/v3/projects/b11daa25048d456d80179c1a9326c919/users/99e2afe2080c40ba8938a9fe0c5b9a4b/roles/c817e9fe7d034dd4ac25b1f45fd209c7` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:29:55.863371 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752d09c-f27d-4a43-94cb-962db71cc9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b11daa25048d456d80179c1a9326c919, user_id=99e2afe2080c40ba8938a9fe0c5b9a4b, role_id=c817e9fe7d034dd4ac25b1f45fd209c7)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:29:55.865985 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752d09c-f27d-4a43-94cb-962db71cc9c9 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:29:55.947399 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1453/2901] 10.222.0.54 () {60 vars in 1482 bytes} [Tue Nov 23 04:29:55 2021] PUT /identity/v3/projects/b11daa25048d456d80179c1a9326c919/users/99e2afe2080c40ba8938a9fe0c5b9a4b/roles/c817e9fe7d034dd4ac25b1f45fd209c7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:29:55.957159 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a6a37-2812-4634-b8c2-9c5e5d95ccdb None None] REQUEST_METHOD: `POST` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:29:55.957450 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a6a37-2812-4634-b8c2-9c5e5d95ccdb None None] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:29:55.957735 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a6a37-2812-4634-b8c2-9c5e5d95ccdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:29:55.985088 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.auth.core [None req-f25a6a37-2812-4634-b8c2-9c5e5d95ccdb None None] MFA Rules not processed for user `99e2afe2080c40ba8938a9fe0c5b9a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79250) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:29:55.986316 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-f25a6a37-2812-4634-b8c2-9c5e5d95ccdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:29:56.047791 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1449/2902] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:29:55 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:29:56.057623 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752d09c-f27d-4a43-94cb-962db71cc9c9 admin admin] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:29:56.059320 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-4752d09c-f27d-4a43-94cb-962db71cc9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:29:56.113662 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752d09c-f27d-4a43-94cb-962db71cc9c9 admin admin] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:29:56.117314 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d7c3b-0d80-42b3-adfd-0831d47369d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dd4736db18940b8961c73142381cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:29:56.117949 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d7c3b-0d80-42b3-adfd-0831d47369d1 service cinder] REQUEST_METHOD: `GET` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:29:56.118235 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d7c3b-0d80-42b3-adfd-0831d47369d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:29:56.118515 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d7c3b-0d80-42b3-adfd-0831d47369d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:29:56.127420 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d7c3b-0d80-42b3-adfd-0831d47369d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:29:56.128864 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d7c3b-0d80-42b3-adfd-0831d47369d1 service cinder] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:29:56.137444 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1454/2903] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:29:56 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:30:16.744052 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a6a37-2812-4634-b8c2-9c5e5d95ccdb None None] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:30:16.803658 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a6a37-2812-4634-b8c2-9c5e5d95ccdb None None] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:30:16.808061 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5886a-95d7-4c1d-b7e7-3f9af2f46d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:30:16.808903 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5886a-95d7-4c1d-b7e7-3f9af2f46d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:30:16.809183 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5886a-95d7-4c1d-b7e7-3f9af2f46d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:30:16.809452 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5886a-95d7-4c1d-b7e7-3f9af2f46d1a admin admin] PATH_INFO: `/v3/users/99e2afe2080c40ba8938a9fe0c5b9a4b` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:30:16.810628 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5886a-95d7-4c1d-b7e7-3f9af2f46d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=99e2afe2080c40ba8938a9fe0c5b9a4b)` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:30:16.813152 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5886a-95d7-4c1d-b7e7-3f9af2f46d1a admin admin] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:30:16.988854 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f1c5886a-95d7-4c1d-b7e7-3f9af2f46d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99e2afe2080c40ba8938a9fe0c5b9a4b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:30:17.059701 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f1c5886a-95d7-4c1d-b7e7-3f9af2f46d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99e2afe2080c40ba8938a9fe0c5b9a4b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:30:17.067238 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f1c5886a-95d7-4c1d-b7e7-3f9af2f46d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99e2afe2080c40ba8938a9fe0c5b9a4b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:30:17.067861 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f1c5886a-95d7-4c1d-b7e7-3f9af2f46d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99e2afe2080c40ba8938a9fe0c5b9a4b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:30:17.079786 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.notifications [None req-f1c5886a-95d7-4c1d-b7e7-3f9af2f46d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99e2afe2080c40ba8938a9fe0c5b9a4b'} {{(pid=79250) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:30:17.086169 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1450/2904] 10.222.0.54 () {58 vars in 1223 bytes} [Tue Nov 23 04:30:16 2021] DELETE /identity/v3/users/99e2afe2080c40ba8938a9fe0c5b9a4b => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:30:17.089936 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c27114-e3df-401c-ad21-b5494600f50f None None] REQUEST_METHOD: `POST` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:30:17.090457 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c27114-e3df-401c-ad21-b5494600f50f None None] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:30:17.090561 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c27114-e3df-401c-ad21-b5494600f50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:30:17.107150 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.auth.core [None req-a3c27114-e3df-401c-ad21-b5494600f50f None None] MFA Rules not processed for user `2323192b0179440984840bcf5178ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=79251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 04:30:17.108371 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-a3c27114-e3df-401c-ad21-b5494600f50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:30:17.165148 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1455/2905] 10.222.0.54 () {58 vars in 957 bytes} [Tue Nov 23 04:30:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 04:30:17.175381 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5886a-95d7-4c1d-b7e7-3f9af2f46d1a admin admin] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:30:17.176789 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-f1c5886a-95d7-4c1d-b7e7-3f9af2f46d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:30:17.231112 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5886a-95d7-4c1d-b7e7-3f9af2f46d1a admin admin] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:30:17.234768 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40a522-7657-48b2-8ba0-6553877a94e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06e29d656f48c99caeb193975b5b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:30:17.235972 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40a522-7657-48b2-8ba0-6553877a94e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:30:17.236252 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40a522-7657-48b2-8ba0-6553877a94e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:30:17.236527 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40a522-7657-48b2-8ba0-6553877a94e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:30:17.245351 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40a522-7657-48b2-8ba0-6553877a94e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:30:17.246690 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40a522-7657-48b2-8ba0-6553877a94e6 service neutron] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:30:17.256391 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1451/2906] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:30:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 04:30:17.640694 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c27114-e3df-401c-ad21-b5494600f50f None None] Authenticating user token {{(pid=79251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:30:17.642244 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.fernet_utils [None req-a3c27114-e3df-401c-ad21-b5494600f50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:30:17.654418 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c27114-e3df-401c-ad21-b5494600f50f None None] Validating token access rules against request {{(pid=79251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:30:17.660138 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006207d-82f9-4886-9214-f243b9f6f707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2323192b0179440984840bcf5178ed35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a46903e1a0df4e5bbff165f0dc8442a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:30:17.660985 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006207d-82f9-4886-9214-f243b9f6f707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:30:17.661388 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006207d-82f9-4886-9214-f243b9f6f707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:30:17.661665 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006207d-82f9-4886-9214-f243b9f6f707 admin admin] PATH_INFO: `/v3/projects/b11daa25048d456d80179c1a9326c919` {{(pid=79251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:30:17.662970 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006207d-82f9-4886-9214-f243b9f6f707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b11daa25048d456d80179c1a9326c919)` {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:30:17.664917 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006207d-82f9-4886-9214-f243b9f6f707 admin admin] RBAC: Authorization granted {{(pid=79251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:30:17.787041 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-6006207d-82f9-4886-9214-f243b9f6f707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b11daa25048d456d80179c1a9326c919', 'request_id': 'req-6006207d-82f9-4886-9214-f243b9f6f707'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:30:17.793009 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-6006207d-82f9-4886-9214-f243b9f6f707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b11daa25048d456d80179c1a9326c919', 'request_id': 'req-6006207d-82f9-4886-9214-f243b9f6f707'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:30:17.798905 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-6006207d-82f9-4886-9214-f243b9f6f707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b11daa25048d456d80179c1a9326c919', 'request_id': 'req-6006207d-82f9-4886-9214-f243b9f6f707'} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:30:17.878352 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-6006207d-82f9-4886-9214-f243b9f6f707 admin admin] The token cache is being invalidate because project b11daa25048d456d80179c1a9326c919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 04:30:17.878646 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-6006207d-82f9-4886-9214-f243b9f6f707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:30:17.879353 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: DEBUG keystone.notifications [None req-6006207d-82f9-4886-9214-f243b9f6f707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 04:30:17.880916 dv-cinder-768458-16-iscsi devstack@keystone.service[79251]: [pid: 79251|app: 0|req: 1456/2907] 10.222.0.54 () {58 vars in 1232 bytes} [Tue Nov 23 04:30:17 2021] DELETE /identity/v3/projects/b11daa25048d456d80179c1a9326c919 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 04:33:36.715838 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40a522-7657-48b2-8ba0-6553877a94e6 service neutron] Authenticating user token {{(pid=79250) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 04:33:36.717205 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-2e40a522-7657-48b2-8ba0-6553877a94e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:33:36.781948 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40a522-7657-48b2-8ba0-6553877a94e6 service neutron] Validating token access rules against request {{(pid=79250) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 04:33:36.837876 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d937e78-6dfe-4ce2-bf66-bc8fd98edfb2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23c3a2a6cfd4492b7d8eaa62dacec94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa78bb05b3e48f3a9c973567c781357', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79250) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 04:33:36.838507 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d937e78-6dfe-4ce2-bf66-bc8fd98edfb2 service placement] REQUEST_METHOD: `GET` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 04:33:36.838787 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d937e78-6dfe-4ce2-bf66-bc8fd98edfb2 service placement] SCRIPT_NAME: `/identity` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 04:33:36.839060 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d937e78-6dfe-4ce2-bf66-bc8fd98edfb2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79250) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 04:33:36.840831 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.fernet_utils [None req-5d937e78-6dfe-4ce2-bf66-bc8fd98edfb2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79250) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 04:33:36.851534 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d937e78-6dfe-4ce2-bf66-bc8fd98edfb2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 04:33:36.853085 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d937e78-6dfe-4ce2-bf66-bc8fd98edfb2 service placement] RBAC: Authorization granted {{(pid=79250) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 04:33:36.862653 dv-cinder-768458-16-iscsi devstack@keystone.service[79250]: [pid: 79250|app: 0|req: 1452/2908] 10.222.0.54 () {60 vars in 1365 bytes} [Tue Nov 23 04:33:36 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)